User interface for sharing content with other electronic devices
By combining a touch-sensitive display and a touchpad, and utilizing contact intensity sensors and tactile output generators, efficient content sharing and privacy protection between electronic devices are achieved, solving the problems of redundant input and privacy protection in user interaction, and improving the efficiency and security of device use.
Patent Information
- Application Number
- CN202210128123.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-09-26
- Filing Date
- 2020-05-06
- Publication Date
- 2025-09-05
- Estimated Expiration
- 2040-05-06
AI Technical Summary
In the prior art, how to efficiently share content and reduce redundant user input during user interaction with electronic devices, especially when powered by batteries, and how to ensure the privacy protection of personally identifiable information.
By combining a touch-sensitive display and a touchpad on an electronic device, using a contact intensity sensor and a tactile output generator, tactile feedback is provided, and content is shared with other devices through RF circuits, while sharing options and setting modification options are presented in the user interface to ensure reliable identification and privacy protection within a range of orientations.
It improves user interaction efficiency, reduces redundant input, saves processor and battery power, and ensures privacy protection and reliability of content sharing.
Smart Images

Figure CN114706522B_ABST
Abstract
Description
[0001] This application is a divisional application of the invention patent application with application number 202080049301.7, application date May 6, 2020, and invention name “User interface for sharing content with other electronic devices”.
[0002] CROSS-REFERENCE TO RELATED APPLICATIONS
[0003] This patent application claims the benefit of U.S. patent application 62 / 843,958, filed May 6, 2019, U.S. provisional application 62 / 897,741, filed September 9, 2019, and U.S. patent application 16 / 584,685, filed September 26, 2019, the contents of which are hereby incorporated by reference in their entirety for all purposes. Technical Field
[0004] The present invention generally relates to electronic devices that display user interfaces for sharing content with other electronic devices, and user interaction with such devices. Background Art
[0005] In recent years, users' interactions with electronic devices have increased significantly. These devices can be devices such as computers, tablets, televisions, multimedia devices, mobile devices, etc.
[0006] In some cases, users want to share content with other electronic devices. Enhancing these interactions can improve the user experience with the device and reduce user interaction time, which is especially important when the input device is battery-powered.
[0007] It is understood that the use of personally identifiable information should be subject to privacy policies and practices that are generally recognized to meet or exceed industry or government requirements for maintaining user privacy. Specifically, personally identifiable information data should be managed and processed to minimize the risk of unintentional or unauthorized access or use, and the nature of authorized use should be clearly stated to users. Summary of the Invention
[0008] Some embodiments described in the present disclosure relate to one or more first electronic devices that present an option that can be selected to share content with a second electronic device that is oriented toward the first electronic device. Some embodiments described in the present disclosure relate to one or more first electronic devices that present an indication to change the orientation of the electronic device when the orientation of the electronic device is outside of an orientation range in which circuitry of another electronic device that identifies that the electronic device is to share content can function with desired reliability. Some embodiments described in the present disclosure relate to one or more electronic devices that present a sharing user interface within an action user interface associated with an application on the electronic device. Some embodiments described in the present disclosure relate to one or more electronic devices that present a user interface for modifying content according to one or more settings before sharing the content with another electronic device. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] For a better understanding of the various described embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, in which like reference numerals designate corresponding parts throughout the several views.
[0010] Figure 1A is a block diagram illustrating a portable multifunction device with a touch-sensitive display according to some embodiments.
[0011] Figure 1B is a block diagram illustrating example components for event processing according to some embodiments.
[0012] Figure 2 A portable multifunction device with a touch screen according to some embodiments is shown.
[0013] Figure 3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments.
[0014] Figure 4A An exemplary user interface for an application menu on a portable multifunction device according to some embodiments is shown.
[0015] Figure 4B An exemplary user interface is shown for a multifunction device having a touch-sensitive surface separate from the display according to some embodiments.
[0016] Figure 5A A personal electronic device according to some embodiments is shown.
[0017] Figure 5B is a block diagram illustrating a personal electronic device according to some embodiments.
[0018] Figures 5C to 5DExample components of a personal electronic device with a touch-sensitive display and an intensity sensor are shown according to some embodiments.
[0019] Figures 5E to 5H Exemplary components and user interfaces of a personal electronic device according to some embodiments are shown.
[0020] Figures 5I to 5N A set of sample tactile output patterns are provided that can be used, individually or in combination, as is or through one or more transformations (e.g., modulation, amplification, truncation, etc.) to generate suitable tactile feedback in various scenarios and for various purposes (such as those described above and those described with respect to the user interfaces and methods discussed herein).
[0021] Figures 6A to 6S Illustrated are exemplary ways in which a first electronic device presents options selectable to share content with a second electronic device toward which the first electronic device is oriented, according to some embodiments of the present disclosure.
[0022] Figures 6T to 6KK An exemplary manner is shown in which a first electronic device according to some embodiments of the present disclosure presents an indication of changing the orientation of the electronic device when the orientation of the electronic device is outside an orientation range in which the circuitry of another electronic device that identifies the electronic device with which the electronic device wants to share content can function with the desired reliability.
[0023] Figures 7A to 7J is a flow chart illustrating a method of presenting options selectable to share content with a second electronic device toward which a first electronic device is oriented according to some embodiments of the present disclosure.
[0024] Figures 7K to 7P is a flowchart illustrating a method for presenting an indication of changing the orientation of an electronic device when the orientation of the electronic device is outside an orientation range within which a circuit that identifies another electronic device with which the electronic device wants to share content can function with desired reliability according to some embodiments of the present disclosure.
[0025] Figures 8A to 8J An exemplary manner in which an electronic device presents a sharing user interface within an action user interface of an application according to some embodiments of the present disclosure is shown.
[0026] Figures 9A to 9C is a flowchart illustrating a method of presenting a sharing user interface within an action user interface of an application according to some embodiments of the present disclosure.
[0027] Figures 10A to 10BBAn exemplary manner in which an electronic device presents one or more options for changing one or more settings associated with a content item before sharing the content is shown according to some embodiments of the present disclosure.
[0028] Figures 11A to 11F is a flow diagram illustrating a method of presenting one or more options for changing one or more settings associated with a content item prior to sharing the content, according to some embodiments of the present disclosure. DETAILED DESCRIPTION
[0029] The following description sets forth exemplary methods, parameters, etc. However, it should be recognized that such description is not intended to limit the scope of the present disclosure, but is provided as a description of exemplary embodiments.
[0030] Electronic devices that need to share content with other electronic devices. Such techniques can reduce the cognitive burden on users who use such devices and / or wish to control their use of such devices. In addition, such techniques can reduce processor power and battery power that would otherwise be wasted on redundant user input.
[0031] Although the following description uses the terms "first," "second," and the like to describe various elements, these elements should not be limited by these terms. These terms are merely used to distinguish one element from another. For example, a first touch may be named a second touch, and similarly, a second touch may be named a first touch, without departing from the scope of the various embodiments described. Both the first touch and the second touch are touches, but they are not the same touch.
[0032] The terms used in the description of the various embodiments described herein are only for the purpose of describing specific embodiments and are not intended to be limiting. As used in the description of the various embodiments described and in the appended claims, the singular forms "a" and "the" are intended to also include plural forms unless the context clearly indicates otherwise. It will also be understood that the terms "and / or" used herein refer to and encompass any and all possible combinations of one or more items in the associated listed items. It will also be understood that the terms "includes," "including," "comprises," and / or "comprising" when used in this specification specify the presence of stated features, integers, steps, operations, elements, and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts, and / or their groupings.
[0033] The term "if" is optionally interpreted to mean "when," "upon," or "in response to determining," or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined that," or "if [stated condition or event] is detected" are optionally interpreted to mean "upon determining," or "in response to determining," or "upon detecting [stated condition or event]," or "in response to detecting [stated condition or event]," depending on the context.
[0034] Embodiments of electronic devices, user interfaces for such devices, and processes associated with using such devices are described herein. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as a PDA and / or music player. Exemplary embodiments of portable multifunction devices include, but are not limited to, the Apple Watch from Apple Inc. (Cupertino, California). Devices, iPod equipment, and Device. Other portable electronic devices, such as laptops or tablets with touch-sensitive surfaces (e.g., touch screen displays and / or trackpads), are optionally used. It should also be understood that in some embodiments, the device is not a portable communication device, but rather a desktop computer with a touch-sensitive surface (e.g., touch screen displays and / or trackpads).
[0035] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick.
[0036] The device typically supports a variety of applications, such as one or more of the following: a drawing application, a rendering application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.
[0037] Various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or varied for different applications and / or adjusted and / or varied within the respective applications. In this way, the common physical architecture of the device (such as the touch-sensitive surface) optionally supports the various applications with a user interface that is intuitive and clear to the user.
[0038] Attention is now turned to embodiments of portable devices having touch-sensitive displays. Figure 1A 1 is a block diagram illustrating a portable multifunction device 100 with a touch-sensitive display system 112 according to some embodiments. Touch-sensitive display 112 is sometimes referred to as a "touch screen" for convenience, and is sometimes referred to as or referred to as a "touch-sensitive display system." Device 100 includes memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and external ports 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact intensity sensors 165 for detecting the intensity of contacts on device 100 (e.g., a touch-sensitive surface, such as touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile output on device 100 (e.g., generating tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touch pad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.
[0039] As used in this specification and claims, the term "intensity" of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or to a surrogate (surrogate) for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values that includes at least four different values and more typically includes hundreds of different values (e.g., at least 256). The intensity of a contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure the force at different points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted averaged) to determine an estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and / or its change, the capacitance of the touch-sensitive surface near the contact and / or its change, and / or the resistance of the touch-sensitive surface near the contact and / or its change are optionally used as a surrogate for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the surrogate measurement of the contact force or pressure is used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the surrogate measurement). In some embodiments, the surrogate measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of the contact as an attribute of the user input allows the user to access additional device functionality that would otherwise be inaccessible to the user on a smaller device with limited real estate, which is used to display an indication (e.g., on a touch-sensitive display) and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls, such as knobs or buttons).
[0040] As used in this specification and claims, the term "tactile output" refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of a device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device that will be detected by a user using the user's sense of touch. For example, when a device or a component of the device is in contact with a surface that is touch-sensitive to a user (e.g., a finger, palm, or other part of the user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation that corresponds to a perceived change in a physical characteristic of the device or component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a "press click" or "release click" on a physical actuation button. In some cases, the user will feel a tactile sensation, such as a "press click" or "release click," even when the physical actuation button associated with the touch-sensitive surface that was physically pressed (e.g., displaced) by the user's movement does not move. As another example, even when the smoothness of the touch-sensitive surface does not change, movement of the touch-sensitive surface may optionally be interpreted or sensed by the user as "roughness" of the touch-sensitive surface. While such a user's interpretation of touch will be limited by the user's individualized sensory perceptions, many sensory perceptions of touch are common to most users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., "press click," "release click," "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or a component thereof that would generate that sensory perception for a typical (or average) user.
[0041] It should be understood that device 100 is merely one example of a portable multifunction device and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. Figure 1A The various components shown in the EMBODIMENTS 100 are implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.
[0042] Memory 102 optionally includes high-speed random access memory and optionally includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.
[0043] Peripherals interface 118 may be used to couple the device's input and output peripherals to CPU 120 and memory 102. One or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform various functions of device 100 and process data. In some embodiments, peripherals interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.
[0044] RF (radio frequency) circuitry 108 receives and transmits RF signals, also known as electromagnetic signals. RF circuitry 108 converts electrical signals into / from electromagnetic signals and communicates with communication networks and other communication devices via the electromagnetic signals. RF circuitry 108 optionally includes well-known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec chipset, a subscriber identity module (SIM) card, memory, and the like. RF circuitry 108 optionally communicates with networks and other devices via wireless communications, such as the Internet (also known as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs)). RF circuitry 108 optionally includes well-known circuitry for detecting near-field communication (NFC) fields, such as via a short-range communication radio. The wireless communication optionally uses any of a variety of communication standards, protocols and technologies, including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Evolution, Data Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Message Access Protocol (IMAP)), and / or IEEE 802.11n. and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Utilizing Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.
[0045] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 111. The speaker 111 converts the electrical signals into sound waves audible to humans. The audio circuit 110 also receives electrical signals converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signals into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., Figure 2 The headset jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset with both output (e.g., a single or dual-ear headset) and input (e.g., a microphone).
[0046] The I / O subsystem 106 couples input / output peripherals on the device 100, such as the touch screen 112 and other input control devices 116, to a peripherals interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a tactile feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals from / to other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, etc. In some alternative embodiments, the input controllers 160 are optionally coupled to any (or none) of the following: a keyboard, an infrared port, a USB port, and a pointing device such as a mouse. One or more buttons (e.g., Figure 2 208) optionally includes an up / down button for volume control of the speaker 111 and / or microphone 113. The one or more buttons optionally include a push button (e.g., Figure 2 206 in the ).
[0047] A quick press of the push button optionally releases the lock on the touch screen 112 or optionally initiates the process of unlocking the device using gestures on the touch screen, as described in U.S. patent application Ser. No. 11 / 322,549, filed Dec. 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image," (i.e., U.S. Patent No. 7,657,849), which is hereby incorporated by reference in its entirety. A long press of the push button (e.g., 206) optionally turns the device 100 on or off. The functions of one or more buttons are optionally user-customizable. The touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.
[0048] The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch screen 112 and / or sends electrical signals to the touch screen 112. The touch screen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.
[0049] The touch screen 112 has a touch-sensitive surface, sensor, or set of sensors that accepts input from the user based on haptic and / or tactile contact. The touch screen 112 and display controller 156 (together with any associated modules and / or instruction sets in memory 102) detect contact (and any movement or interruption of that contact) on the touch screen 112 and convert the detected contact into interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch screen 112. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to the user's finger.
[0050] The touch screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. The touch screen 112 and display controller 156 optionally use any of a variety of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen 112 to detect contact and any movement or interruption thereof. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as in the Apple ® from Apple Inc. (Cupertino, California). and iPod The technology used in
[0051] The touch-sensitive display in some embodiments of the touch screen 112 is optionally similar to the multi-touch-sensitive trackpad described in the following U.S. Patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.), and / or U.S. Patent Publication 2002 / 0015024A1, each of which is hereby incorporated by reference in its entirety. However, the touch screen 112 displays visual output from the device 100, while a touch-sensitive trackpad does not provide visual output.
[0052] In some embodiments, the touch-sensitive display of the touch screen 112 is as described in the following patent applications: (1) U.S. patent application No. 11 / 381,313, filed on May 2, 2006, entitled “Multipoint Touch Surface Controller”; (2) U.S. patent application No. 10 / 840,862, filed on May 6, 2004, entitled “Multipoint Touchscreen”; (3) U.S. patent application No. 10 / 903,964, filed on July 30, 2004, entitled “Gestures For Touch Sensitive Input Devices”; (4) U.S. patent application No. 11 / 048,264, filed on January 31, 2005, entitled “Gestures For Touch Sensitive Input Devices”; (5) U.S. patent application No. 11 / 050,264, filed on January 18, 2005, entitled “Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices”; (6) U.S. Patent Application No. 11 / 228,758, filed on September 16, 2005, entitled “Virtual Input Device Placement On A Touch Screen User Interface”; (7) U.S. Patent Application No. 11 / 228,700, filed on September 16, 2005, entitled “Operation Of A Computer With A Touch Screen Interface”; (8) U.S. Patent Application No. 11 / 228,737, filed on September 16, 2005, entitled “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard”; and (9) U.S. Patent Application No. 11 / 367,749, filed on March 3, 2006, entitled “Multi-Functional Hand-Held Device”. All of these applications are incorporated herein by reference in their entirety.
[0053] The touch screen 112 optionally has a video resolution exceeding 100 dpi. In some embodiments, the touch screen has a video resolution of about 160 dpi. The user optionally uses any suitable object or appendage, such as a stylus, a finger, or the like, to contact the touch screen 112. In some embodiments, the user interface is designed to work primarily through finger-based contacts and gestures, which may not be as precise as stylus-based input due to the larger contact area of a finger on the touch screen. In some embodiments, the device converts rough finger-based input into precise pointer / cursor positions or commands for performing the user's desired action.
[0054] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of the device that, unlike the touch screen, does not display visual output. The touchpad is optionally a touch-sensitive surface that is separate from the touch screen 112 or an extension of the touch-sensitive surface formed by the touch screen.
[0055] Device 100 also includes a power system 162 for powering the various components. Power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, power fault detection circuitry, a power converter or inverter, a power status indicator (e.g., a light emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in a portable device.
[0056] Device 100 optionally also includes one or more optical sensors 164 . Figure 1AAn optical sensor is shown coupled to the optical sensor controller 158 in the I / O subsystem 106. The optical sensor 164 optionally includes a charge-coupled device (CCD) or complementary metal oxide semiconductor (CMOS) phototransistor. The optical sensor 164 receives light from the environment projected through one or more lenses and converts the light into data representing an image. In conjunction with the imaging module 143 (also called a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the rear of the device 100, facing away from the touch screen display 112 on the front of the device, enabling the touch screen display to be used as a viewfinder for still and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device, allowing the user to optionally capture an image of the user for video conferencing while viewing other video conference participants on the touch screen display. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and sensor in the device housing), allowing a single optical sensor 164 to be used with the touch screen display for both video conferencing and still and / or video image acquisition.
[0057] Device 100 optionally also includes one or more contact intensity sensors 165 . Figure 1A A contact force sensor is shown coupled to force sensor controller 159 in I / O subsystem 106. Contact force sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other force sensors (e.g., sensors for measuring the force (or pressure) of a contact on a touch-sensitive surface). Contact force sensor 165 receives contact force information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact force sensor is juxtaposed with or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact force sensor is located on the back of device 100, opposite touch screen display 112 located on the front of device 100.
[0058] Device 100 optionally also includes one or more proximity sensors 166 . Figure 1AA proximity sensor 166 is shown coupled to the peripherals interface 118. Alternatively, the proximity sensor 166 is optionally coupled to the input controller 160 in the I / O subsystem 106. The proximity sensor 166 is optionally implemented as described in the following U.S. patent applications: No. 11 / 241,839, entitled “Proximity Detector In Handheld Device”; No. 11 / 240,788, entitled “Proximity Detector In Handheld Device”; No. 11 / 620,702, entitled “Using Ambient Light Sensor To Augment Proximity Sensor Output”; No. 11 / 586,862, entitled “Automated Response To And Sensing Of User Activity In Portable Devices”; and No. 11 / 638,251, entitled “Methods And Systems For Automatic Configuration Of Peripherals,” which are hereby incorporated by reference in their entireties. In some embodiments, when the multifunction device is placed near the user's ear (e.g., when the user is on a phone call), the proximity sensor turns off and disables the touch screen 112.
[0059] Device 100 optionally also includes one or more tactile output generators 167 . Figure 1AA tactile output generator is shown coupled to a tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 optionally includes one or more electroacoustic devices such as speakers or other audio components; and / or electromechanical devices for converting energy into linear motion such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components for converting electrical signals into tactile outputs on the device). The contact force sensor 165 receives tactile feedback generation instructions from the tactile feedback module 133 and generates tactile outputs on the device 100 that can be felt by the user of the device 100. In some embodiments, at least one tactile output generator is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112) and optionally generates tactile outputs by moving the touch-sensitive surface vertically (e.g., inward / outward toward the surface of the device 100) or laterally (e.g., back and forth in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on the back of the device 100, opposite the touch screen display 112 located on the front of the device 100.
[0060] Device 100 optionally also includes one or more accelerometers 168 . Figure 1A An accelerometer 168 is shown coupled to the peripherals interface 118. Alternatively, the accelerometer 168 is optionally coupled to the input controller 160 in the I / O subsystem 106. The accelerometer 168 optionally implements as described in the following U.S. Patent Publication No. 20050190059, entitled "Acceleration-based Theft Detection System for Portable Electronic Devices," and U.S. Patent Publication No. 20060017692, entitled "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer," both of which are incorporated herein by reference in their entireties. In some embodiments, information is displayed in a portrait view or a landscape view on the touch screen display based on analysis of data received from one or more accelerometers. Device 100 optionally includes a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) in addition to accelerometer 168 for obtaining information about the position and orientation (eg, portrait or landscape) of device 100 .
[0061] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. In addition, in some embodiments, memory 102 ( Figure 1A ) or 370( Figure 3 ) Storage device / global internal state 157, such as Figure 1A and Figure 3 . The device / global internal state 157 includes one or more of the following: an active application state, which indicates which applications, if any, are currently active; a display state, which indicates what applications, views, or other information occupy various areas of the touch screen display 112; a sensor state, which includes information obtained from the device's various sensors and input control devices 116; and position information regarding the device's position and / or posture.
[0062] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitating communication between various hardware components and software components.
[0063] The communication module 128 facilitates communication with other devices via one or more external ports 124 and also includes various software components for processing data received by the RF circuitry 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are suitable for coupling directly to other devices or indirectly through a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external ports are connected to (trademark of Apple Inc.) devices.
[0064] The contact / motion module 130 optionally detects contact with the touch screen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a trackpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger down event), determining the strength of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there has been movement of the contact and tracking the movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has ceased (e.g., detecting a finger up event or contact break). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of a contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a sequence of contact data. These operations are optionally applied to a single point of contact (e.g., a single-finger contact) or multiple points of contact simultaneously (e.g., "multi-touch" / multiple-finger contact). In some embodiments, the contact / motion module 130 and display controller 156 detect contact on the touchpad.
[0065] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by a user (e.g., to determine whether a user has "clicked" an icon). In some embodiments, at least a subset of the intensity thresholds are determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator and can be adjusted without changing the physical hardware of the device 100). For example, a mouse "click" threshold for a touchpad or touchscreen can be set to any one of a large range of predefined thresholds without changing the touchpad or touchscreen display hardware. In addition, in some embodiments, a software setting is provided to the user of the device for adjusting one or more intensity thresholds in a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by utilizing a system-level click on an "intensity" parameter to adjust multiple intensity thresholds at once).
[0066] Contact / motion module 130 optionally detects gesture input by the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contacts). Thus, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger press event and then detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift-off) event.
[0067] Graphics module 132 includes various known software components for rendering and displaying graphics on touch screen 112 or other displays, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual attributes) of displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including, but not limited to, text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.
[0068] In some embodiments, the graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes specifying the graphics to be displayed from an application program or the like, along with coordinate data and other graphic attribute data, if necessary, and then generates screen image data for output to the display controller 156.
[0069] Haptic feedback module 133 includes various software components for generating instructions used by tactile output generator 167 to produce tactile output at one or more locations on device 100 in response to user interaction with device 100 .
[0070] Text input module 134, which is optionally a component of graphics module 132, provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).
[0071] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for use in location-based dialing; to the camera 143 as picture / video metadata; and to applications that provide location-based services, such as the weather widget, the local yellow pages widget, and the map / navigation widget).
[0072] Application 136 optionally includes the following modules (or instruction sets), or a subset or superset thereof:
[0073] Contacts module 137 (sometimes called address book or contact list);
[0074] Telephone module 138;
[0075] Video conferencing module 139;
[0076] Email client module 140;
[0077] Instant messaging (IM) module 141;
[0078] Fitness support module 142;
[0079] A camera module 143 for still and / or video images;
[0080] Image management module 144;
[0081] Video player module;
[0082] Music player module;
[0083] Browser module 147;
[0084] Calendar module 148;
[0085] Widget module 149, which optionally includes one or more of the following: weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other widgets acquired by the user, and user-created widgets 149-6;
[0086] A widget creator module 150 for forming user-created widgets 149-6;
[0087] Search module 151;
[0088] Video and music player module 152, which combines the video player module and the music player module;
[0089] Notepad module 153;
[0090] Map module 154; and / or
[0091] Online video module 155.
[0092] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.
[0093] In combination with the touch screen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the contacts module 137 is optionally used to manage an address book or contact list (e.g., stored in the application internal state 192 of the contacts module 137 in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communications via telephone 138, video conferencing module 139, email 140, or IM 141; and so on.
[0094] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, phone module 138 is optionally used to enter a character sequence corresponding to a phone number, access one or more phone numbers in contacts module 137, modify an entered phone number, dial the corresponding phone number, conduct a conversation, and disconnect or hang up when the conversation is complete. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.
[0095] In combination with the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch screen 112, the display controller 156, the optical sensor 164, the optical sensor controller 158, the contact / motion module 130, the graphics module 132, the text input module 134, the contact module 137 and the telephone module 138, the video conferencing module 139 includes executable instructions for initiating, conducting and terminating a video conference between a user and one or more other participants in accordance with user instructions.
[0096] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to create and send emails with still images or video images captured by camera module 143.
[0097] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134, the instant messaging module 141 includes executable instructions for entering a character sequence corresponding to an instant message, modifying previously entered characters, transmitting the corresponding instant message (e.g., using the Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocol for phone-based instant messaging or using XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both phone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).
[0098] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, the GPS module 135, the map module 154, and the music player module, the fitness support module 142 includes executable instructions for creating a fitness (e.g., with time, distance, and / or calorie burn goals); communicating with fitness sensors (sports equipment); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting and playing music for fitness; and displaying, storing, and transmitting fitness data.
[0099] In combination with the touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132 and image management module 144, the camera module 143 includes executable instructions for the following operations: capturing still images or videos (including video streams) and storing them in the memory 102, modifying the characteristics of the still images or videos, or deleting the still images or videos from the memory 102.
[0100] In conjunction with touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.
[0101] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132 and the text input module 134, the browser module 147 includes executable instructions for browsing the Internet in accordance with user instructions, including searching for, linking to, receiving and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.
[0102] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the email client module 140 and the browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying and storing a calendar and data associated with the calendar (e.g., calendar entries, to-do items, etc.) in accordance with user instructions.
[0103] In conjunction with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, and the browser module 147, the desktop widget module 149 is a mini-application that is optionally downloaded and used by the user (e.g., the weather desktop widget 149-1, the stock desktop widget 149-2, the calculator desktop widget 149-3, the alarm desktop widget 149-4, and the dictionary desktop widget 149-5) or a mini-application created by the user (e.g., the user-created desktop widget 149-6). In some embodiments, the desktop widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the desktop widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., the Yahoo! desktop widget).
[0104] In combination with the RF circuit 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134 and browser module 147, the desktop widget creator module 150 is optionally used by a user to create a desktop widget (e.g., converting a user-specified portion of a web page into a desktop widget).
[0105] In combination with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132 and text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user instructions.
[0106] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touch screen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).
[0107] In conjunction with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the notes module 153 includes executable instructions for creating and managing notes, to-do lists, etc. according to user instructions.
[0108] In combination with the RF circuitry 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the GPS module 135, and the browser module 147, the map module 154 is optionally used to receive, display, modify, and store maps and data associated with the maps (e.g., driving directions, data relating to stores and other points of interest at or near a particular location, and other location-based data) in accordance with user instructions.
[0109] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes instructions for allowing a user to access, browse, receive (e.g., by streaming and / or downloading), play back (e.g., on the touch screen or on an external display connected via external port 124), send an email with a link to a particular online video, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, instant messaging module 141 is used instead of email client module 140 to send a link to a particular online video. Additional descriptions of online video applications can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed on June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical UserInterface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed on December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical UserInterface for Playing Online Videos,” the contents of which are hereby incorporated by reference in their entirety.
[0110] Each of the modules and applications described above corresponds to an executable instruction set for performing one or more of the functions described above and the methods described in this patent application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) do not have to be implemented as separate software programs, processes, or modules, and thus various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. For example, a video player module is optionally combined with a music player module into a single module (e.g., Figure 1A In some embodiments, the memory 102 optionally stores a subset of the above modules and data structures. In addition, the memory 102 optionally stores additional modules and data structures not described above.
[0111] In some embodiments, device 100 is a device in which operation of a predefined set of functions on the device is performed exclusively through a touch screen and / or a touchpad. By using a touch screen and / or a touchpad as the primary input control device for operating device 100, the number of physical input control devices (e.g., push buttons, dials, etc.) on device 100 is optionally reduced.
[0112] A predefined set of functions that are exclusively performed through the touch screen and / or trackpad optionally includes navigation between user interfaces. In some embodiments, the trackpad, when touched by the user, navigates the device 100 from any user interface displayed on the device 100 to a main menu, home menu, or root menu. In such embodiments, the trackpad is used to implement a "menu button." In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a trackpad.
[0113] Figure 1B is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370( Figure 3 ) includes an event classifier 170 (e.g., in the operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).
[0114] Event classifier 170 receives event information and determines the application 136-1 and the application view 191 of application 136-1 to which the event information is to be delivered. Event classifier 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, application 136-1 includes an application internal state 192 that indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information is to be delivered.
[0115] In some embodiments, the application internal state 192 includes additional information, such as one or more of: resumption information to be used when the application 136-1 resumes execution, user interface state information indicating that information is being displayed or is ready to be displayed by the application 136-1, a state queue for enabling the user to return to a previous state or view of the application 136-1, and a repeat / undo queue of previous actions taken by the user.
[0116] Event monitor 171 receives event information from peripherals interface 118. The event information includes information about sub-events (e.g., a user touch on touch-sensitive display 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via audio circuit 110). The information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.
[0117] In some embodiments, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other embodiments, peripheral device interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or receiving an input for more than a predetermined duration).
[0118] In some embodiments, the event classifier 170 also includes a hit view determination module 172 and / or an active event identifier determination module 173.
[0119] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides software procedures for determining where within one or more views a sub-event has occurred. A view consists of controls and other elements that a user can see on the display.
[0120] Another aspect of the user interface associated with an application is a set of views, sometimes also referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of the respective application) in which a touch is detected optionally correspond to programmatic levels within the application's programmatic or view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as a hit view, and the set of events recognized as correct input is optionally determined based at least in part on the hit view of the initial touch that started the touch-based gesture.
[0121] Hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy where the sub-events should be processed. In most cases, the hit view is the lowest-level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source for which it was identified as the hit view.
[0122] Active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with one particular view, views higher in the hierarchy will still remain actively participating views.
[0123] Event dispatcher module 174 dispatches event information to event recognizers (e.g., event recognizer 180). In embodiments that include active event recognizer determination module 173, event dispatcher module 174 delivers the event information to the event recognizer determined by active event recognizer determination module 173. In some embodiments, event dispatcher module 174 stores the event information in an event queue, which is retrieved by corresponding event receiver 182.
[0124] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a standalone module or part of another module stored in memory 102, such as contact / motion module 130.
[0125] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events that occur within a corresponding view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes multiple event recognizers 180. In other embodiments, one or more of event recognizers 180 is part of a separate module, such as a user interface toolkit (not shown) or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, a corresponding event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from an event classifier 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177, or GUI updater 178 to update the application's internal state 192. Alternatively, one or more of the application views in application view 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.
[0126] A corresponding event identifier 180 receives event information (e.g., event data 179) from event classifier 170 and identifies an event based on the event information. Event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, event identifier 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (which optionally include sub-event delivery instructions).
[0127] The event receiver 182 receives event information from the event classifier 170. The event information includes information about sub-events such as touches or touch movements. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves the movement of a touch, the event information optionally also includes the rate and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another (e.g., from a portrait orientation to a landscape orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device posture).
[0128] The event comparator 184 compares the event information with predefined event or sub-event definitions and determines the event or sub-event based on the comparison, or determines or updates the state of the event or sub-event. In some embodiments, the event comparator 184 includes an event definition 186. The event definition 186 includes the definition of the event (e.g., a predefined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, the sub-events in event (187) include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, the definition of event 1 (187-1) is a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on the displayed object, a first lift-off (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on the displayed object, and a second lift-off (touch end) of a predetermined duration. In another example, the definition of event 2 (187-2) is a drag on a displayed object. For example, dragging includes a touch (or contact) of a predetermined duration on a displayed object, movement of the touch on the touch-sensitive display 112, and lifting of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.
[0129] In some embodiments, event definition 187 includes definitions of events for corresponding user interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler that is associated with the sub-event and the object that triggered the hit test.
[0130] In some embodiments, the definition of the corresponding event (187) also includes a delay action that delays the delivery of the event information until it has been determined that the sub-event sequence does or does not correspond to the event type of the event identifier.
[0131] When a corresponding event recognizer 180 determines that a sequence of sub-events does not match any event in event definitions 186, the corresponding event recognizer 180 enters the event impossible, event failed, or event ended state, after which subsequent sub-events of the touch-based gesture are ignored. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.
[0132] In some embodiments, corresponding event recognizers 180 include metadata 183 with configurable properties, flags, and / or lists that indicate how the event delivery system should perform sub-event delivery for actively participating event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact or can interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to different levels in a view or programmatic hierarchy.
[0133] In some embodiments, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates an event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating an event handler 190 is different from sending (and deferred sending) sub-events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a flag associated with the identified event, and the event handler 190 associated with the flag obtains the flag and performs a predefined process.
[0134] In some embodiments, event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver the event information to an event handler associated with the sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or with the actively participating view receives the event information and performs a predetermined process.
[0135] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the location of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on a touch-sensitive display.
[0136] In some embodiments, event handler 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.
[0137] It should be understood that the above discussion of event handling for user touches on a touch-sensitive display also applies to other forms of user input utilizing input devices to operate the multifunction device 100, and not all user input is initiated on a touch screen. For example, mouse movement and mouse button presses, optionally in conjunction with single or multiple keyboard presses or holddowns; contact movement on a trackpad, such as taps, drags, scrolls, etc.; stylus input; movement of the device; spoken commands; detected eye movement; biometric input; and / or any combination thereof, are optionally used as input corresponding to sub-events defining the event to be recognized.
[0138] Figure 2A portable multifunction device 100 with a touch screen 112 is shown according to some embodiments. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more of the graphics by, for example, making gestures on the graphics using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, selection of the one or more graphics occurs when the user breaks contact with the one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, from right to left, up and / or down), and / or rolling of a finger that has made contact with the device 100 (from right to left, from left to right, up and / or down). In some specific implementations or in some cases, inadvertent contact with a graphic does not select the graphic. For example, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application when the gesture corresponding to selection is a tap.
[0139] The device 100 optionally also includes one or more physical buttons, such as a "home" or menu button 204. As previously described, the menu button 204 is optionally used to navigate to any application 136 in a set of applications that are optionally executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen 112.
[0140] In some embodiments, the device 100 includes a touch screen 112, a menu button 204, a push button 206 for turning the device on / off and for locking the device, one or more volume adjustment buttons 208, a subscriber identity module (SIM) card slot 210, a headset jack 212, and a docking / charging external port 124. The push button 206 is optionally used to turn the device on / off by pressing the button and holding it in the depressed state for a predefined time interval; to lock the device by pressing the button and releasing it before the predefined time interval has elapsed; and / or to unlock the device or initiate an unlocking process. In an alternative embodiment, the device 100 also accepts voice input for activating or deactivating certain functions via the microphone 113. The device 100 also optionally includes one or more contact force sensors 165 for detecting the intensity of contact on the touch screen 112, and / or one or more tactile output generators 167 for generating tactile output for the user of the device 100.
[0141] Figure 33 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments. The device 300 does not have to be portable. In some embodiments, the device 300 is a laptop, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a children's learning toy), a gaming system, or a control device (e.g., a home controller or an industrial controller). The device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, a memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuits (sometimes referred to as a chipset) that interconnect system components and control communications between system components. The device 300 includes an input / output (I / O) interface 330 having a display 340, which is typically a touch screen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 for generating tactile output on the device 300 (e.g., similar to the above referenced device). Figure 1A The tactile output generator 167 described above), sensor 359 (e.g., optical sensor, acceleration sensor, proximity sensor, touch sensor and / or contact intensity sensor (similar to the above reference Figure 1A The memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 370 optionally includes one or more storage devices located remotely from the CPU 310. In some embodiments, the memory 370 stores data related to the portable multifunction device 100 ( Figure 1A ) or a subset thereof. In addition, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while portable multifunction device 100 ( Figure 1A )'s memory 102 optionally does not store these modules.
[0142] Figure 3Each element in the above-mentioned elements in is optionally stored in one or more memory devices of the memory device mentioned previously.Each module in the above-mentioned modules corresponds to the instruction set for performing the above-mentioned functions.Above-mentioned modules or programs (for example, instruction sets) need not be implemented as independent software programs, processes or modules, and therefore the various subsets of these modules are optionally combined or otherwise rearranged in various embodiments.In some embodiments, memory 370 optionally stores the subset of above-mentioned modules and data structures.In addition, memory 370 optionally stores additional modules and data structures not described above.
[0143] Attention is now turned to an embodiment of a user interface, optionally implemented on, for example, portable multifunction device 100 .
[0144] Figure 4A An exemplary user interface for an applications menu on portable multifunction device 100 is shown according to some embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:
[0145] Signal strength indicators 402 for wireless communications such as cellular and Wi-Fi signals;
[0146] Time 404;
[0147] Bluetooth indicator 405;
[0148] Battery status indicator 406;
[0149] A tray 408 with icons for commonly used applications, such as:
[0150] o An icon 416 labeled “Phone” of the phone module 138 , optionally including an indicator 414 of the number of missed calls or voicemails;
[0151] o An icon 418 of the email client module 140 labeled “Mail,” optionally including an indicator 410 of the number of unread emails;
[0152] o An icon 420 labeled "Browser" for the browser module 147; and
[0153] o An icon 422 labeled “iPod” for the video and music player module 152 (also referred to as the iPod (a trademark of Apple Inc.) module 152); and
[0154] Icons for other apps, such as:
[0155] o Icon 424 labeled “Messages” of IM module 141;
[0156] o Icon 426 labeled “Calendar” of the calendar module 148;
[0157] o Icon 428 labeled “Photos” of the image management module 144;
[0158] o An icon 430 labeled “Camera” of the camera module 143;
[0159] o Icon 432 labeled “Online Video” of the online video module 155;
[0160] o Icon 434 labeled “Stock Market” of the Stock Market widget 149-2;
[0161] o Icon 436 labeled “Map” of the map module 154;
[0162] o Icon 438 labeled “Weather” of the weather widget 149-1;
[0163] o Icon 440 labeled “Clock” of the alarm clock widget 149-4;
[0164] o An icon 442 labeled “Fitness Support” of the fitness support module 142;
[0165] o An icon 444 labeled "Notepad" of the Notepad module 153; and
[0166] o An icon 446 of a settings application or module labeled “Settings” that provides access to settings for the device 100 and its various applications 136 .
[0167] It should be pointed out that Figure 4A The icon labels shown are exemplary only. For example, icon 422 for video and music player module 152 is labeled "Music" or "Music Player." Other labels are optionally used for various application icons. In some embodiments, the label of a respective application icon includes the name of the application corresponding to the respective application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.
[0168] Figure 4B A touch-sensitive surface 451 (eg, touch screen display 112) is shown having a touch-sensitive surface 451 (eg, touch screen display 112) that is separate from a display 450 (eg, touch screen display 112). Figure 3 tablet or trackpad 355) of the device (e.g., Figure 3Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) for detecting intensity of contacts on touch-sensitive surface 451 and / or one or more tactile output generators 357 for generating tactile output for a user of device 300.
[0169] Although some of the examples below will be given with reference to input on a touch screen display 112 (where the touch-sensitive surface and display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, such as Figure 4B In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a main axis (e.g., Figure 4B 453) corresponding to the main axis (for example, Figure 4B According to these embodiments, the device detects a position corresponding to a corresponding position on the display (e.g., Figure 4B 4B ), 460 corresponds to 468 and 462 corresponds to 470) with the touch-sensitive surface 451 (e.g., 460 and 462 in FIG. 4B ). Thus, when the touch-sensitive surface (e.g., Figure 4B 451) and a display of a multi-function device (e.g., Figure 4B When the user interface 450 in FIG. 1 is separated, the user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.
[0170] Additionally, while the examples below are primarily given with reference to finger inputs (e.g., finger contacts, single-finger tap gestures, finger swipe gestures), it should be understood that in some embodiments, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). For another example, a tap gesture is optionally replaced by a mouse click when the cursor is over the location of the tap gesture (e.g., instead of detecting the contact, followed by ceasing to detect the contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or that a mouse and finger contact are optionally used simultaneously.
[0171] Figure 5AAn exemplary personal electronic device 500 is shown. The device 500 includes a body 502. In some embodiments, the device 500 may include a body 502 relative to the devices 100 and 300 (e.g., Figure 1A 4B ). In some embodiments, device 500 has a touch-sensitive display screen 504, hereinafter referred to as touch screen 504. As an alternative to or in addition to touch screen 504, device 500 has a display and a touch-sensitive surface. As with devices 100 and 300, in some embodiments, touch screen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors for detecting the intensity of the contact (e.g., touch) applied. The one or more intensity sensors of touch screen 504 (or touch-sensitive surface) can provide output data representing the intensity of the touch. The user interface of device 500 can respond to the touch based on the intensity of the touch, which means that touches of different intensities can invoke different user interface operations on device 500.
[0172] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related patent applications: International Patent Application Serial No. PCT / US2013 / 040061, filed on May 8, 2013, entitled “Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application,” published as WIPO Patent Publication No. WO / 2013 / 169849; and International Patent Application Serial No. PCT / US2013 / 069483, filed on November 11, 2013, entitled “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships,” published as WIPO Patent Publication No. WO / 2014 / 105276, each of which is hereby incorporated by reference in its entirety.
[0173] In some embodiments, the device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508 (if included) can be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, the device 500 has one or more attachment mechanisms. Such attachment mechanisms (if included) can allow the device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watchbands, bracelets, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow the user to wear the device 500.
[0174] Figure 5B An exemplary personal electronic device 500 is shown. In some embodiments, the device 500 may include a reference Figure 1A 、 Figure 1B and Figure 3 Some or all of the components described. Device 500 has a bus 512 that operatively couples an I / O portion 514 to one or more computer processors 516 and a memory 518. The I / O portion 514 can be connected to a display 504, which can have a touch-sensitive component 522 and optionally a strength sensor 524 (e.g., a contact strength sensor). In addition, the I / O portion 514 can be connected to a communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near-field communication (NFC), cellular, and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, the input mechanism 506 is optionally a rotatable input device or a depressible input device and a rotatable input device. In some examples, the input mechanism 508 is optionally a button.
[0175] In some examples, input mechanism 508 is optionally a microphone. Personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which are operatively connected to I / O portion 514.
[0176] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, may, for example, cause the computer processors to perform the techniques described below, including processes 700, 701, 900, and 1100 (Figures 7, 9, and 11). A computer-readable storage medium may be any medium that can tangibly contain or store computer-executable instructions for use by or in conjunction with an instruction execution system, apparatus, and device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and persistent solid-state memory such as flash memory, solid-state drives, and the like. The personal electronic device 500 is not limited to Figure 5B components and configurations, but may include other components or additional components in a variety of configurations.
[0177] As used herein, the term "indicator" refers to an indication that is optionally provided on device 100, 300, and / or 500 ( Figure 1A 、 Figure 3 and Figures 5A to 5B ) on a display screen of a computer. For example, an image (e.g., an icon), a button, and text (e.g., a hyperlink) optionally each constitute an affordance.
[0178] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface with which a user is interacting. In some implementations that include a cursor or other position marker, the cursor acts as a "focus selector" such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), a focus selector is displayed on a touch-sensitive surface (e.g., Figure 3 Touchpad 355 or Figure 4B In the event that an input (e.g., a press input) is detected on the touch-sensitive surface 451 in FIG, the particular user interface element is adjusted according to the detected input. In the case of a touch screen display (e.g., a touch screen display) that enables direct interaction with user interface elements on the touch screen display Figure 1A touch-sensitive display system 112 or Figure 4AIn some implementations of the touch screen 112 in FIG, 2 , a contact detected on the touch screen acts as a “focus selector” such that when input (e.g., a press input by the contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touch screen display, the particular user interface element is adjusted according to the detected input. In some implementations, the focus moves from one area of the user interface to another area of the user interface without corresponding movement of a cursor or movement of a contact on the touch screen display (e.g., by using a tab key or arrow keys to move the focus from one button to another); in these implementations, the focus selector moves according to the movement of the focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is generally a user interface element (or contact on the touch screen display) that is controlled by the user to deliver the user's intended interaction with the user interface (e.g., by indicating to the device the element of the user interface with which the user desires to interact). For example, when a press input is detected on a touch-sensitive surface (e.g., a trackpad or touch screen), the position of a focus selector (e.g., a cursor, contact, or selection box) over a corresponding button will indicate that the user intends to activate the corresponding button (rather than other user interface elements shown on the device display).
[0179] As used in the specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected during a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted off, before or after contact begins to move, before contact ends, before or after contact is detected to increase in intensity, and / or before or after contact is detected to decrease in intensity). The characteristic intensity of a contact is optionally based on one or more of the following: the maximum value of the intensity of the contact, the mean value of the intensity of the contact, the average value of the intensity of the contact, the value at the top 10% of the intensity of the contact, the half-maximum value of the intensity of the contact, the 90% maximum value of the intensity of the contact, etc. In some embodiments, the duration of the contact is used in determining the characteristic intensity (e.g., when the characteristic intensity is the average value of the intensity of the contact over time). In some embodiments, the feature strength is compared to a set of one or more strength thresholds to determine whether the user has performed an operation. For example, the set of one or more strength thresholds optionally includes a first strength threshold and a second strength threshold. In this example, a contact whose feature strength does not exceed the first threshold results in a first operation, a contact whose feature strength exceeds the first strength threshold but does not exceed the second strength threshold results in a second operation, and a contact whose feature strength exceeds the second threshold results in a third operation. In some embodiments, a comparison between the feature strength and one or more thresholds is used to determine whether to perform one or more operations (e.g., whether to perform the corresponding operation or to abandon the corresponding operation) rather than to determine whether to perform the first operation or the second operation.
[0180] Figure 5C Detecting multiple contacts 552A-552E on touch-sensitive display 504 using multiple intensity sensors 524A-524D is shown. Figure 5C Also included is an intensity graph that shows the current intensity measurements of intensity sensors 524A-524D relative to intensity units. In this example, the intensity measurements of intensity sensors 524A and 524D are both 9 intensity units, and the intensity measurements of intensity sensors 524B and 524C are both 7 intensity units. In some implementations, the cumulative intensity is the sum of the intensity measurements of multiple intensity sensors 524A-524D, which in this example is 32 intensity units. In some embodiments, each contact is assigned a corresponding intensity, which is a portion of the cumulative intensity. Figure 5D554. The cumulative strength assigned to contacts 552A-552E based on their distance from the center of force 554 is shown. In this example, each of contacts 552A, 552B, and 552E is assigned a strength of the contact of 8 strength units of the cumulative strength, and each of contacts 552C and 552D is assigned a strength of the contact of 4 strength units of the cumulative strength. More generally, in some embodiments, each contact j is assigned a corresponding strength Ij that is a portion of the cumulative strength A according to a predefined mathematical function Ij=A·(Dj / ΣDi), where Dj is the distance of the corresponding contact j from the center of force, and ΣDi is the sum of the distances of all corresponding contacts (e.g., i=1 to the last) from the center of force. The reference may be performed using an electronic device similar to or identical to device 100, 300, or 500. Figure 5C-5D In some embodiments, the characteristic intensity of the contact is based on one or more intensities of the contact. In some embodiments, the intensity sensor is used to determine a single characteristic intensity (e.g., a single characteristic intensity of a single contact). It should be noted that the intensity map is not part of the displayed user interface, but is included in the Figure 5C-5D To assist readers.
[0181] In some embodiments, a portion of a gesture is identified for determining the characteristic strength. For example, the touch-sensitive surface optionally receives a continuous swipe contact that transitions from a starting position and reaches an end position where the contact strength increases. In this example, the characteristic strength of the contact at the end position is optionally based only on a portion of the continuous swipe contact, rather than the entire swipe contact (e.g., only the portion of the swipe contact at the end position). In some embodiments, a smoothing algorithm is optionally applied to the intensity of the swipe contact before determining the characteristic strength of the contact. For example, the smoothing algorithm optionally includes one or more of the following: an unweighted sliding average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some cases, these smoothing algorithms eliminate narrow peaks or dips in the intensity of the swipe contact to achieve the purpose of determining the characteristic strength.
[0182] The intensity of the contact on the touch-sensitive surface is optionally characterized relative to one or more intensity thresholds, such as a contact detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device will perform an operation typically associated with clicking a button of a physical mouse or trackpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device will perform an operation different from the operation typically associated with clicking a button of a physical mouse or trackpad. In some embodiments, when a contact is detected with a characteristic intensity below the light press intensity threshold (e.g., and above a nominal contact detection intensity threshold, contacts below the nominal contact detection intensity threshold are no longer detected), the device will move the focus selector in accordance with the movement of the contact on the touch-sensitive surface, without performing an operation associated with the light press intensity threshold or the deep press intensity threshold. Generally speaking, unless otherwise stated, these intensity thresholds are consistent between different groups of user interface illustrations.
[0183] An increase in contact feature intensity from an intensity below a light press intensity threshold to an intensity between the light press intensity threshold and the deep press intensity threshold is sometimes referred to as a "light press" input. An increase in contact feature intensity from an intensity below a deep press intensity threshold to an intensity above the deep press intensity threshold is sometimes referred to as a "deep press" input. An increase in contact feature intensity from an intensity below a contact detection intensity threshold to an intensity between the contact detection intensity threshold and the light press intensity threshold is sometimes referred to as detecting a contact on the touch surface. A decrease in contact feature intensity from an intensity above the contact detection intensity threshold to an intensity below the contact detection intensity threshold is sometimes referred to as detecting a contact lifted from the touch surface. In some embodiments, the contact detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.
[0184] In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or multiple contacts), wherein the corresponding press input is detected at least in part based on detecting an increase in the intensity of the contact (or multiple contacts) to above a press input intensity threshold. In some embodiments, the corresponding operation is performed in response to detecting an increase in the intensity of the corresponding contact to above the press input intensity threshold (e.g., a "down stroke" of the corresponding press input). In some embodiments, the press input includes an increase in the intensity of the corresponding contact to above the press input intensity threshold and a subsequent decrease in the intensity of the contact to below the press input intensity threshold, and the corresponding operation is performed in response to detecting a subsequent decrease in the intensity of the corresponding contact to below the press input threshold (e.g., an "up stroke" of the corresponding press input).
[0185] Figure 5E-5H Detection of a gesture is shown, the gesture comprising contact 562 with an intensity from below Figure 5E Light press intensity threshold in L ”) increases to a value higher than Figure 5H The deep press intensity threshold in D ”). On the displayed user interface 570 including application icons 572A-572D displayed in the predefined area 574, when the cursor 576 is displayed over the application icon 572B corresponding to application 2, a gesture performed using the contact 562 is detected on the touch-sensitive surface 560. In some embodiments, the gesture is detected on the touch-sensitive display 504. The intensity sensor detects the intensity of the contact on the touch-sensitive surface 560. The device determines whether the intensity of the contact 562 is within the deep press intensity threshold (e.g., “IT D ”) reaches a peak above. Contact 562 is maintained on touch-sensitive surface 560. In response to detecting the gesture, and according to the intensity rising to the deep press intensity threshold (e.g., “IT D ”) above contact 562, displays scaled representations 578A-578C (eg, thumbnails) of documents recently opened for application 2, such as Figure 5F-5H In some embodiments, the intensity is a characteristic intensity of the contact compared to one or more intensity thresholds. It should be noted that the intensity map for contact 562 is not part of the displayed user interface, but is included in the Figure 5E-5H To assist readers.
[0186] In some embodiments, the display of representations 578A-578C includes animation. For example, representation 578A is initially displayed near application icon 572B, as shown in FIG. Figure 5F As the animation progresses, representation 578A moves upward and representation 578B is displayed near application icon 572B, as shown in FIG5G. Then, representation 578A moves upward, 578B moves upward toward representation 578A, and representation 578C is displayed near application icon 572B, as shown in FIG5G. Figure 5H In some embodiments, the animation progresses according to the intensity of contact 562, as shown in FIG. Figure 5F-5G , where representations 578A-578C appear and decrease as the intensity of contact 562 moves toward a deep press intensity threshold (e.g., “IT D In some embodiments, the intensity according to which the animation progresses is the characteristic intensity of the contact. The reference may be performed using an electronic device similar to or identical to device 100, 300, or 500. Figures 5E to 5H The operation described.
[0187] In some embodiments, the device employs intensity hysteresis to avoid unexpected inputs, sometimes referred to as "jitter," where the device defines or selects a hysteresis intensity threshold that has a predefined relationship to a press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable proportion of the press input intensity threshold). Thus, in some embodiments, a press input includes an increase in the intensity of the corresponding contact to above the press input intensity threshold and a subsequent decrease in the intensity of the contact to below a hysteresis intensity threshold corresponding to the press input intensity threshold, and a corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases to below the hysteresis intensity threshold (e.g., an "upstroke" of the corresponding press input). Similarly, in some embodiments, a press input is detected only when the device detects that the contact intensity increases from an intensity equal to or below the hysteresis intensity threshold to an intensity equal to or above the press input intensity threshold and, optionally, that the contact intensity subsequently decreases to an intensity equal to or below the hysteresis intensity, and a corresponding operation is performed in response to detecting the press input (e.g., an increase in contact intensity or a decrease in contact intensity, depending on the circumstances).
[0188] For ease of explanation, a description of an operation performed in response to a press input associated with a press input intensity threshold or in response to a gesture including a press input is optionally triggered in response to detecting any of the following: contact intensity increasing above the press input intensity threshold, contact intensity increasing from an intensity below a hysteresis intensity threshold to an intensity above the press input intensity threshold, contact intensity decreasing below the press input intensity threshold, and / or contact intensity decreasing below a hysteresis intensity threshold corresponding to the press input intensity threshold. Additionally, in examples where an operation is described as being performed in response to detecting that the intensity of the contact decreases below the press input intensity threshold, the operation is optionally performed in response to detecting that the intensity of the contact decreases below a hysteresis intensity threshold that corresponds to and is less than the press input intensity threshold.
[0189] In some embodiments, the electronic device 500 includes one or more tactile output generators, wherein the one or more tactile output generators generate different types of tactile output sequences, as described in Table 1 below. In some embodiments, the specific type of tactile output sequence generated by the one or more tactile output generators corresponds to a specific tactile output pattern. For example, the tactile output pattern specifies the characteristics of the tactile output, such as the amplitude of the tactile output, the shape of the motion waveform of the tactile output, the frequency of the tactile output, and / or the duration of the tactile output. When a device (e.g., one or more tactile output generators that generate tactile output via moving a movable mass) generates tactile output with different tactile output patterns, the tactile output can produce different tactile sensations in a user holding or touching the device. Although the user's senses are based on the user's perception of the tactile output, most users will be able to recognize changes in the waveform, frequency, and amplitude of the tactile output generated by the device.
[0190] More specifically, Figures 5I to 5K A set of sample tactile output patterns are provided that can be used, individually or in combination, as is or through one or more transformations (e.g., modulation, amplification, truncation, etc.) to generate suitable tactile feedback in various scenarios for various purposes (such as those described above and those described with respect to the user interfaces and methods discussed herein). This example of a control panel for tactile output shows how a set of three waveforms and eight frequencies can be used to generate an array of tactile output patterns. In addition to the tactile output patterns shown in these figures, each of these tactile output patterns is optionally adjusted in amplitude by changing the gain value of the tactile output pattern, as shown, for example, for Figures 5L to 5N The FullTap 80Hz, FullTap 200Hz, MiniTap 80Hz, MiniTap 200Hz, MicroTap 80Hz and MicroTap 200Hz in FIG are shown as variants with gains of 1.0, 0.75, 0.5 and 0.25, respectively. Figures 5L to 5N As shown, changing the gain of a tactile output pattern changes the amplitude of the pattern without changing the frequency of the pattern or changing the shape of the waveform. In some embodiments, changing the frequency of the tactile output pattern also results in a lower amplitude because some tactile output generators are limited by how much force can be applied to the movable mass, so the higher frequency movement of the mass is constrained to a lower amplitude to ensure that the acceleration required to form the waveform does not require forces outside the operating force range of the tactile output generator (e.g., the peak amplitude of FullTap at 230 Hz, 270 Hz, and 300 Hz is lower than the amplitude of FullTap at 80 Hz, 100 Hz, 125 Hz, and 200 Hz).
[0191] Figures 5I to 5NA tactile output pattern having a particular waveform is shown. The waveform of the tactile output pattern represents a pattern of physical displacement versus time relative to a neutral position (e.g., Xzero) through which the movable mass passes to generate a tactile output having the tactile output pattern. For example, Figure 5I The first set of tactile output patterns shown (e.g., the tactile output pattern of "FullTap") each have a waveform that includes oscillations having two complete cycles (e.g., oscillations that start and end at a neutral position and pass through the neutral position three times). Figure 5J The second set of tactile output patterns shown (eg, the “MiniTap” tactile output patterns) each have a waveform that includes an oscillation having one complete cycle (eg, an oscillation that begins and ends at a neutral position and passes through the neutral position once). Figure 5K The third set of tactile output patterns shown (e.g., the "MicroTap" tactile output pattern) each has a waveform that includes an oscillation that includes half a complete cycle (e.g., an oscillation that begins and ends at a neutral position and does not pass through the neutral position). The waveforms of the tactile output patterns also include starting and ending buffers that represent gradual acceleration and deceleration of the movable mass at the beginning and end of the tactile output. Figures 5I to 5N The exemplary waveform shown includes Xmin and Xmax values representing the maximum and minimum extents of movement of the movable mass. For larger electronic devices with larger movable masses, the minimum and maximum extents of movement of the mass may be larger or smaller. Figures 5I to 5N The examples shown describe the movement of a mass in one dimension, but similar principles can also be applied to the movement of a movable mass in two or three dimensions.
[0192] like Figures 5I to 5K As shown, each tactile output pattern also has a corresponding characteristic frequency that affects the "pitch" of the tactile sensation a user feels from a tactile output having that characteristic frequency. For continuous tactile output, the characteristic frequency represents the number of cycles (e.g., cycles per second) that the movable mass of the tactile output generator completes in a given time period. For discrete tactile output, a discrete output signal is generated (e.g., with 0.5, 1, or 2 cycles), and the characteristic frequency value specifies how fast the movable mass needs to move to generate a tactile output having that characteristic frequency. Figure 5I to Figure 5NAs shown, for each type of tactile output (e.g., defined by a corresponding waveform, such as FullTap, MiniTap, or MicroTap), higher frequency values correspond to faster movement of the movable mass and, therefore, generally speaking, to a shorter tactile output completion time (e.g., including the time required to complete the number of cycles of the discrete tactile output plus the start and end buffer times). For example, a FullTap with a characteristic frequency of 80 Hz takes longer to complete (e.g., in seconds) than a FullTap with a characteristic frequency of 100 Hz. Figure 5I , 35.4ms vs. 28.3ms). In addition, for a given frequency, a tactile output with more cycles in its waveform at the corresponding frequency takes longer to complete than a tactile output with fewer cycles in its waveform at the same corresponding frequency. For example, a 150Hz FullTap takes longer to complete than a 150Hz MiniTap (e.g., 19.4ms vs. 12.8ms), and a 150Hz MiniTap takes longer to complete than a 150Hz MicroTap (e.g., 12.8ms vs. 9.4ms). However, for tactile output modes with different frequencies, this rule may not apply (e.g., a tactile output with more cycles but a higher frequency may take a shorter amount of time to complete than a tactile output with fewer cycles but a lower frequency, and vice versa). For example, at 300Hz, FullTap takes the same amount of time as MiniTap (e.g., 9.9ms).
[0193] like Figures 5I to 5KAs shown, the tactile output pattern also has a characteristic amplitude that affects the amount of energy contained in the tactile signal, or the "intensity" of the tactile sensation that the user can feel through the tactile output having the characteristic amplitude. In some embodiments, the characteristic amplitude of the tactile output pattern refers to the absolute value or normalized value representing the maximum displacement of the movable mass relative to the neutral position when the tactile output is generated. In some embodiments, the characteristic amplitude of the tactile output pattern can be adjusted according to various conditions (e.g., customized based on user interface context and behavior) and / or preconfigured metrics (e.g., input-based metrics, and / or user interface-based metrics), such as by a fixed or dynamically determined gain factor (e.g., a value between 0 and 1). In some embodiments, an input-based metric (e.g., an intensity change metric or an input speed metric) measures a characteristic of the input during the period that triggers the generation of the tactile output (e.g., the rate of change of the characteristic intensity of the contact in a press input or the rate of movement of the contact on the touch-sensitive surface). In some embodiments, a user interface-based metric (e.g., a boundary-crossing velocity metric) measures a characteristic of a user interface element (e.g., the speed at which the element moves across a hidden or visible boundary in the user interface) during a user interface change that triggers generation of a tactile output. In some embodiments, a characteristic amplitude of the tactile output pattern can be "envelope" modulated, and peaks of adjacent cycles can have different amplitudes, where one of the waveforms shown above is further modified by multiplying by an envelope parameter that changes over time (e.g., from 0 to 1) to gradually adjust the amplitude of a portion of the tactile output over time as the tactile output is generated.
[0194] As used herein, an "installed application" refers to a software application that has been downloaded to an electronic device (e.g., device 100, 300, and / or 500) and is ready to be launched (e.g., become open) on the device. In some embodiments, a downloaded application becomes an installed application using an installer that extracts program portions from the downloaded software package and integrates the extracted portions with the computer system's operating system.
[0195] As used herein, the term "open application" or "executing application" refers to a software application that has persisted state information (e.g., as part of device / global internal state 157 and / or application internal state 192). An open or executing application is optionally any of the following types of applications:
[0196] The active app currently displayed on the display of the device on which the app is being used;
[0197] Background applications (or background processes), which are not currently displayed but for which one or more processes are being processed by one or more processors; and
[0198] • A suspended or dormant application that is not running but has state information stored in memory (volatile and non-volatile, respectively) and can be used to resume execution of the application.
[0199] As used herein, the term "closed application" refers to a software application that does not retain state information (e.g., the state information of a closed application is not stored in the device's memory). Therefore, closing an application includes stopping and / or removing the application's application process and removing the application's state information from the device's memory. Generally speaking, while in a first application, opening a second application does not close the first application. When the second application is displayed and the first application stops displaying, the first application becomes a background application.
[0200] Attention now turns to embodiments of a user interface ("UI") and associated processes implemented on an electronic device, such as portable multifunction device 100, device 300, or device 500.
[0201] User interface and associated processes
[0202] Selectable option for sharing content with a second electronic device toward which the first electronic device is oriented
[0203] Users interact with electronic devices in a variety of different ways, including sharing content with nearby electronic devices. The embodiments described below provide ways for electronic devices to display options that, when selected, cause the electronic device (e.g., based on the orientation of the electronic device) to share content with another electronic device toward which the electronic device is oriented. Enhancing interaction with the device reduces the amount of time required for the user to perform an operation, thereby reducing the power consumption of the device and extending the battery life of battery-powered devices. It should be understood that people use devices. When a person uses a device, this person is optionally referred to as a user of the device.
[0204] 6A to 6T FIGURE 5 illustrates an exemplary manner in which a first electronic device 500 presents an option that can be selected to share content with a second electronic device toward which the first electronic device is oriented, according to some embodiments of the present disclosure. The embodiments in these figures are used to illustrate the processes described below, including reference to Figures 7A to 7J Describe the process.
[0205] Figures 6A to 6B 5 shows a user interface of a photo application. The user interface includes an image 602 stored on the electronic device 500, a selectable option 604 for presenting a content sharing user interface, a selectable option 606 for saving the image 602 as a favorite image, and a selectable option 608 for deleting the image. Figure 6BAs shown, the user (eg, using contact 603) selects option 604 for presenting a content sharing user interface. In response to the user's selection, the electronic device 500 presents Figure 6C The sharing user interface shown.
[0206] Figures 6C to 6Q A sharing user interface is shown including a sharing option 616a that updates as the orientation of the electronic device 500 changes relative to the plurality of other electronic devices 610a-610e. Figure 6C As shown, the sharing user interface includes a header that includes a representation 612a of the image 602 to be shared, an indication 612b of metadata for the image 602, and a selectable option 612c that, when selected, causes the electronic device 500 to present a setup user interface according to one or more steps of method 1100 described below. The sharing user interface includes a larger representation 614 of the image to be shared, a plurality of options 616a-616d for sharing the image with another user, a plurality of options 618a-618e for sharing the image with another electronic device, and a plurality of selectable options 620a-620c for performing corresponding actions with respect to the image.
[0207] Each option 616a-616d for sharing content with another user or electronic device includes an indication of the other user or electronic device and an indication of the manner in which the image is to be shared. Specifically, option 616a can be selected to share content with another electronic device (e.g., corresponding to device C) using a wireless network sharing protocol. Option 616b can be selected to share an image with another user (e.g., user S) using email. Options 616c-616d can be selected to share an image with the corresponding other user (e.g., user K or Z) via data-based messaging and / or text messaging. As will be described in more detail below, sharing option 616a can be selected to share an image with another electronic device selected based on the orientation of the electronic device 500 relative to other nearby electronic devices 610a-610e. As will be described in more detail below, sharing option 616a can be selected to share an image with another electronic device selected based on the orientation of the electronic device 500 relative to other nearby electronic devices 610a-610e. Figure 6C As shown, the share option 616a includes an image representing the other electronic device 610c, such as an image included in a contact card stored on the electronic device 500, which contact card includes contact information of one or more user accounts (e.g., phone numbers, email addresses) associated with a user of the other electronic device 610c.
[0208] Each option 618a-618e can be selected to initiate the process of sharing the image using the corresponding method of sharing the image. Option 618a can be selected to initiate the process of sharing the image using a wireless network sharing protocol, as will be described below with reference to Figures 6S to 6TAs described in more detail below, option 618b can be selected to initiate the process of sharing the image using email. Option 618c can be selected to initiate the process of sharing the image using enhanced data-based messaging or text messaging. Option 618d can be selected to initiate the process of sharing the image using a first social media application. Option 618e can be selected to initiate the process of sharing the image using a second social media application.
[0209] Options 620a-620c can be selected to perform non-sharing actions with respect to the image. Option 620a can be selected to copy the image. Option 620b can be selected to add the image to a favorite image list. Option 620c can be selected to tag the image.
[0210] like Figure 6C As shown, electronic device 500 is oriented toward another electronic device 610c. Because electronic device 500 is oriented toward other electronic device 610c, electronic device 500 configures wireless sharing protocol option 616a to be selectable for sharing images with other electronic device 610c (eg, instead of device 610d).
[0211] exist Figure 6D , electronic device 500 begins to change its orientation relative to other electronic devices 610a-610e. In response to detecting the movement of electronic device 500, electronic device 500 presents indications 620a and 620d of electronic devices 610a and 610d, respectively, around wireless network protocol sharing option 616a. The positions of indications 620a and 620d relative to option 616a are based on the positions of electronic devices 610a and 610d relative to electronic device 500. For example, indication 620a is in the upper left corner of sharing option 616a because electronic device 601a is in the upper left corner of electronic device 500, and indication 620d is in the lower right corner of sharing option 616a because electronic device 610d is in the lower right corner of electronic device 500.
[0212] Electronic device 500 does not present an indication of electronic device 610e because electronic device 500 and electronic device 610e are not configured to share data using a wireless network sharing protocol (e.g., electronic device 500 does not include a contact card associated with electronic device 610e, electronic device 610e is not discoverable for content sharing, electronic device 610e is not connected to a wireless network, etc.).
[0213] Electronic device 500 does not display an indication for electronic device 610b because electronic device 610b and electronic device 610a are too close to each other so that, at the current distance between electronic device 500 and electronic devices 610a and 610b, electronic device 500 cannot be oriented uniquely toward one of electronic devices 610a and 610b. Electronic device 500 optionally displays indication 620a for electronic device 610a instead of electronic device 610b based on the frequency and / or recency with which electronic device 500 shared content with electronic device 610a instead of electronic device 610b.
[0214] Generally speaking, if the electronic device 500 is pointed at another electronic device within a predetermined angular range (e.g., 20 degrees, 30 degrees, etc.), the share option 616a can be selected to share content with the other electronic device at which the electronic device 500 is pointed. If the electronic device 500 is not pointed at another electronic device when the share user interface is opened, the electronic device 500 optionally selects the other electronic device based on the frequency and recency of sharing with other nearby electronic devices 610. If the electronic device is not pointed at another electronic device and the frequency and / or recency with which the electronic device has shared content with nearby electronic devices is insufficient (e.g., compared to one or more predetermined thresholds), the electronic device 500 optionally forgoes displaying the share option 616a.
[0215] Figure 6E 5 shows the position of the electronic device 500 when it is moving. Figure 6E As shown, the positions of the indicators 620a and 620d around the option 616a are updated to reflect the positions of the electronic devices 610a and 610d relative to the electronic device 500. The electronic device 500 continues to move to Figure 6F The position in.
[0216] Figures 6F to 6J FIG. 5 shows how the electronic device 500 updates the wireless network sharing protocol option 616a in response to detecting that the electronic device 500 is oriented toward another electronic device. Figure 6F In response to detecting the orientation of the electronic device 500 relative to the other electronic device 610d, the electronic device 500 generates a tactile output (e.g., such as the one described above with reference to FIG. Figures 5I to 5N The tactile output (one of the tactile outputs) and the audio output are used to indicate that the electronic device 500 is oriented toward another electronic device 610d that may be shared with it via a wireless network sharing protocol. In addition, the size of the indication 620d of the other electronic device 610d begins to increase. As will be described below with reference to Figures 6G to 6JDescribed in more detail, if the electronic device 500 remains oriented toward the other electronic device 610 d for a threshold amount of time 624 b , the electronic device 500 updates the wireless network sharing protocol option 616 a to be selectable for sharing images with the other electronic device 610 d .
[0217] exist Figure 6G , the electronic device 500 continues to be oriented toward the other electronic device 610d for a period of time 624a. As the current time 624a approaches the threshold time 624b, the electronic device 500 presents an indication 622 of the progress of the process of updating the wireless network protocol sharing options 616a.
[0218] exist Figure 6H , the amount of time 624a that the electronic device 500 remains oriented toward the other electronic device 610d reaches a threshold amount of time 624b. The electronic device 500 updates the indication 622 of the progress of updating the sharing option 616a to indicate that the threshold time 624b has been reached by completing the circle around the sharing option 616a. In some embodiments, as the current time 624a approaches the threshold time 624b, the electronic device 500 gradually animates the indication 622 of the completion of the circle around the sharing option 616a.
[0219] like Figure 6I As shown, after reaching the threshold time 624b, when the selectable option is updated from being selectable to share the image with electronic device 610c to being selectable to share the image with electronic device 610d, electronic device 500 presents an animation in which indication 620d of electronic device 610d replaces indication 620c of electronic device 610c.
[0220] like Figure 6J As shown, the electronic device 500 generates a tactile output (e.g., Figure 5I5N ) and an audio output indicating that the sharing option 616a has been updated. The sharing option 616a is updated to include an indication (e.g., the letter "D") representing the other electronic device 610d. Once the sharing option 616a has been updated, in response to detecting the selection of the sharing option 616a, the electronic device 500 optionally initiates a process of sharing the image with the other electronic device 610d (e.g., instead of the device 610c) using the wireless network sharing protocol. In addition to updating the sharing option 616a, the electronic device 500 presents an indication 620c of the electronic device 610c at a position around the sharing option 616a indicating the orientation of the electronic device 610c relative to the electronic device 500. Although the sharing option 616a is updated in response to the change in the orientation of the electronic device 500, the remaining selectable options 616b-616d, 618a-618e, and 620a-620c remain unchanged (e.g., remain selectable to initiate a corresponding sharing process that does not change according to the orientation of the device 500).
[0221] exist Figure 6K , the share option 616a is configured to initiate the process of sharing the image with the electronic device 610a when selected. Figures 6F to 6J The sharing options 616a are updated in a similar manner as shown in FIG. For the sake of brevity, these details are not repeated here. Figure 6K , the electronic device 500 begins to move toward the electronic devices 610a and 610b Figure 6L The location shown in .
[0222] In response to the electronic device 500 moving to Figure 6L In the position shown in FIG, the electronic device 500 presents an indication 620b of the electronic device 610b around the selectable option 616a. This is because Figure 6L At the distances shown from electronic devices 610a and 610b, electronic device 500 is able to distinguish between being oriented toward electronic device 610a and being oriented toward electronic device 610b (e.g., the angles between devices 610a and 610b and device 500 are greater than a threshold angle, but not less than a threshold angle, optionally at Figure 6L where they are threshold angles before the device 500 moves). Figure 6L As shown, electronic device 500 begins to rotate toward electronic device 610b.
[0223] like Figure 6M As shown, the electronic device 500 has moved to face the electronic device 610b. In response to the orientation of the electronic device 500 toward the electronic device 610b, the electronic device 500 updates the share option 616a to be selectable to share with the electronic device 610b. Figures 6F to 6J The photo is shared with electronic device 610b in a similar manner as shown.
[0224] exist Figure 6N , the user selects the share option 616a (eg, using contact 603). In response to the user's selection, the electronic device 500 initiates a process of sharing the image with the electronic device 610b using the wireless network sharing protocol.
[0225] Figures 6O to 6P The electronic device 500 is shown presenting an indication 626 of the progress of sharing photos with the electronic device 610b using the wireless network sharing protocol. Figure 6O , the electronic device 500 presents a partially complete ring 626 around the share option 616a, which indicates the progress of the sharing process, and text 628 indicating that the photo is currently being sent to the other electronic device 610b. As the sharing process continues, the arrangement 626 is animated to become a complete circle around the share option 616a.
[0226] exist Figure 6P , the electronic device 500 presents a complete ring 626 and text 628 around the share option 616a to indicate that the photo has been sent to the other electronic device 610b via the wireless network sharing protocol.
[0227] Figures 6Q to 6R The electronic device 500 is shown sharing an image with another electronic device via a data-based message or a text message. Figure 6Q In , the user selects (e.g., using contact 603) option 616d to share the image with another electronic device via an enhanced data-based message or text message. Figure 6R , in response to the user's selection, the electronic device 500 presents a messaging user interface 630 with a message pre-populated with an image 632 and a recipient (eg, user Z). The user of the electronic device 500 can send a message to another user using the messaging user interface.
[0228] like Figure 6S As shown, option 618a includes a flag indicating the number of electronic devices with which electronic device 500 can share photos using the wireless network sharing protocol. Figure 6S In FIG. 6 , the user (eg, using contact 603) selects option 618a for presenting a wireless network sharing protocol user interface. In response to the user's selection, the electronic device 500 presents Figure 6T The wireless network sharing protocol user interface is shown.
[0229] like Figure 6T As shown, the user interface includes Figure 6SA similar sharing option 634 is shown as the sharing option 616a, which is used by other electronic devices. Figure 6L Indicator 620 is shown surrounded by similar indicators 636a, 636c, 636d, 636m, and 636t. Share option 634 is an enlarged version of share option 616a, and indicators 636a, 636c, and 636d are images corresponding to indicators 610a, 610c, and 610d. Therefore, the position of indicator 636 reflects the position of other electronic device 610 relative to electronic device 500 and moves to different positions as the orientation or position of electronic device 500 or electronic device 610 changes. Option 634 and indicator 636 are presented at a larger size than option 616a and indicator 620.
[0230] The wireless network sharing protocol user interface also includes a plurality of selectable options 638 that, when selected, cause the electronic device 500 to share images with corresponding other electronic devices using the wireless network sharing protocol. The position of the options 638 within the user interface does not change as the orientation of the electronic device 500 changes.
[0231] The user interface categorizes the selectable options 638 into categories, such as electronic devices belonging to users known to the user of the electronic device 500 (e.g., users whose contact cards the electronic device 500 includes), devices associated with the same user account as the user account of the electronic device 500, and other nearby devices that are not associated with users known to the user of the electronic device 500 or are not associated with the user of the electronic device 500. More specifically, options 638c, 638a, 638d, and 638b can be selected to share content with electronic devices associated with users known to the user of the electronic device 500; options 638t and 638m are associated with electronic devices associated with the user of the electronic device 500; and option 638e can be selected to share content with another electronic device 610e that is nearby the electronic device 500. As shown in FIG. 6T , there are seven electronic devices with which the electronic device 500 can share photos using the wireless network sharing protocol, which utilizes Figure 6S This is indicated by the icon shown overlaid on option 618a.
[0232] In some embodiments, a sensor (e.g., circuitry) of the electronic device 500 that determines the other electronic device 610 at which the electronic device 500 is pointed functions with a desired level of reliability when the orientation of the electronic device 500 is within a predetermined range of orientations, and the sensor does not perform with a desired level of reliability when the orientation of the electronic device 500 is outside of the predetermined range of orientations. The predetermined range of orientations is optionally a range of angles between the electronic device 500 and a reference plane. In some embodiments, the reference plane is perpendicular to gravity. In some embodiments, the reference plane is a plane between the electronic device 500 and the other electronic device 610, and the electronic device 500 is configured to respond to detecting a request for an optional sharing option (such as Figure 6T Option 634 shown or Figure 6S Thus, in some embodiments, the electronic device 500 provides visual feedback to the user to encourage the user to position the electronic device 500 within a desired predetermined orientation range during the content sharing operation. Figure 6KK , the surface of the device 500 that faces the reference plane is, optionally, the rear surface of the device (e.g., the surface of the device opposite to the surface on which the touch screen 504 is disposed), and the surface of the device 500 that faces away from the reference plane is, optionally, the front surface of the device (e.g., the surface of the device on which the touch screen 504 is disposed).
[0233] return Figure 6T , when the electronic device 500 is at an angle θ relative to the reference plane 640a (where θ is within a desired predetermined range of orientations), the selectable share option 634 is displayed in a flat visual orientation. Figure 6T As shown, the reference plane 640a is perpendicular to the gravity g. When the angle θ between the electronic device 500 and the reference plane 640a is greater than the reference angle r, the circuitry for determining which electronic device 610 the electronic device 500 is pointing to can optionally be performed with desired reliability. Figure 6T As shown, when the angle θ between the electronic device 500 and the reference plane 640a is greater than the reference angle r, the sharing option 634 is displayed with a flat visual appearance. Displaying the sharing option 634 in a flat visual orientation optionally includes displaying the sharing option 634 in a circular shape. The image representing the other electronic device 610b (e.g., the letter "B") within the sharing option 634 is displayed in an undistorted manner.
[0234] like Figures 6U to 6Y As shown, in some embodiments, when the angle θ between the electronic device 500 and the reference plane 640a is less than the reference angle r, the sharing option 634 is not updated when the electronic device 500 is rotated to point to a different electronic device 610.
[0235] For example, Figure 6U As shown, after electronic device 500 first changes position to point at another electronic device 610a and then is oriented at an angle θ that is less than a reference angle r, sharing options 634 are updated (e.g., when device 500 is rotated to point at device 610a, angle θ is greater than reference angle r). Because electronic device 500 is rotated to point at electronic device 610a, sharing options 634 include image A representing electronic device 610a. After rotating toward device 610a, because angle θ between electronic device 500 and reference plane 640a is less than reference angle r, sharing options 634 are displayed with a tilted appearance. Displaying the share option 634 with a tilted appearance includes: displaying the share option 634 with an oval shape; distorting the image representing the electronic device 610a, such as by stretching the image horizontally and shortening the image vertically; and / or adjusting the size of the indicators 636b, 636c, 636d, 636m, and 636t of the other electronic devices so that the representations toward the top of the share option 634 (e.g., indicators 636b and 636c) are smaller and the representations toward the bottom of the share option 634 (e.g., indicators 636d and 636m) are larger (e.g., as if the indicators 636 wrap around the share option 634 outside the plane of the display 504). These modifications to the share option 634 give the option a tilted appearance. Displaying the option with a tilted appearance indicates to the user that the angle between the electronic device 500 and the reference plane 640a needs to be adjusted to restore the desired reliability of the circuitry of the other electronic devices 610 that determines the direction at which the electronic device 500 is pointed.
[0236] like Figure 6V As shown, when the angle θ between the electronic device 500 and the reference plane 640a is less than the reference angle r, the electronic device 500 rotates to point to the electronic device 610b. Because the angle θ is less than the reference angle r, the sharing option 634 is not updated to include an image representing the electronic device 610b even though the electronic device 500 is pointing to the electronic device 610b. Instead, the sharing option 634 continues to correspond to the electronic device 610a, which is the last electronic device 610 that the electronic device 500 pointed to when the angle θ between the electronic device 500 and the reference plane 640a was greater than the reference angle r. Although the optional sharing option 634 is not updated in response to the electronic device 500 changing its orientation to point to the electronic device 610b, the position of the representation 636 of other electronic devices available for sharing moves according to the movement of the electronic device 500 relative to the other electronic devices available for sharing. Figure 6V , the user selects share option 634 (eg, using contact 603 ).
[0237] like Figure 6W As shown, in response to detecting Figure 6V By selecting share option 634, electronic device 500 initiates the process of sharing content with electronic device 610a. This sharing process is initiated when angle θ between electronic device 500 and reference plane 640a is less than reference angle r. Because share option 634 is not updated in response to electronic device 500 pointing at electronic device 610b, the content is shared with electronic device 610a. While sharing content with electronic device 610a, electronic device 500 displays an indication 648 that sharing is in progress.
[0238] However, in some embodiments, if selection of option 634 is detected when the angle θ between the electronic device 500 and the reference plane 640a is less than the reference angle r, the electronic device 500 does not initiate the process of sharing the content, such as Figures 6X to 6Y shown. Figure 6X and Figure 6V 6 is similar in that the angle θ between the electronic device 500 and the reference plane 640a is less than the reference angle r, the electronic device 500 is pointed at the electronic device 610b, and the selectable sharing option 634 includes an indication of the electronic device 610a. The selectable sharing option 634 includes an indication of the electronic device 610a because the last time the electronic device 500 was at the angle θ greater than the reference angle r, the electronic device 500 was pointed at the electronic device 610a.
[0239] like Figure 6X As shown, the user (eg, using contact 603) selects selectable share option 634. In response to the user's selection, the electronic device 500 abandons sharing the content and generates a tactile output 646 (eg, such as described above with reference to FIG. 6). Figures 5I to 5N a tactile output) and a visual indication 642, such as Figure 6Y Visual indication 642 indicates that the user is tilting electronic device 500 (eg, to an angle greater than r), and selectable option 644, when selected, causes electronic device 500 to clear the indication.
[0240] In some embodiments, even when the angle θ between the electronic device 500 and the reference plane 640a is less than the reference angle r, the selectable sharing option 634 is updated to indicate the electronic device 610 to which the electronic device 500 is pointing, such as Figures 6Z to 6BB As shown. Figure 6Z In FIG, the electronic device 500 is pointed at the electronic device 610b and is at an angle θ relative to the reference plane 640a that is smaller than the reference angle r. Because the electronic device 500 is pointed at the electronic device 610b, the selectable sharing option 634 includes an indication of the electronic device 610b.
[0241] exist Figure 6AA In FIG, the electronic device 500 rotates to point at the electronic device 610a while maintaining an angle θ with respect to the reference plane 640a that is less than the reference angle r. In response to detecting that the electronic device 500 is pointing at the electronic device 610a, the electronic device 500 updates the selectable sharing options 634 to include an indication of the electronic device 610a. The electronic device 500 also updates the display of the representations 636 of the other electronic devices available for sharing based on the movement of the electronic device 500 relative to the other electronic devices available for sharing. Figure 6AA As shown, the user selects selectable share option 634 (eg, using contact 603 ).
[0242] like Figure 6BB As shown, in response to Figure 6AA In response to the user selection in , the electronic device 500 initiates a process of sharing content with the electronic device 610a. While sharing content with the electronic device 610a, the electronic device 500 displays an indication 648 that sharing is in progress.
[0243] Figures 6CC to 6KK The electronic device 500, when displaying a sharing user interface, displays a selectable sharing option 616a in an angled appearance in response to detecting that an angle θ between the electronic device and a reference plane 640a or 640b is less than a reference angle r. The sharing user interface includes a plurality of selectable options 616 and 618 for sharing content using various sharing protocols. Figures 6CC to 6KK The sharing user interface shown is similar to the one in the reference above. Figures 6A to 6S The sharing user interface.
[0244] Figures 6CC to 6DD 640a) as the angle θ between the electronic device 500 and the reference plane 640a decreases (and becomes further away from the magnitude of the reference angle r). The relationship between the visual tilt of the sharing option 616a and the angle θ between the electronic device 500 and the reference plane 640a optionally also applies to Figures 6T to 6BB Sharing options 634 are shown. In addition, Figures 6T to 6BB The various results shown for rotating the device 500 and / or selecting the share option 634 are optionally also applicable to Figures 6CC to 6KK The share option 616a in.
[0245] Figure 6CCThe sharing user interface is shown when the angle θ between the electronic device 500 and the reference plane 640a is less than the reference angle r. When the electronic device 500 is pointed at the electronic device 610a, the sharing option 616a includes an indication of the electronic device 610a. Because θ is less than r, the sharing option 616a is displayed with a visual tilt effect. While the selectable sharing option 616a is displayed with the visual tilt effect, the electronic device 500 continues to update the position of the indication 620 of the other electronic device available for sharing based on the change in the orientation of the electronic device 500 relative to the other electronic device 610.
[0246] like Figure 6DD As shown, as the angle θ between the electronic device 500 and the reference plane 640a decreases (while remaining less than r), the visual tilt of the sharing option 616a increases (e.g., as if the top of the sharing option 616a continues to move further down into the plane of the touch screen 504, and as if the bottom of the sharing option 616a continues to move further out of the plane of the touch screen 504). For example, the height of the sharing option 616a shown in Figure 6DD is less than Figure 6CC The height of the share option 616a is shown because Figure 6DD The value of θ in is less than Figure 6CC The value of θ in .
[0247] Figure 6EE 6. The sharing user interface is shown when the electronic device 500 is parallel to the reference plane 640a (or more generally, less than an angle α relative to the reference plane 640a, including potentially negative angles relative to the reference plane 640a). In response to detecting that the electronic device 500 is parallel to the reference plane 640a, the electronic device 500 stops displaying the sharing option 616a, displays an indication 650 instructing the user to tilt the electronic device 500, and presents a tactile output 646 (e.g., such as the tactile output described above). Figures 5I to 5N Indication 650 is displayed at the same location in the user interface where share option 616a was displayed.
[0248] like Figures 6FF to 6GG As shown, when the user tilts the electronic device 500 from parallel to the reference plane 640a to an angle θ greater than the reference angle r, the electronic device 500 presents a sharing option 616a with a visual tilt that decreases as θ increases (while θ is still less than r), and then, once θ is equal to and / or greater than r, presents a sharing option 616a with no visual tilt (e.g., and as θ increases while θ is greater than r, there remains no visual tilt).
[0249] exist Figure 6FFIn response to detecting that electronic device 500 is no longer parallel to reference plane 640a and that angle θ between electronic device 500 and reference plane 640a is less than reference angle r, electronic device 500 displays selectable sharing option 616a with a visually tilted appearance. Sharing option 616a is displayed at the same location in the user interface as indication 650.
[0250] like Figure 6GG As shown, when the angle θ between the electronic device 500 and the reference plane 640a increases while remaining less than the reference angle r, the electronic device 500 displays the sharing option with a visual tilt that appears to be more tilted than the visual tilt with which the optional sharing option 616a is displayed when θ is less (e.g., when the orientation of the device 500 is less than the reference angle r relative to the reference plane 640a, the sharing option 616a is displayed with an increasingly less tilted visual tilt appearance as the orientation of the device 500 moves further away from the reference plane 640a, and the sharing option 616a is displayed with an increasingly tilted visual tilt appearance as the orientation of the device moves closer to the reference plane 640a). For example, when θ is less than the reference angle r relative to the reference plane 640a, the sharing option 616a is displayed with an increasingly less tilted visual tilt appearance. Figure 6FF China and Belgium Figure 6GG The selectable share option 616a is displayed with a visual tilt in Figure 6FF China and Belgium Figure 6GG Thus, in some embodiments, the amount of change in the tilt of the share option 616a changes in an amount proportional to the amount of change in the orientation of the device 500, and the direction of change in the tilt of the share option 616a also changes as the direction of change in the orientation of the device 500 changes.
[0251] exist Figure 6HH , the electronic device 500 returns to an angle θ greater than the reference angle r (e.g., as shown in FIG. 5 ) after being parallel to the reference plane 640a. Figure 6EE In response to detecting that the electronic device 500 returns to an angle θ greater than the reference angle r after being parallel to the reference plane 640a, the electronic device 500 generates a tactile output 652 (e.g., such as the tactile output θ described above). Figures 5I to 5N one of the tactile outputs described). Figure 6HH The tactile output 652 shown in FIG. 5 and generated in response to detecting that the electronic device 500 has returned to an angle θ greater than the reference angle r has one or more characteristics that differ from the tactile output 652 described above with reference to FIG. Figure 6EEOne or more characteristics of tactile output 656 generated in response to detecting that electronic device 500 is parallel to reference plane 640a. For example, tactile output 656 is optionally an "error" tactile output, such as three tactile pulses indicating to the user that an error has occurred (e.g., an "error" tactile output is also generated at electronic device 500 in response to detecting other errors), and tactile output 652 is a "notification" tactile output, such as a single pulse indicating a notification event to the user (e.g., a "notification" tactile output is also generated at electronic device 500 in response to detecting a non-error event, such as a notification, at the electronic device).
[0252] like Figure 6HH As shown, in response to detecting that the angle θ between the electronic device 500 and the reference plane 640a is greater than the reference angle r, the selectable sharing option 616a is displayed with a flat visual appearance. Displaying the selectable sharing option 616a with a flat visual appearance includes displaying the option 616a in a circular shape.
[0253] Figures 6II to 6KK 6T to 6T illustrate how the electronic device 500 modifies the appearance of the selectable share option 616a based on the orientation of the electronic device 500 relative to a reference plane 640b, which is defined relative to another electronic device 610 with which the electronic device 500 can share content. Figure 6HH The various sharing, visual tilt and other features described above are optionally also applicable to Figure 6II to Figure 6KK .
[0254] exist Figure 6II 6. In the embodiment of the present invention, electronic device 500 is at an angle θ relative to reference plane 640b that is greater than reference angle r. Reference plane 640b is a plane between electronic device 500 and electronic device 610c, with which electronic device 500 will share content in response to detecting selection of selectable share option 616a. Electronic device 610c is optionally selected for sharing because electronic device 500 is pointed at electronic device 610c.
[0255] exist Figure 6JJ In FIG, electronic device 500 is rotated to point at electronic device 610a. In response to detecting a change in the orientation of electronic device 500 from pointing at electronic device 610c to pointing at electronic device 610a, electronic device 500 updates selectable sharing options 616a to include an indication of electronic device 610a. Additionally, reference plane 640b is now defined relative to electronic device 610a rather than relative to electronic device 610c. Figure 6JJ, the angle θ between the electronic device 500 and the reference plane 640b is greater than the reference angle r, and thus the selectable sharing option 616a is displayed with a visually flat (eg, non-tilted) appearance.
[0256] exist Figure 6KK In the embodiment, the electronic device 500 changes its orientation so that the angle θ between the electronic device 500 and the reference plane 640b is less than the reference angle r. In response to detecting that the angle θ is less than the reference angle r, the electronic device 500 displays the share option 616a in a visually tilted appearance, such as the previously referenced Figure 6T to Figure 6HH As stated.
[0257] Figures 7A to 7J 700 is a flowchart illustrating a method of presenting an option that can be selected to share content with a second electronic device that is oriented toward a first electronic device according to some embodiments of the present disclosure. Method 700 is optionally performed on an electronic device (such as device 100, device 300, device 500), as described above with reference to Figure 1A-1B 、 Figure 2-Figure 3 、 Figure 4A-4B and Figures 5A-5H Some operations in method 700 may be optionally combined, and / or the order of some operations may be optionally changed.
[0258] In some embodiments, such as Figure 6CIn the embodiment of the present invention, a first electronic device 500 (e.g., a mobile device including a touch screen (e.g., a tablet, smartphone, media player, or wearable device) or a computer including one or more of a keyboard, a mouse, a trackpad, and a display / touch screen) in communication with a display device 504 and one or more input devices displays (702) a sharing user interface via the display, the sharing user interface including a plurality of selectable content sharing options 616a-616d and 618a-618e for sharing content with other devices, including a first content sharing option 618a, wherein the first content sharing option displayed at a first position in the sharing user interface can be selected to initiate a process of sharing content with a second electronic device 610c. Optionally, a plurality of representations of content sharing options are presented in a sharing user interface element, the sharing user interface element being presented in response to detecting user input for initiating a process of sharing content with another electronic device. The sharing user interface element optionally includes a selectable option related to sharing content from an application that received the user input for initiating a process of sharing content. In some embodiments, in response to detecting a selection of one of the representations, the electronic device initiates a process of sharing content using a sharing method represented by the selected sharing option. Sharing options optionally include text messaging, enhanced data-based messaging, email, social media, hyperlinks, and short-range wireless sharing protocols (eg, sharing over Wi-Fi or Bluetooth operations, etc.) The first option is optionally a wireless network sharing protocol option.
[0259] In some embodiments, such as Figure 6F , when displaying a plurality of content sharing options 616a-616d and 618a-618e and a first content sharing option 616a that can be selected to initiate a process of sharing content with a second electronic device 610c, the electronic device 500 detects (704) a change in orientation of the first electronic device 500 from a first orientation to a second orientation (e.g., a rotational or translational movement of the electronic device). For example, the top edge of the electronic device initially points in a first direction and moves to point in a second direction.
[0260] In some embodiments, such as Figure 6EIn response to detecting a change in the orientation of the first electronic device 500 (706), based on determining that the second orientation satisfies one or more sharing criteria associated with the second electronic device 610c, the first content sharing option 616a remains selectable to initiate a process of sharing content with the second electronic device 610c using the first content sharing option (708). In some embodiments, the one or more sharing criteria include criteria that are met when the first electronic device and the second electronic device are communicating with each other (e.g., via a wireless network sharing protocol), the orientation of the first electronic device corresponds to the second electronic device, and / or the first electronic device determines that the user of the first electronic device is likely to select the second electronic device as a sharing destination based on previous sharing behavior with the second electronic device. For example, the top edge of the first electronic device is pointed towards the second electronic device (e.g., within an angular range of the orientation of the second electronic device, such as 10 degrees or 20 degrees), or the first electronic device frequently shares the same type of content as the content to be shared with the second electronic device.
[0261] In some embodiments, such as Figure 6J In response to detecting a change in the orientation of the first electronic device 500 (706), based on determining that the second orientation satisfies one or more sharing criteria associated with the third electronic device 610d, the sharing user interface includes a content sharing option 616a displayed at a first location in the sharing user interface, which can be selected to initiate a process of sharing content with the third electronic device 610d without initiating a process of sharing content with the second electronic device 610c (710). Optionally, the orientation of the first electronic device changes from an orientation with the top edge of the first electronic device toward the second electronic device to an orientation with the top edge of the first electronic device toward the third electronic device (e.g., within an angular range of the orientation of the third electronic device, such as 10 degrees or 20 degrees). In this scenario, the sharing option displayed at the first location in the sharing user interface optionally becomes selectable to initiate sharing with the third electronic device instead of the second electronic device (e.g., because the first electronic device is no longer pointed at the second electronic device).
[0262] The above-mentioned manner of selecting one between the second electronic device and the third electronic device as the recipient of the shared content based on the final orientation of the electronic device allows the first electronic device to change which electronic device will receive the shared content item based on the orientation of the first electronic device, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by changing which electronic device will receive the shared content based on the orientation, rather than requiring the user to navigate a visual user interface to select an electronic device to receive the content), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0263] In some embodiments, such as Figure 6J In some embodiments, in response to detecting a change in the orientation of the first electronic device 500 (712), based on determining that the second orientation satisfies the one or more sharing criteria associated with the third electronic device 610d (e.g., selecting the first content sharing option will cause the first electronic device to share content with the third electronic device because the first electronic device is oriented toward the third electronic device for a time longer than a time threshold), the electronic device 500 updates (714) the appearance of the first content sharing option 616a to change from an appearance corresponding to the second electronic device 610c to an appearance corresponding to the third electronic device 610d. In some embodiments, when the first content sharing option is associated with the second electronic device, the first content sharing option includes an image associated with the second electronic device, and when the first content sharing option becomes associated with the third electronic device, the first content sharing option is updated to include an image associated with the third electronic device instead of an image associated with the second electronic device. For example, the image associated with the respective electronic device is an image included in a contact card stored on the first electronic device, the contact card also including information about contacting the respective electronic device and / or a user account associated with the respective electronic device (e.g., a phone number, an email address, a social media account, etc.).
[0264] Updating the appearance of the first content sharing option to correspond to the electronic device associated with the first sharing option in the above-mentioned manner allows the first electronic device to indicate to the user which electronic device the content will be shared with in response to selection of the first sharing option, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by reducing the number of inputs required to determine which electronic device is associated with the first sharing option), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0265] In some embodiments, such as Figure 6JIn response to detecting a change in the orientation of the first electronic device 500 (716), based on determining that the second orientation satisfies the one or more sharing criteria associated with the third electronic device 610d, the electronic device 500 replaces (718) the first content sharing option 616a with a content sharing option 616a that can be selected to initiate a process of sharing content with the third electronic device 610d (for example, the electronic device stops displaying the first content sharing option associated with the second electronic device and displays the content sharing option that can be selected to initiate a process of sharing content with the third electronic device at a first position in the user interface).
[0266] The above-mentioned manner of replacing the first content sharing option with a content sharing option that can be selected to initiate the process of sharing content with a third electronic device allows the first electronic device to save display area for other content such as other sharing options, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by enabling the user to continue viewing other content (for example, other sharing options) without having to scroll or pan the user interface), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0267] In some embodiments, such as Figure 6D In some embodiments, when the orientation of the first electronic device 500 changes, the first electronic device 500 displays one or more visual indications 620a, 620c, and 620d of one or more other electronic devices 610a and 610d, including the second electronic device 610c (e.g., within the first option 616a), along with the first content sharing option 616a (e.g., displaying the one or more visual indications within the first content sharing option, adjacent to the first content sharing option, surrounding the first content sharing option, etc.) (720), the one or more other electronic devices being within a threshold distance (e.g., 6 feet, 10 feet, 20 feet, or a distance defined by the range of a wireless communication protocol between the first electronic device and the other devices) of the first electronic device 500. In some embodiments, the visual indications of the one or more other electronic devices are presented at positions relative to the first sharing option that reflect the positions of the one or more other electronic devices relative to the first electronic device. For example, the first sharing option is an icon, and the visual indications of the other electronic devices are dots located around the first sharing option at an orientation corresponding to the orientation of each corresponding other electronic device relative to the reference orientation of the first electronic device. For example, if the third electronic device is to the right of the direction in which the top edge of the first electronic device is oriented, the first electronic device presents a dot to the right of the first sharing option representing the third electronic device.
[0268] The above-described manner of presenting visual indications of the one or more other electronic devices allows the first electronic device to indicate to the user the location of electronic devices that the first electronic device can detect and share content with, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by reducing the amount of time it takes the user to locate the first electronic device so that the first sharing option is updated to be selectable to share content with the desired other electronic devices), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0269] In some embodiments, such as Figure 6C , when the orientation of the first electronic device 500 has not changed (e.g., the first electronic device has not moved), the first electronic device 500 stops (722) displaying the one or more visual indications 620 of the one or more other electronic devices 610. Optionally, in response to detecting a change in the orientation of the first electronic device, the first electronic device presents the one or more visual indications of the one or more other electronic devices.
[0270] The above-described manner of stopping displaying the one or more visual indications of the one or more other electronic devices when the orientation of the first electronic device has not changed allows the first electronic device to abandon determining the location for displaying the one or more indications when the orientation of the electronic device has not changed, which reduces power usage and extends the battery life of the electronic device by reducing the number of operations that the electronic device needs to perform.
[0271] In some embodiments, such as Figure 6D , the one or more visual indications 620a, 620c, and 620d of the one or more other electronic devices 610a and 610d include a user interface element (724) that at least partially surrounds the first content sharing option 616a. In some embodiments, the one or more visual indications of the one or more other electronic devices are located in a ring around the first content sharing option. For example, the first content sharing option is a circular icon, and the one or more visual indications of the one or more other electronic devices are dots positioned around the icon at a position on the ring that corresponds to the position of each corresponding other electronic device relative to the first electronic device.
[0272] The above-mentioned manner of presenting the one or more visual indications of the one or more other electronic devices in a ring around the first content sharing option allows the first electronic device to present visual indications at positions around the first content sharing option corresponding to the positions of the other electronic devices relative to the first electronic device, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by enabling the user to more quickly identify how to move the first electronic device to orient the first electronic device toward the corresponding other electronic device), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0273] In some embodiments, such as Figure 6D In some embodiments, the user interface element at least partially surrounding the first content sharing option 616a includes one or more corresponding indications 620a and 620d (726) of one or more other electronic devices 610a and 610d displayed on the user interface element at least partially surrounding the first content sharing option 616a. Optionally, the electronic device presents a ring around the first content sharing option that includes dots or other visual indications at corresponding positions of the one or more other electronic devices relative to the first electronic device. In some embodiments, the position of the dots indicates the angle of the one or more other devices relative to the central axis of the first electronic device, but does not indicate the distance between each of the one or more electronic devices and the first electronic device.
[0274] The above-mentioned manner of presenting the one or more visual indications of the one or more other electronic devices in an arrangement around the first content sharing option allows the first electronic device to present visual indications at positions around the first content sharing option corresponding to the positions of the other electronic devices relative to the first electronic device, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by enabling the user to more quickly identify how to move the first electronic device to orient the first electronic device toward the corresponding other electronic device), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0275] In some embodiments, such as Figure 6DIn the embodiment, one or more other electronic devices 610a and 610d are devices associated with users or user accounts that have a predetermined relationship with the user or user account associated with the first electronic device 500 (e.g., the first electronic device stores the other electronic device or the user account associated with the other electronic device as a contact, the first electronic device stores the other electronic device in a list of electronic devices with which it may share content, the first electronic device has previously shared content with the other electronic device, etc.), and the user interface elements at least partially surrounding the first content sharing option 616 do not include one or more corresponding indications of one or more other corresponding electronic devices 610e that are within a threshold distance of the first electronic device 500 but are unknown to the electronic device (728). In some embodiments, the electronic devices unknown to the first electronic device optionally include: electronic devices that the first electronic device has not stored as contacts (and does not store user accounts associated with other electronic devices as contacts), electronic devices that the first electronic device does not store in a list of electronic devices with which it may share content, and / or electronic devices with which the first electronic device has not previously shared content. For example, the second electronic device and the third electronic device are known to the first electronic device, and the fourth electronic device within a threshold distance of the first electronic device is unknown to the first electronic device, so the first electronic device presents indications for the second electronic device and the third electronic device, but does not present an indication for the fourth electronic device.
[0276] The above-described manner of presenting only indications of other electronic devices known to the first electronic device allows the first electronic device to enable the user to more quickly configure a first selectable option for sharing content with one of the other electronic devices selected by the user, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by making it easier for users to locate electronic devices with which they may want to share, because users are more likely to want to share content with known electronic devices than with unknown electronic devices), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0277] In some embodiments, such as Figure 6E , before detecting a change in the orientation of the first electronic device 500, the user interface elements at least partially surrounding the first sharing option 616a include an indication 620d of the third electronic device (730). Optionally, one of the dots surrounding the first sharing option represents the third electronic device and is positioned within the arrangement around the first sharing option at a position corresponding to the relative position of the third electronic device with respect to the first electronic device.
[0278] In some embodiments, such as Figure 6I In some embodiments, in response to detecting a change in the orientation of the first electronic device 500 (732), based on determining that the second orientation satisfies one or more sharing criteria associated with the third electronic device 610d (e.g., the second orientation is that the first electronic device is positioned so that the first electronic device faces the third electronic device (e.g., the top edge of the first electronic device is the closest edge of the first electronic device to the third electronic device)), the first electronic device 500 displays (734) an animation in which the indication 620d of the third electronic device 610d changes to a visual representation of the user of the third electronic device 610d. In some embodiments, the size of the dot representing the third electronic device in the arrangement around the first sharing option expands to an image associated with the third electronic device (e.g., an image of a contact card stored on the first electronic device, the contact card including contact information about one or more user accounts associated with the third electronic device and / or the third electronic device itself (e.g., phone numbers, email addresses, etc.) (e.g., information required to share content with the third electronic device using a wireless network sharing protocol)). In some embodiments, the image representing the third electronic device moves to a first position in the user interface and becomes the first sharing option. The first sharing option optionally becomes selectable to initiate a process of sharing content with the third electronic device using a wireless network sharing protocol. In some embodiments, after the orientation of the first electronic device remains in the second orientation for a predetermined amount of time (e.g., 1 second, 2 seconds, 5 seconds), the displayed indication of the third electronic device changes to an animation of a visual representation of a user of the third electronic device.
[0279] The above-described manner of displaying an animation of the indication to the third electronic device changing to a visual representation of the user of the third electronic device allows the first electronic device to indicate to the user which electronic device the first electronic device will share content with in response to detecting a selection of the first sharing option, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by reducing the likelihood of user errors of sharing content with the wrong electronic device in response to detecting a selection of the first sharing option), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently (such as by reducing the user input required to correct errors).
[0280] In some embodiments, such as Figure 6EIn some embodiments, the first sharing option 616a is displayed as a visual representation of a user of the second electronic device 610c before a change in the orientation of the first electronic device 500 is detected (736). Optionally, the image is included in a contact card stored on the first electronic device, the contact card including contact information about one or more user accounts associated with the second electronic device (e.g., phone numbers, email addresses), and information about sharing content with the second electronic device itself (e.g., via a wireless network sharing protocol). In some embodiments, the visual representation of the user of the second electronic device is displayed within the first sharing option.
[0281] In some embodiments, such as Figure 6I In response to detecting a change in orientation of the first electronic device 500 (738), based on determining that the second orientation satisfies one or more sharing criteria associated with the third electronic device 610c (e.g., including when the first electronic device is maintained in the second orientation for an amount of time exceeding a predetermined threshold (e.g., 1 second, 2 seconds, 5 seconds, etc.)), the first electronic device 500 displays (740) an animation of the visual representation of the user of the second electronic device 610c changing to an indication 620c of the second electronic device 610c displayed on a user interface element that at least partially surrounds the first sharing option 616a. Optionally, the size of the indication of the second electronic device is reduced from the size of the indication to a dot in the arrangement surrounding the first sharing option. The indication of the second electronic device displayed on the arrangement is optionally positioned at a location on the arrangement corresponding to the location of the third electronic device relative to the first electronic device. In some embodiments, if the first electronic device does not change orientation, the first sharing option remains selectable to initiate the process of sharing content with the second electronic device and continues to be presented with an image representing the user of the second electronic device.
[0282] The above-described manner in which the visual representation of the user displaying the second electronic device changes to an animation of an indication of the second electronic device displayed on the arrangement allows the first electronic device to indicate to the user that the first sharing option is no longer selectable to initiate the process of sharing content with the second electronic device, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by reducing user errors of sharing content with the wrong electronic device in response to detecting a selection of the first sharing option), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0283] In some embodiments, such as Figures 6D to 6EIn the embodiment of the present invention, the first electronic device 500 changes (742) the position of one or more corresponding indications 620a and 620d for the one or more other electronic devices 610a and 610d displayed on the interface element at least partially surrounding the first content sharing option 616a based on the change in orientation between the first electronic device 500 and the one or more other electronic devices 610a and 610d, so that the position of the one or more corresponding indications 620a and 620d for the one or more other electronic devices 610a and 610d on the user interface element at least partially surrounding the first content sharing option 616a corresponds to the relative orientation of the one or more other electronic devices 610a and 610d relative to the first electronic device 500. Optionally, the one or more corresponding indications for each corresponding other electronic device are displayed at a corresponding position within the arrangement corresponding to the corresponding position of the one or more other electronic devices relative to the first electronic device. For example, when the third electronic device is positioned to the left of the first electronic device, the first electronic device displays the indication for the third electronic device to the left of the first sharing option. When the third electronic device changes position to be behind the first electronic device, the indication of the third electronic device is optionally moved to be positioned within the arrangement, at a bottom edge of the first shared option. Similarly, in some embodiments, when the first electronic device changes position, the representations of the one or more other electronic devices move to new positions in the arrangement around the first option, the new positions corresponding to the updated positions of the other electronic devices relative to the first electronic device.
[0284] The above-mentioned manner of moving one or more indications of one or more other electronic devices within the arrangement around the first sharing option in response to detecting a change in the position of one or more other electronic devices relative to the first electronic device allows the first electronic device to consistently present indications of the other electronic devices at positions within the arrangement around the first sharing option that correspond to the positions of the other electronic devices relative to the first electronic device, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by enabling the user to identify which representation corresponds to which other electronic device by looking at the positions of the other electronic devices relative to the first electronic device), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0285] In some embodiments, such as Figure 6E, the one or more corresponding indications 620 for the one or more other electronic devices 610 include a corresponding indication for the second electronic device 610c and a corresponding indication for the third electronic device 610d (744). Optionally, the corresponding indication for the second electronic device is displayed at a position within the arrangement around the first sharing option that corresponds to the position of the second electronic device relative to the first electronic device, and the corresponding indication for the third electronic device is displayed at a position within the arrangement around the first sharing option that corresponds to the position of the third electronic device relative to the first electronic device.
[0286] In some embodiments, such as Figure 10E In the embodiment of the present invention, based on determining that the second electronic device 610c and the third electronic device 610d have a first orientation difference relative to the first electronic device 500 (for example, the second electronic device and the third electronic device are separated from each other by a first angle relative to the first electronic device), the corresponding indication for the second electronic device 620d and the corresponding indication for the third electronic device 620c are separated by a first distance (746) on the user interface element that at least partially surrounds the first sharing option 616a. Optionally, the indications for the second electronic device and the third electronic device are separated from each other by a first angle relative to the first sharing option. For example, the second electronic device is to the right of the first electronic device and the third electronic device is behind the first electronic device, such that the second electronic device and the third electronic device are separated by an angle of approximately 90 degrees relative to the first electronic device. In this example, the indication for the second electronic device is displayed to the right of the first sharing option, and the indication for the third electronic device is displayed below the first sharing option, such that the second indication and the third indication are separated by an angle of approximately 90 degrees relative to the first sharing option.
[0287] In some embodiments, such as Figure 10JIn the embodiment of the present invention, based on determining that the second electronic device 610c and the third electronic device 610a have a second orientation difference relative to the first electronic device 500 (for example, the second electronic device and the third electronic device are separated from each other by a second angle relative to the first electronic device), the corresponding indication 620c for the second electronic device 610c and the corresponding indication 620a for the third electronic device 610a are separated by a second distance different from the first distance on the user interface element that at least partially surrounds the first sharing option 616a (748). Optionally, the indications for the second electronic device and the third electronic device are separated from each other by a second angle relative to the first sharing option. For example, the second electronic device is to the right of the first electronic device and the third electronic device is to the left of the first electronic device, such that the second electronic device and the third electronic device are separated by an angle of approximately 180 degrees relative to the first electronic device. In this example, the indication for the second electronic device is displayed to the right of the first sharing option and the indication for the third electronic device is displayed to the left of the first sharing option, such that the second indication and the third indication are separated by an angle of approximately 180 degrees relative to the first sharing option.
[0288] The above-mentioned manner of presenting indications of the second electronic device and the third electronic device separated by a distance corresponding to the distance between the second electronic device and the third electronic device allows the first electronic device to present indications of the second electronic device and the third electronic device at a position corresponding to the position of the second electronic device and the third electronic device, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by making it easier for the user to identify which electronic device is represented by which indication), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently, and reduces user errors of sharing content with the wrong electronic device in response to detecting selection of the first sharing option.
[0289] In some embodiments, such as Figure 6J , the one or more shared criteria associated with the third electronic device 610 d include a criterion that is satisfied when the second orientation is oriented toward the third electronic device 610 d (750). Optionally, a top edge of the first electronic device or some other predetermined portion of the first electronic device is pointed in the direction of the third electronic device and is within a threshold angular range (e.g., + / - 10 degrees, 20 degrees, etc.) of the third electronic device.
[0290] In some embodiments, such as Figure 6JIn the embodiment of the present invention, in response to detecting a change in the orientation of the first electronic device 500 (752), in response to determining that the second orientation is oriented toward the third electronic device 610d and before the one or more shared criteria associated with the third electronic device 610d are met, the first electronic device 500 generates (754) an indication at the first electronic device 500 indicating that the second orientation is oriented toward the third electronic device. Optionally, the representation of the third electronic device is presented with visual characteristics that are different from the visual characteristics of the representation of the third electronic device before the first electronic device detects that the second orientation is oriented toward the third electronic device (for example, the dot representing the third electronic device changes from a small black dot to a large blue dot). The indication is optionally an audio or tactile output. For example, the first electronic device presents multiple dots representing multiple electronic devices within a threshold distance of the first electronic device, and when the first electronic device detects the second orientation oriented toward the third electronic device, the dot representing the third electronic device changes color and / or changes size, and / or the first electronic device generates an audio or tactile output indicating that the second orientation corresponding to the third electronic device has been reached.
[0291] The above-mentioned manner of presenting an indication of the second orientation toward the third electronic device allows the first electronic device to notify the user that the first sharing option is about to change from being selectable to share content with the second electronic device to being selectable to share content with the third electronic device, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by enabling the user to move the first electronic device to prevent the first sharing option from changing, rather than having to reposition the first electronic device toward the second electronic device to reconfigure the first sharing option to be selectable to share content with the second electronic device, and reducing errors of unintentional sharing with a third device), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0292] In some embodiments, such as Figure 6JIn the embodiment, in response to detecting a change in the orientation of the first electronic device 500 (756), based on determining that the second orientation satisfies the one or more sharing criteria associated with the third electronic device 610d (e.g., when the top edge of the first electronic device or another predetermined position of the first electronic device is pointed at the third electronic device and is within a threshold angle range (e.g., + / - 10 or 20 degrees), the first electronic device 500 generates (758) an indication (e.g., an audio or tactile output) at the first electronic device 500 that the content sharing option 616a displayed at the first position in the sharing user interface can be selected to initiate a process of sharing content with the third electronic device 610d without initiating a process of sharing content with the second electronic device 610c. Optionally, the electronic device generates the indication in response to updating the first sharing option to be selectable to share content with the third electronic device instead of the second electronic device. In some embodiments, the electronic device updates the first sharing option in response to detecting that the first electronic device has been in the second orientation for a predetermined amount of time (e.g., 2 seconds, 3 seconds, 5 seconds, etc.). For example, the first electronic device generates an indication when the first electronic device initially reaches the second orientation and generates another indication when the first electronic device has been in the second orientation for a predetermined amount of time such that the first sharing option is updated.
[0293] The above-mentioned manner of generating an indication in response to updating the first sharing option allows the first electronic device to notify the user that the first sharing option has been updated to be selectable to share content with a third electronic device instead of the second electronic device, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by preventing user errors from sharing content with a third electronic device when the user intended to share content with the second electronic device), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0294] In some embodiments, such as Figure 6H In the embodiment of the present invention, when the second orientation is oriented toward the third electronic device 610d for a time longer than the time threshold 624d (e.g., 2 seconds, 3 seconds, 5 seconds) (e.g., when the third electronic device is within a predefined angular range of a predetermined axis of the electronic device), the second orientation satisfies the one or more sharing criteria associated with the third electronic device 610d (760). For example, if the first electronic device is in the second orientation for a time less than the time threshold before moving to a different orientation not associated with the third electronic device, the first selectable option remains selectable to initiate the process of sharing content with the second electronic device.
[0295] The above-mentioned manner of updating the first sharing option in response to detecting that the first electronic device is in the second orientation for a threshold amount of time allows the first electronic device to abandon updating the first sharing option if the electronic device is in the second orientation for a time less than the threshold amount of time, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by reducing user errors of accidentally changing the first sharing option to be able to select to share content with a third electronic device instead of the second electronic device), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0296] In some embodiments, such as Figure 6N , when the sharing user interface is displayed via the display device 504 , the first electronic device 500 receives ( 762 ) a selection of the content sharing option 616 a (eg, the first content sharing option) via the one or more input devices.
[0297] In some embodiments, such as Figure 6O In response to receiving input selecting content sharing option 616a (764), first electronic device 500 shares content with second electronic device 610b based on determining that content sharing option 616a can be selected to initiate a process of sharing content with second electronic device 610b (766). Optionally, the first electronic device initiates a process of sharing content with the second electronic device via a wireless network sharing protocol while maintaining display of a sharing user interface without displaying another user interface.
[0298] In some embodiments, in response to receiving input selecting a content sharing option (764), the first electronic device 500 shares the content with the third electronic device (768) based on determining that the content sharing option can be selected to initiate a process of sharing content with the third electronic device. For example, if the electronic device 500 displays Figure 6JIn some embodiments, when the user interface shown in the figure detects the selection of option 616a, the first electronic device 500 will initiate the process of sharing content with the electronic device 610d. Optionally, the first electronic device initiates the process of sharing content with the third electronic device via the wireless network sharing protocol. For example, the selection of the first content sharing option causes the first electronic device to initiate the process of sharing content with another electronic device that is currently associated with the first sharing option. In some embodiments, the selection of a sharing method other than the first sharing option in the sharing user interface initiates the process of sharing content with another electronic device using a different sharing method (e.g., a text message or email, rather than via a wireless network sharing protocol), which optionally causes the first electronic device to stop displaying the sharing user interface and instead display another user interface associated with the other sharing method (e.g., a text messaging user interface, an email user interface, etc.).
[0299] The above-described manner of sharing content with a second electronic device or a third electronic device based on which electronic device the selected sharing option is associated with allows the first electronic device to provide selectable options for sharing content with each of the second electronic device and the third electronic device, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, reducing user errors of sharing content with the wrong other device by providing options for sharing with each other electronic device within a threshold distance), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0300] In some embodiments, such as Figure 6L In the embodiment of the present invention, a content sharing option 616a is displayed (e.g., displayed within, adjacent to, surrounding, etc., the first content sharing option) along with one or more visual indications 620b, 620c, and 620d of one or more other electronic devices 610b, 610c, and 610d, including a second electronic device and a third electronic device, that are within a threshold distance (e.g., 6 feet, 10 feet, 20 feet, or a distance defined by the range of a wireless communication protocol between the first electronic device and the other devices) of the first electronic device 500 (770). Optionally, the content sharing option is presented as a ring with a dot surrounding the content sharing option that indicates each of the other electronic devices.
[0301] In some embodiments, such as Figure 6OIn response to receiving input selecting the content sharing option 616a, the first electronic device 500 replaces (772) one or more visual indications 620b, 620c, and 620d of one or more other electronic devices 610b, 610c, and 610d with a visual indication 626 of the progress of sharing the content. Optionally, the first electronic device stops displaying the one or more visual indications of the other electronic devices (e.g., an arrangement of dots each representing another electronic device) and presents an indication of the progress of sharing the content in the user interface in the location where the one or more visual indications of the other electronic devices are presented. For example, the electronic device presents a progress ring around the sharing option that gradually fills up around the sharing option as more and more content is shared with the other electronic device.
[0302] The above-mentioned manner of replacing the visual indication of the one or more other electronic devices with a visual indication of the content sharing progress allows the first electronic device to use an area of the user interface to display indications to the other electronic devices when the user selects an electronic device with which to share content, and to display the content sharing progress while the first electronic device is in the process of sharing content, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by saving display area so that the user can view the rest of the user interface with reduced scrolling or panning), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0303] In some embodiments, such as Figure 6MIn some embodiments, the plurality of selectable content sharing options for sharing content with other devices also includes a second content sharing option 616b, and the second content sharing option 616b does not change according to the orientation of the first electronic device 500 (774). In some embodiments, the second content sharing option is one of an option for sharing content with a specific user account using a specific sharing method (e.g., an application for sharing, such as text messaging, enhanced data-based messaging, email, etc.) or an option for initiating a process of sharing content using a specific sharing method. For example, the sharing user interface includes a first sharing option, an option for sharing content with a specific contact via text messaging, an option for sharing content with a specific contact via email, an option for initiating a process of sharing content via email, an option for initiating a process of sharing content via text messaging, and an option for sharing content with social media. In this example, the option for sharing content with a specific contact via text messaging, the option for sharing content with a specific contact via email, the option for initiating a process of sharing content via email, the option for initiating a process of sharing content via text messaging, and the option for sharing content with social media do not change with a change in the orientation of the electronic device.
[0304] The above-mentioned manner of presenting a second sharing option that does not change according to the orientation of the first electronic device allows the first electronic device to continue to present the second sharing option even if the orientation of the first electronic device changes in a manner that causes the first sharing option to change, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by reducing the number of sharing options that need to be updated by the first electronic device), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0305] In some embodiments, a sharing user interface (776) such as that in FIG. 6C is displayed in response to selection (e.g., using contact 603) of a selectable sharing option 604 displayed in a corresponding application on the first electronic device 500, such as in Figure 6B Optionally, the corresponding application is an application for viewing and / or editing content. For example, the photo application includes an optional option for sharing a photo currently being presented in the photo application, and selection of the option causes the first electronic device to display a sharing user interface for sharing the photo.
[0306] The above-described manner of presenting a sharing user interface in response to selection of an optional sharing option allows the first electronic device to forgo powering on the shared circuitry of the first electronic device before detecting selection of the optional sharing option, which reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0307] In some embodiments, such as Figure 6C In some embodiments, the first content sharing option 616a is associated with a first sharing protocol and a corresponding other electronic device 610c, and the sharing user interface also includes a second content sharing option 618 (778) associated with the sharing protocol but not associated with the corresponding other electronic device 610c. In some embodiments, the first sharing option and the second sharing option are associated with a wireless network sharing protocol, wherein the first sharing option is associated with a specific other electronic device and can be selected to share content with the other electronic device, but the second sharing option is not associated with any specific other electronic device and can be selected not to share content, but instead to display another user interface associated with the wireless network sharing protocol, through which the user can share content with one or more other electronic devices / contacts.
[0308] In some embodiments, such as Figure 6S , when the sharing user interface is displayed via the display device 504 , the first electronic device 500 receives ( 780 ) (eg, using contact 603 ) a selection of the second content sharing option 618 a via the one or more input devices.
[0309] In some embodiments, such as Figure 6T In response to receiving input (782) selecting the second content sharing option 618a, the electronic device 500 displays (784) via the display device 504 an enlarged sharing user interface (e.g., a wireless network sharing protocol user interface) associated with the sharing protocol, the enlarged sharing user interface including a corresponding content sharing option 634 (e.g., a selectable option that, if selected, causes the first electronic device to share content using the sharing protocol with a corresponding other electronic device selected based on the orientation of the first electronic device), the corresponding content sharing option being selectable to share content using the sharing protocol with another electronic device 610b based on the orientation of the first electronic device 500 (786). In some embodiments, the other electronic device with which the option is initially associated is selected based on criteria other than the orientation of the electronic device, such as the frequency with which the first electronic device shares content with the other electronic device, the type of content being shared, the most recent time the first electronic device shared content with the other electronic device, the number of times the first electronic device shared content with the other electronic device, etc.
[0310] In some embodiments, in response to receiving input (782) selecting the second content sharing option 618a, the electronic device 500 displays (784) via the display device 504 an enlarged sharing user interface associated with the sharing protocol (e.g., a wireless network sharing protocol user interface), the enlarged sharing user interface including multiple visual representations 636a, 636c, 636d, 636t, and 636m of multiple electronic devices, including a visual representation of the second electronic device and a visual representation of a third electronic device, the multiple electronic devices being within a threshold distance of the first electronic device 500 and available for sharing using the sharing protocol (788). Optionally, the visual representations are images (rather than dots) representing the other electronic devices (e.g., images associated with contact cards associated with the other electronic devices) positioned around the corresponding content sharing option based on the position of each other electronic device relative to the first electronic device. For example, if the second electronic device is to the left of the first electronic device and the third electronic device is to the right of the first electronic device, the user interface includes an image representing the second electronic device to the left of the corresponding sharing option and an image representing the third electronic device to the right of the corresponding sharing option. In some embodiments, the enlarged sharing user interface associated with the sharing protocol also includes multiple selectable options for sharing content with corresponding other electronic devices using the wireless network sharing protocol.
[0311] The above-described manner of presenting an enlarged sharing user interface associated with a sharing agreement allows the first electronic device to present representations of other electronic devices with more information and detail than would fit in the sharing user interface, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by providing the user with more information about other electronic devices to enable the user to quickly select the desired other electronic device with which to share content), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0312] In some embodiments, such as Figure 6L, prior to receiving a selection of the second content sharing option 618a, the first content sharing option 616a is displayed in the sharing user interface along with one or more visual indications 620 of electronic devices 610 within a threshold distance of the first electronic device 500, rather than images representing the electronic devices (e.g., a dot representing each other electronic device), wherein the one or more visual indications 620 are positioned relative to the first content sharing option 616a based on the position of the electronic device 610 relative to the first electronic device 500 (790). Optionally, the dots are positioned in a ring around the first content sharing option at an angle representing the angular position of each other electronic device relative to the first electronic device.
[0313] In some embodiments, such as Figure 6T , after receiving a selection of the second content sharing option 618a, a corresponding content sharing option 634 is displayed in the enlarged sharing user interface (792) along with one or more images 636 representing electronic devices 610 within the threshold distance of the first electronic device 500. Optionally, the images are images associated with a contact card associated with each of the other electronic devices.
[0314] In some embodiments, such as Figure 6T , one or more images 636 are positioned relative to the corresponding content sharing options 634 based on the position of the electronic device 610 relative to the first electronic device 500 (794). Optionally, these images are positioned in a ring around the corresponding content sharing options at an angle that represents the angular position of each other electronic device relative to the first electronic device. For example, before detecting the selection of the second content sharing option, the electronic device presents the indications of the other electronic devices as dots around the first selectable sharing option, and in response to detecting the selection of the second sharing option, the electronic device presents the indications of the other electronic devices as images around the corresponding sharing options. The corresponding sharing options and images are optionally presented at a larger size than the first sharing option and dots.
[0315] The above-described manner of presenting indications of other electronic devices as being positioned around the corresponding sharing options at locations indicating the location of each other electronic device relative to the first electronic device allows the first electronic device to present visual indications of each other electronic device with more information about each other electronic device (e.g., recognizable photos rather than some other indications, such as dots), which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (e.g., by enabling the user to more quickly identify which other electronic device each indication represents), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0316] In some embodiments, such as Figure 6TIn some embodiments, the user interface includes a portion labeled "My Devices" that includes a selectable option that, when selected, causes the first electronic device to share content with a corresponding electronic device that is associated with the user account associated with the first electronic device and is within a threshold distance (e.g., a distance at which the sharing protocol is available) of the first electronic device. The electronic devices in the "My Devices" portion are optionally devices that have been configured with the user account of the user of the first electronic device. In some embodiments, the user interface includes a portion labeled "Contacts" or "People I Know" that includes a selectable option that, when selected, causes the first electronic device to share content with a corresponding electronic device associated with a user account included in a contact card stored on the first electronic device, the corresponding electronic device being within a threshold distance of the first electronic device (e.g., a distance at which a sharing protocol is available) and being a device that is not configured with a user account of the first electronic device. In some embodiments, the user interface includes a portion labeled "Other Devices Nearby" that includes a selectable option that, when selected, causes the first electronic device to share content with a corresponding electronic device that is within a threshold distance of the first electronic device (e.g., a distance at which a sharing protocol is available) and is not associated with a user account of the first electronic device or a user account included in a contact card stored on the first electronic device. The corresponding sharing options are optionally presented in an area of the user interface that is not the first area, the second area, or the third area. In some embodiments, the selectable options presented in the first area, the second area, and the third area do not change with a change in the orientation of the first electronic device, and a change in the orientation of the first electronic device causes the corresponding content sharing options to change. In some embodiments, electronic devices in the “People I Know” section are displayed as dots surrounding the first content sharing option in the sharing user interface, but devices in the “My Devices” section and the “Other Nearby Devices” section are not displayed around the first content sharing option in the sharing user interface.
[0317] The above-mentioned manner of presenting selectable options for sharing content using a sharing protocol with electronic devices belonging to a user of the first electronic device, electronic devices belonging to contacts of the first electronic device, and electronic devices that are not users of the first electronic device or are not contacts of the first electronic device in different areas of the user interface allows the first electronic device to enable the user to more quickly find the desired electronic device with which to share content, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by reducing the amount of time the user spends locating and selecting the desired sharing option), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0318] In some embodiments, such as Figure 6Q In the embodiment, the plurality of content sharing options includes a second content sharing option 616d associated with the corresponding user, and the second content sharing option can be selected to initiate the process of sharing content with the corresponding user regardless of the orientation of the first electronic device 500 (798). Optionally, the second selectable sharing option continues to be presented and can continue to be selected to share content with the corresponding user regardless of the orientation of the first electronic device. In some embodiments, the second sharing option is associated with a corresponding method of sharing content. For example, the second sharing option is an option for sharing content with a contact via one of email, text message, enhanced data-based messaging, social media, etc.
[0319] The above-mentioned manner of presenting the second sharing option for sharing content with the corresponding user regardless of the orientation of the first electronic device allows the first electronic device to continue to present the second option even if the orientation of the first electronic device changes, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by enabling the user to select the second option for sharing content with the corresponding user even if the position of the first electronic device has changed without moving the first electronic device or entering another input to configure the second sharing option to be selectable for sharing with the corresponding user), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0320] In some embodiments, such as Figure 6QIn some embodiments, the first content sharing option 616a can be selected to initiate sharing using a corresponding sharing protocol (e.g., a short-range wireless sharing protocol), the first content sharing option 616a is displayed in an area of the sharing user interface along with a remaining portion consisting of a plurality of content sharing options 616b-616d associated with other users (e.g., each of the plurality of content sharing options is associated with one other user and a method of sharing content), and the remaining portion consisting of the plurality of content sharing options 616b-616d can be selected to initiate sharing with the other users using one or more sharing protocols other than the corresponding sharing protocol (798-2). In some embodiments, the area of the sharing user interface includes the first sharing option and a plurality of sharing options that can be selected to share content with the corresponding users using a corresponding method of sharing content (e.g., email, text message, enhanced data-based messaging, social media, etc.). In some embodiments, sharing occurs in response to selection of the first content sharing option while the sharing user interface remains displayed, whereas sharing with the other sharing options occurs outside of the sharing user interface in response to selection of the other content sharing options and causes the first electronic device to cease displaying the sharing user interface.
[0321] The above-described manner of presenting multiple content sharing options, each of which can be selected to share content with another user using a sharing protocol other than the corresponding sharing protocol associated with the first sharing option, allows the first electronic device to present multiple sharing options that do not change in response to the first electronic device detecting a change in the orientation of the first electronic device, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by enabling the user to select other options regardless of the position of the first electronic device), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0322] In some embodiments, such as Figure 6Q , the remainder of the plurality of content sharing options includes (798-4) a first respective content sharing option 616b associated with the first respective user and the first respective sharing agreement, wherein the first respective content sharing option is displayed along with a visual indication of the first respective sharing agreement (798-6). Optionally, the first respective content sharing option is an icon that includes an image representing the first respective user (e.g., an image included in the first respective user's contact card), wherein the icon representing the first respective sharing agreement is overlaid on the image representing the first respective user.
[0323] In some embodiments, such as Figure 6Q, the remainder of the plurality of content sharing options include (798-4) a second corresponding content sharing option 616c associated with the second corresponding user and the second corresponding sharing agreement, wherein the second corresponding content sharing option is displayed together with a visual indication of the second corresponding sharing agreement (798-8). In some embodiments, the second corresponding content sharing option is an icon including an image representing the second corresponding user (e.g., an image included in the second corresponding user's contact card), wherein the icon representing the second corresponding sharing agreement is overlaid on the image representing the second corresponding user. The first corresponding sharing agreement and the second corresponding sharing agreement are optionally each one of an email, a text message, an enhanced data-based message, or social media. For example, the first corresponding content sharing option can be selected to initiate a process of sharing content with the first user via a text message, and the second corresponding content sharing option can be selected to initiate a process of sharing content with the second user via an email.
[0324] The above-described manner of presenting corresponding sharing options associated with a specific user and a specific sharing protocol with a visual indication of the sharing protocol allows the first electronic device to enable the user to avoid mistakenly selecting an incorrect sharing protocol, which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0325] In some embodiments, such as Figure 6C In the embodiment of the present invention, before detecting a change in the orientation of the first electronic device 500 (798-10), based on determining that one or more first criteria are met, regardless of the orientation of the first electronic device 500, a first content sharing option 616a in the sharing user interface can be selected to initiate a process of sharing content with the first suggested electronic device 610c (798-12). Optionally, the first criteria are based on the number of times the first electronic device has shared content with the first suggested electronic device, the most recent time the first electronic device shared content with the first suggested electronic device, the type of content being shared, the current date and time, the current location, etc.
[0326] In some embodiments, such as Figure 6MIn some embodiments, before a change in the orientation of the first electronic device 500 is detected (798-10), based on determining that one or more second criteria are met, regardless of the orientation of the first electronic device 500, the first content sharing option 616a in the sharing user interface can be selected to initiate the process of sharing content with the second suggested electronic device 610b (798-14). In some embodiments, the second criteria are based on the number of times the first electronic device has shared content with the second suggested electronic device, the most recent time the first electronic device has shared content with the second suggested electronic device, the type of content being shared, the current date and time, the current location, etc. Therefore, in some embodiments, before the first electronic device changes its orientation after displaying the sharing user interface, the first sharing option can be selected by default to initiate the process of sharing content with the suggested other electronic devices, not based on the current orientation of the first electronic device, but by default based on other criteria associated with the suggested electronic device.
[0327] The manner of selecting the corresponding suggested electronic device based on the first criterion or the second criterion allows the first electronic device to initially configure the first sharing option to be selectable to share content with the suggested electronic device with which the user is most likely to want to share content, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by reducing the number of inputs required to share content with the corresponding suggested electronic device with which the first sharing option is initially configured to enable the first electronic device to share content), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0328] In some embodiments, such as Figure 6KIn response to detecting a change in the orientation of the first electronic device 500 (798-16), based on determining that the second orientation satisfies one or more sharing criteria associated with the first corresponding electronic device 610a and the second corresponding electronic device 610b (e.g., the first corresponding electronic device and the second corresponding electronic device are positioned proximate to each other such that the orientation of the first electronic device corresponds to both the first corresponding electronic device and the second corresponding electronic device) (798-18), based on determining that one or more first criteria are satisfied, regardless of the orientation of the first electronic device 500, a first content sharing option 616a in the sharing user interface can be selected to initiate a process of sharing content with the first corresponding electronic device 610a (798-20). Optionally, the first criteria is based on the number of times the first electronic device has shared content with the first corresponding electronic device, the most recent time the first electronic device shared content with the first corresponding electronic device, the type of content being shared, the current date and time, the current location, etc. For example, if the first electronic device has shared content with the first corresponding electronic device more times than the first electronic device has shared content with the second corresponding electronic device, the first sharing option can be selected to share content with the first corresponding electronic device instead of the second corresponding electronic device.
[0329] In some embodiments, such as Figure 6K In response to detecting a change in the orientation of the first electronic device 500 (798-16), based on determining that the second orientation satisfies one or more sharing criteria associated with the first corresponding electronic device 610a and the second corresponding electronic device 610b (for example, the first corresponding electronic device and the second corresponding electronic device are positioned close to each other such that the orientation of the first electronic device corresponds to both the first corresponding electronic device and the second corresponding electronic device) (798-18), based on determining that the one or more second criteria are satisfied, regardless of the orientation of the first electronic device, a first content sharing option in a sharing user interface can be selected to initiate a process of sharing content with the second corresponding electronic device (798-22), such as, Figure 6KIn the case where the first sharing option 616a is configured to be used for sharing with electronic device 610b instead of electronic device 610a. Optionally, the second criterion is based on the number of times the first electronic device has shared content with the second corresponding electronic device, the most recent time the first electronic device shared content with the second corresponding electronic device, the type of content being shared, the current date and time, the current location, etc. The first criterion and the second criterion are optionally used to determine which of the first corresponding electronic device and the second corresponding electronic device the user is most likely to want to share content with when the orientation of the first electronic device may correspond to either the first corresponding electronic device or the second corresponding electronic device. For example, if the first electronic device has shared content with the second corresponding electronic device more times than the first electronic device has shared content with the first corresponding electronic device, the first sharing option will be selected to share content with the second corresponding electronic device instead of the first corresponding electronic device. In some embodiments, if the first electronic device is oriented within 20 degrees of the corresponding electronic device and there is another electronic device positioned within this angle range, the first criterion and the second criterion are used to determine which electronic device the first sharing option should be associated with.
[0330] The above-mentioned manner of using the first criterion and the second criterion to select which of the first corresponding electronic device and the second corresponding electronic device allows the first electronic device to associate the first sharing option with the corresponding electronic device with which the user is most likely to want to share content, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by reducing the number of inputs required to share content with the electronic device with which the user is more likely to want to share content), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0331] In some embodiments, such as Figure 6K , when the first electronic device 500 is in the second orientation, satisfies the one or more first criteria, and is able to select the first content sharing option 616a in the sharing user interface to initiate a process of sharing content with the first corresponding electronic device 610a, the first electronic device 500 detects (798-24) that the position of the first electronic device 500 has changed from Figure 6K The first position shown to Figure 6M A change in the second position shown (eg, detecting movement of the electronic device to a different position and / or a different orientation).
[0332] In some embodiments, in response to detecting that the location of the first electronic device 500 is Figure 6K The first position in Figure 6M, based on determining that the second position (e.g., the current position and / or orientation of the first electronic device) meets one or more sharing criteria associated with the second corresponding electronic device 610b (e.g., the second position is associated with the second corresponding electronic device and not associated with the first corresponding electronic device), the first content sharing option 616a can be selected to initiate the process of sharing content with the second corresponding electronic device 610b (798-28). Optionally, the first electronic device moves closer to the first corresponding electronic device and the second corresponding electronic device so that the position range associated with the first corresponding electronic device and the position range associated with the second corresponding electronic device do not overlap (e.g., the orientation of the first electronic device is within a predetermined angular range, such as 10 degrees or 20 degrees), and the first electronic device is positioned within the position range associated with the second corresponding electronic device. In some embodiments, if the second position does not meet the criteria associated with the second corresponding electronic device, the first sharing option remains selectable to share content with the first corresponding electronic device. In some embodiments, if the second position meets the criteria associated with a third corresponding electronic device instead of the first corresponding electronic device, the first sharing option is updated to be associated with the third corresponding electronic device.
[0333] The above-mentioned manner of updating the first content sharing option to be selectable to initiate the process of sharing content with the second corresponding electronic device in response to detecting that the second position satisfies one or more sharing criteria associated with the second corresponding electronic device allows the first electronic device to provide the user with a manner of selecting a device other than the device selected by the first electronic device based on non-orientation-based criteria for sharing using the first sharing option, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by enabling the user to select the second corresponding electronic device by moving the first electronic device to the second position instead of having to navigate the user interface to select the second corresponding electronic device), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0334] It should be understood that Figures 7A to 7J The specific order in which the operations are described in the foregoing is merely exemplary and is not intended to indicate that the order is the only order in which the operations may be performed. A person of ordinary skill in the art will recognize various ways to reorder the operations described herein. In addition, it should be noted that the details of other processes described herein with respect to other methods described herein (e.g., methods 701, 900, and 1100) also apply in a similar manner to the details of the processes described above with respect to Figures 7A to 7JMethod 700. For example, the method for updating sharing options based on the orientation of the electronic device relative to other electronic devices described above with reference to method 700 optionally has one or more of the characteristics of the following methods described herein with reference to other methods described herein (e.g., methods 701, 900, and 1100): presenting an indication of changing the orientation of the electronic device, presenting a sharing user interface within an action user interface of an application running on the electronic device, presenting an option for modifying one or more settings for the content item before sharing the content item, etc. For the sake of brevity, these details are not repeated here.
[0335] The operations in the above information processing method are optionally implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (for example, as shown in FIG. 1A to FIG. Figure 1B 、 Figure 3 、 Figures 5A to 5H In addition, the above reference Figures 7A to 7J The described operations are optionally performed by Figure 1A to Figure 1B . For example, display operations 702, 720, and 722, receiving operations 762, 780, and generating operations 754 and 758 are optionally implemented by event classifier 170, event recognizer 180, and event handler 190. Event monitor 171 in event classifier 170 detects contact on touch screen 504, and event distributor module 174 transmits the event information to application 136-1. The corresponding event recognizer 180 of application 136-1 compares the event information with the corresponding event definition 186 and determines whether the first contact at a first location on the touch screen corresponds to a predefined event or sub-event, such as the selection of an object on the user interface. When a corresponding predefined event or sub-event is detected, event recognizer 180 activates the event handler 190 associated with the detection of the event or sub-event. Event handler 190 optionally utilizes or calls data updater 176 or object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly know how to update the content displayed by the application based on the GUI updater 178. Figure 1A to Figure 1B The components depicted in the figure implement other processes.
[0336] Figures 7K to 7P7 is a flowchart illustrating a method 701 for presenting an indication to change the orientation of an electronic device when the orientation of the electronic device is outside an orientation range within which circuitry of another electronic device that identifies the electronic device to share content with can function with desired reliability according to some embodiments of the present disclosure. Method 701 is optionally performed on an electronic device (such as device 100, device 300, device 500), as described above with reference to Figure 1A to Figure 1B 、 Figure 2 To Figure 3, Figures 4A to 4B and Figures 5A to 5H Some operations in method 701 are optionally combined, and / or the order of some operations is optionally changed.
[0337] In some embodiments, such as Figure 6TIn some embodiments, when the current orientation of the first electronic device is within a first (e.g., predefined) orientation range relative to a reference orientation 640a (e.g., a reference plane such as the ground; or a plane intersecting the first electronic device and a corresponding electronic device with which the first electronic device can share content; or a reference vector such as gravity or the gravitational pull of a larger object such as the earth), the first electronic device 500 (e.g., a mobile device including a touch screen (e.g., a tablet, smart phone, media player, or wearable device) or a computer including one or more of a keyboard, a mouse, a trackpad, and a display / touch screen) in communication with a display device and one or more input devices displays (703) via the display device a sharing user interface for sharing content with other electronic devices, the sharing user interface including corresponding representations 634 of different electronic devices 610b that can be used to share content with the first electronic device. In some embodiments, the reference orientation is a plane perpendicular to gravity, and the first electronic device includes an accelerometer or other sensor capable of sensing gravity, which enables the first electronic device to determine its orientation relative to gravity. In some embodiments, a reference orientation is defined relative to corresponding other electronic devices with which the first electronic device can share content (such as a plane intersecting the first electronic device and the corresponding other electronic devices or a plane defined in some other way relative to the corresponding other electronic devices). Optionally, the corresponding orientation of the first electronic device relative to the reference orientation is the angle between a predetermined axis of the electronic device and the reference plane. The sharing user interface is optionally also used to share content with user accounts other than the user account associated with the first electronic device (e.g., an email address, a phone number, a social media account, etc.). In some embodiments, the sharing user interface includes multiple selectable options that, when selected, cause the first electronic device to share content in a corresponding manner. Representations of different electronic devices that can be used to share content with the first electronic device are optionally selectable options that, when selected, cause the first electronic device to share content with different electronic devices. In some embodiments, the predetermined axis of the electronic device is an axis parallel to an edge of the electronic device (such as a vertical edge or a horizontal edge of the first electronic device). For example, the sharing user interface enables a user to share content via email, text messaging, enhanced data-based messaging, and social media, such as the sharing user interface described with reference to method 700. In some embodiments, the first electronic device includes one or more orientation sensors (e.g., accelerometers, etc.) for determining its orientation.
[0338] In some embodiments, such as Figures 6T to 6U, when displaying a sharing user interface, the first electronic device 500 detects (705) a change in the orientation θ of the first electronic device from a first orientation to a second orientation. In some embodiments, changing the orientation of the first electronic device from the first orientation to the second orientation includes one or more of the following: changing the orientation of the first electronic device relative to a reference orientation (e.g., tilting the electronic device vertically), and changing the orientation of the electronic device relative to an axis perpendicular to the reference orientation or parallel to gravity (e.g., rotating the electronic device horizontally). For example, the user rotates the first electronic device horizontally, such as to point a predetermined edge (e.g., the top edge) of the first electronic device toward a corresponding other electronic device with which the user wishes to share content from the first electronic device. Reference method 700 describes such an orientation-based determination of a target sharing device.
[0339] In some embodiments, such as Figures 6II to 6JJIn response to detecting a change in the orientation of the first electronic device 500 (707), based on determining that the second orientation θ of the first electronic device is within a first predetermined range of orientations (e.g., a predetermined axis of the electronic device (e.g., a vertical axis) is 15 degrees to 255 degrees relative to a reference plane), the first electronic device 500 updates (709) corresponding representations 616a of different devices 610a that can be used to share content with the first electronic device based on the direction the first electronic device is pointing. In some embodiments, the sharing target device is selected using an orientation sensor that determines the direction in which a predetermined surface of the electronic device is oriented. Optionally, the sensor determines a vector perpendicular to the rear surface of the first electronic device and determines which other electronic device the vector is pointing to. For example, if the first electronic device is oriented at an angle within the range of 15 degrees to 255 degrees relative to a reference plane perpendicular to gravity and the top edge of the first electronic device faces the second electronic device, the second electronic device is selected as the sharing target device, and if the top edge of the first electronic device faces the third electronic device, the third electronic device is selected as the sharing target device. Optionally, in response to determining which electronic device is the sharing target device, the first electronic device displays an indication of the sharing target device, such as updating the selectable options for sharing content to include a representation of a user account associated with the sharing target device. In some embodiments, the first electronic device includes a circuit (e.g., a sensor) that detects the orientation and / or position of the first electronic device relative to other electronic devices within a threshold distance (e.g., 20 feet, 30 feet, 50 feet) of the first electronic device. Optionally, the first predetermined orientation range is an orientation range in which the sensor can function with a predetermined level of reliability. For example, if the sensor can function with a predetermined level of reliability when the first electronic device is positioned at an orientation within a range of 15 degrees to 255 degrees relative to a reference plane perpendicular to gravity, the first predetermined orientation range is 15 degrees to 255 degrees relative to the reference plane perpendicular to gravity. In this example, when the first electronic device is oriented at 15 degrees to 255 degrees relative to a reference plane perpendicular to gravity, the first electronic device updates the sharing target device based on which of the other electronic devices the first electronic device is pointing to. Such updating of a shared target based on which of the other electronic devices the first electronic device is pointed to is described with reference to method 700 .
[0340] In some embodiments, such as Figures 6U to 6VIn some embodiments, in response to detecting a change in the orientation θ of the first electronic device (707), based on determining that the second orientation of the first electronic device is within a second predetermined orientation range outside the first predetermined orientation range (e.g., the first electronic device is approximately parallel to the reference plane (e.g., at an angle of less than + / - 1 degree, 3 degrees, 5 degrees, 10 degrees, 15 degrees relative to the reference plane)), the first electronic device abandons (711) updating the corresponding representations 634 of different devices 610a that can be used to share content with the first electronic device based on the direction the first electronic device is pointing. In some embodiments, in response to detecting that the corresponding orientation of the first electronic device relative to the reference plane is outside the first predetermined orientation range, the first electronic device stops displaying an indication of the sharing target device and displays an indication to change the orientation of the electronic device. For example, in response to detecting that the orientation of the first electronic device changes from within the first predetermined orientation range relative to the reference plane to outside the first predetermined orientation range, the first electronic device stops displaying the selectable sharing option including the indication of the sharing target device, and instead displays an indication to tilt the first electronic device at the location where the selectable sharing option was displayed. In some embodiments, when the first electronic device is in a first orientation outside the first predetermined range of orientations (e.g., approximately parallel to a reference plane or an orientation less than + / - 1 degree, 3 degrees, or 5 degrees relative to the reference plane), the indication of the sharing target device or the optional sharing option is stopped from being displayed. Optionally, when the first electronic device is in a second orientation outside the first predetermined range of orientations (e.g., less than 15 degrees relative to a reference plane perpendicular to gravity, but greater than approximately parallel to the reference plane or greater than + / - 1 degree, 3 degrees, or 5 degrees relative to the reference plane), the indication of the sharing target device or the optional sharing option continues to be displayed. In some embodiments, as will be described in more detail below, when the first electronic device is in the second orientation outside the first predetermined range of orientations, the indication of the sharing target device or the optional sharing option is displayed to have visual characteristics that are different from the visual characteristics of the indication or option when the first electronic device is oriented within the first predetermined range of orientations. For example, the indication of the sharing target device or the optional sharing option is displayed in a distorted or tilted manner to give a tilted appearance (e.g., to encourage the user to tilt the first electronic device to an orientation within the first predetermined range of orientations).
[0341] The above-mentioned manner of updating the representations of different devices based on the direction in which the first electronic device is pointing in response to determining that the orientation of the first electronic device is within a first predetermined orientation range, and abandoning updating the representations in response to determining that the orientation of the first electronic device is within a second orientation range outside the first predetermined orientation range, reduces errors in determining shared targets when the circuit for determining shared targets based on the orientation of the first electronic device operates more reliably within a subset of device orientations (for example, within the first predetermined orientation range), which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by prompting the user to position the first electronic device in a manner that will enable the first electronic device to reliably and therefore predictably and efficiently determine the shared target device), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0342] In some embodiments, such as Figure 6T In some embodiments, the corresponding representation of the different electronic device is a selectable option that, when selected, causes the first electronic device to share content with the different electronic device, such as via a wireless sharing protocol. The corresponding representation is optionally displayed simultaneously with multiple selectable options that, when selected, initiate a corresponding process of sharing content with another user account or electronic device via different corresponding sharing protocols (e.g., email, text message, social media, etc.).
[0343] In some embodiments, such as Figure 6UIn some embodiments, in response to detecting a change in the orientation θ of the first electronic device 500, based on determining that the second orientation of the first electronic device is outside the first predetermined orientation range (e.g., within the second predetermined orientation range or outside the first predetermined orientation range and the second predetermined orientation range), the first electronic device 500 displays (715) a visual indication 634 of changing the orientation of the first electronic device at a first position in the shared user interface (e.g., the visual indication of changing the orientation of the first electronic device replaces a corresponding representation of a different electronic device, or the corresponding representation of the different electronic device is modified to indicate to the user that the first electronic device is tilted). In some embodiments, the visual indication of changing the orientation of the first electronic device includes text, such as "Tilt device" or "Tilt phone". Optionally, the indication of tilting the first electronic device is a corresponding representation of the different electronic device that is displayed in a manner different from the manner in which the corresponding representation is displayed when the first electronic device is within the first orientation range.
[0344] The above-mentioned manner of changing the corresponding representation with an indication of changing the orientation of the first electronic device based on determining that the orientation of the first electronic device is outside a first predetermined orientation range prompts the user to reposition the first electronic device in an orientation in which the circuits of the device used to determine the orientation of the first electronic device can reliably function, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by instructing the user to reposition the first electronic device in order to accurately and effectively use features of the circuits of other electronic devices that rely on determining the orientation of the first electronic device, such as updating the corresponding representation), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0345] In some embodiments, such as Figure 6T In response to detecting a change in the orientation θ of the first electronic device 500 (717), a corresponding representation 634 of the different electronic device is displayed (719) with a first value of the corresponding visual attribute (e.g., a flat visual orientation) based on determining that the second orientation of the first electronic device 500 is within a first predetermined orientation range. In some embodiments, the corresponding representation of the different electronic device includes an image representing the different electronic device, such as a user picture or avatar associated with a user account of the different electronic device. Optionally, when the corresponding representation of the different electronic device is displayed in the flat visual orientation, the representation has a first shape (e.g., a circle) and the image is not distorted.
[0346] In some embodiments, such as Figure 6UIn some embodiments, in response to detecting a change in the orientation θ of the first electronic device 500 (717), based on determining that the second orientation of the first electronic device is outside the first predetermined orientation range, the indication 634 of changing the orientation of the electronic device is a corresponding representation of the different electronic device displayed with a second value of the corresponding visual attribute (e.g., a tilted visual orientation), the second value being different from the first value of the corresponding visual attribute (721). In some embodiments, when the corresponding representation of the different electronic device is displayed with the tilted visual orientation, the representation has a second shape (e.g., an elliptical shape), and the image is distorted to create the appearance that the visual indication of the corresponding electronic device is tilted.
[0347] The above-mentioned manner of displaying the corresponding representation in a tilted visual orientation based on determining that the orientation of the first electronic device is outside the first predetermined orientation quickly and effectively indicates that the device is in an orientation in which the circuit for determining the direction in which the first electronic device is pointing cannot reliably function, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by instructing the user to correctly position the first electronic device in order to accurately and effectively use features of the circuits of other electronic devices that rely on determining the direction in which the first electronic device is pointing, such as updating the corresponding representation), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0348] In some embodiments, such as Figures 6CC to 6DD, the current values of the visual attributes of the corresponding representations of the different electronic devices change as the current orientation θ of the first electronic device 500 changes outside the first predetermined orientation range (723). In some embodiments, the amount of change in the current value of the visual attribute changes by an amount proportional to the amount of change in the orientation of the first electronic device. For example, when the orientation of the electronic device remains outside the first orientation range, the amount of visual tilt of the representations of the different electronic devices changes slightly when the orientation changes slightly, and the amount of visual tilt changes by a larger amount when the orientation of the electronic device changes by a larger amount. The direction of the change in the current value of the corresponding visual attribute optionally changes as the direction of the change in the orientation of the first electronic device changes. For example, when the first electronic device is in an orientation outside the first orientation range, the amount of visual tilt of the representations of the other electronic devices increases as the orientation of the electronic device moves further away from the reference orientation, and the amount of visual tilt of the representations of the other electronic devices decreases as the orientation of the electronic device moves closer to the reference orientation. In some embodiments, the visual tilt of the corresponding representation increases as the orientation of the first electronic device changes further away from the first orientation range. As another example, the first predetermined orientation range includes orientations in which the angle between the first electronic device and a reference plane (e.g., a plane perpendicular to gravity or a plane between the first electronic device and a different electronic device) is between 15 degrees and 255 degrees. In this example, in response to detecting that the angle between the first electronic device and the reference plane is 13 degrees, the first electronic device displays the corresponding representation with a tilted appearance. For example, in response to detecting that the angle between the first electronic device and the reference plane decreases to 9 degrees, the first electronic device displays the corresponding representation with a more tilted appearance, which appears to be more tilted than the appearance when the first electronic device is at an angle of 13 degrees relative to the reference plane. Therefore, in some embodiments, the further the orientation of the first electronic device is from the limit of the first predetermined orientation range, the more tilted the corresponding representation appears.
[0349] The above-mentioned manner of changing the second visual orientation of the corresponding representations of different electronic devices as the orientation of the first electronic device changes outside the first predetermined orientation range quickly and effectively communicates to the user the current orientation of the first electronic device relative to the orientation range in which the shared circuit works most reliably, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by instructing the user to change the orientation of the first electronic device to improve the performance of the circuit of other electronic devices that determine the direction at which the first electronic device is pointing). This also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently (such as by effectively instructing the user how to position the first electronic device to improve the performance of the circuit that senses the direction in which the first electronic device is pointing).
[0350] In some embodiments, such as Figures 6T to 6U , displaying a corresponding representation 634 of a different electronic device 610b with a first value of a corresponding visual attribute, and displaying a corresponding representation 634 of a different electronic device 610a with a second value of the corresponding visual attribute includes displaying one or more representations 636 of other electronic devices 610 that can be used to share content with the first electronic device, with multiple representations 636 of the other electronic devices displayed at positions around the corresponding representations, and the multiple representations are updated as the current orientation of the first electronic device relative to the other electronic devices changes (725). Optionally, the corresponding representations of the different electronic devices include images representing the different electronic devices, such as user profile pictures or avatars associated with user accounts of the different electronic devices or representations of names or pseudonyms of user accounts of the different electronic devices. In some embodiments, the images representing the different electronic devices are surrounded by representations of the other electronic devices. For example, the representations of the other electronic devices are dots or images associated with each corresponding other electronic device. In some embodiments, the position of each representation of the corresponding other electronic device relative to the image representing the different electronic device is optionally similar to the position of the corresponding other electronic device relative to the first electronic device, such as described with reference to method 700. For example, if the first other electronic device is positioned in the direction of the right edge of the first electronic device, the representation of the first other electronic device is displayed to the right of the image representing the different electronic device, and if the second other electronic device is positioned in the direction of the bottom edge of the first electronic device, the representation of the second other electronic device is displayed adjacent to the bottom edge of the image representing the different electronic device. In some embodiments, the representations of the other electronic devices are displayed around the image representing the different electronic device regardless of the visual orientation of the representations of the different electronic devices. Optionally, when the orientation of the first electronic device is outside of a first predetermined range of orientations and the representations of the different electronic devices are displayed at a tilted visual orientation, the representations of the other electronic devices are distorted, such as distorting the shape of the representations of the other electronic devices, or displaying the representation above the image representing the different electronic device at a smaller size than the size of the representation below the image representing the different electronic device (e.g., indicating that the top portion of the representation of the other electronic device has been tilted into the display and the bottom portion of the representation of the other electronic device has been tilted outward from the display).
[0351] The above-mentioned manner of displaying representations of other electronic devices at positions around the corresponding representations that are updated as the current orientation of the first electronic device relative to the other electronic devices changes, and displaying the corresponding representations in the first visual orientation or the second visual orientation, provides feedback to the user when the user repositions the first electronic device, such as so that the first electronic device updates the device with which content is to be shared based on the direction in which the first electronic device is pointed. This simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by providing the user with visual assistance that enables the user to more quickly update the corresponding representations of different electronic devices to share content with different electronic devices). This also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0352] In some embodiments, such as Figures 6Z to 6AA , when the current orientation of the first electronic device 500 is outside the first predetermined angular range and outside the second predetermined angular range, and when the corresponding representation 634 of the different electronic device is displayed with the second value of the corresponding visual attribute (727), the first electronic device 500 detects (729) a change in the orientation of the first electronic device from the second orientation to a third orientation (e.g., a change in the angle between the first electronic device and the reference plane and / or a change in the direction in which the first electronic device is pointing), the third orientation being outside the first predetermined orientation range and outside the second predetermined orientation range. In some embodiments, the first predetermined orientation range includes orientations in which the angle between the first electronic device and the reference plane is in the range of 15 degrees to 255 degrees, and the second predetermined orientation range includes orientations in which the angle between the first electronic device and the reference plane is approximately zero (e.g., + / - 0.1 degrees, 0.5 degrees, or 1 degree). Thus, in some embodiments, when the angle between the first electronic device and the reference plane is less than 15 degrees but greater than a limit of the second orientation range, the orientation of the first electronic device is outside both the first predetermined orientation range and the second predetermined orientation range.
[0353] In some embodiments, such as Figures 6Z to 6AAIn the embodiment of the present invention, when the current orientation θ of the first electronic device 500 is outside the first predetermined angular range and outside the second predetermined angular range, and when the corresponding representation 634 of the different electronic device 610 is displayed with the second value of the corresponding visual attribute (727), in response to detecting a change in the orientation of the first electronic device from the second orientation to the third orientation, the first electronic device 500 updates (731) the corresponding representation 634 of the different device 610 that can be used to share content with the first electronic device based on the direction in which the first electronic device is pointing. In some embodiments, when the orientation of the first electronic device is outside the first predetermined orientation range and the second predetermined orientation range, the first electronic device displays the representation of the different electronic device in a tilted visual orientation and updates the corresponding representation when the first electronic device moves from pointing at one different electronic device to pointing at another different electronic device. Optionally, in response to detecting that the orientation of the first electronic device is within the second predetermined orientation range, the corresponding representation of the different electronic device is not updated based on the direction in which the first electronic device is pointing. In some embodiments, in response to detecting that the orientation of the first electronic device is within a second predetermined range of orientations, the first electronic device stops displaying corresponding representations of different electronic devices and displays an indication of tilting the first electronic device (for example, including an image or text of "tilt device", "tilt phone", etc.), which does not include corresponding representations of different electronic devices.
[0354] The above-mentioned manner of updating the corresponding representations of different devices displayed with second values of corresponding visual characteristics based on the direction in which the first electronic device is pointed when the orientation of the first electronic device is outside a first predetermined orientation range and outside a second predetermined orientation range provides continued operation of the direction-based sharing method described herein when the user is instructed to change the orientation of the first electronic device, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by continuing to update the corresponding representations while encouraging the user to update the orientation of the first electronic device to an orientation that improves the performance of the circuit that detects the direction in which the first electronic device is pointed), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently (such as by providing visual feedback on the orientation of the first electronic device to help the user orient the first electronic device toward the desired sharing target more quickly, and encouraging the user to change the orientation of the first electronic device to an orientation that improves device performance).
[0355] In some embodiments, such as Figures 6U to 6VIn some embodiments, when the current orientation θ of the first electronic device 500 is outside the first predetermined angular range and outside the second predetermined angular range, and when the corresponding representation 634 of the different electronic device is displayed with the second value of the corresponding visual attribute (733), the electronic device 500 detects (735) a change in the orientation of the first electronic device from the second orientation to a third orientation (e.g., a change in the angle between the first electronic device and the reference plane and / or a change in the direction in which the first electronic device is pointing), the third orientation being outside the first predetermined orientation range and outside the second predetermined orientation range. In some embodiments, the first predetermined orientation range includes orientations in which the angle between the first electronic device and the reference plane is in the range of 15 degrees to 255 degrees, and the second predetermined orientation range includes orientations in which the angle between the first electronic device and the reference plane is approximately zero (e.g., + / - 0.1 degrees, 0.5 degrees, or 1 degree). Thus, in some embodiments, when the angle between the first electronic device and the reference plane is less than 15 degrees but greater than a limit of the second orientation range, the orientation of the first electronic device is outside both the first predetermined orientation range and the second predetermined orientation range.
[0356] In some embodiments, such as Figures 6U to 6V In some embodiments, when the current orientation θ of the first electronic device 500 is outside the first predetermined angular range and outside the second predetermined angular range, and when the corresponding representation 634 of the different electronic device 610a is displayed with the second value of the corresponding visual attribute (733), in response to detecting a change in the orientation of the first electronic device from the second orientation to the third orientation, the first electronic device 500 abandons updating (737) the corresponding representation 634 of the different device 610a that can be used to share content with the first electronic device 500 based on the direction in which the first electronic device is pointed. In some embodiments, when the orientation of the first electronic device is outside the first predetermined orientation range and the second predetermined orientation range, the first electronic device displays the representation of the different electronic device in the second (e.g., tilted) visual orientation and does not update the corresponding representation when the first electronic device moves from pointing at one different electronic device to pointing at another different electronic device. In some embodiments, in response to detecting that the orientation of the first electronic device is within the second predetermined orientation range, the first electronic device stops displaying the corresponding representation of the different electronic device and displays an indication of tilting the first electronic device (e.g., an image or text including "tilt device", "tilt phone", etc.), which does not include the corresponding representation of the different electronic device.
[0357] The above-mentioned manner of abandoning updating the corresponding representation when the orientation of the first electronic device is outside the first orientation range prevents the first electronic device from erroneously updating the corresponding representation when it is in an orientation where the circuit for identifying the direction in which the first electronic device is pointing functions with reduced reliability, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by reducing errors and enabling the user to more quickly select different desired electronic devices for sharing), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0358] In some embodiments, such as Figure 6V , when a corresponding representation 634 of a different electronic device 610a displayed with a second value of a corresponding visual attribute is displayed, the first electronic device 500 receives (739) (e.g., using contact 603) input via the one or more input devices selecting the corresponding representation 634 of the different electronic device 610a displayed with the second value of the corresponding visual attribute (e.g., an optional sharing option that, when selected, causes the first electronic device to initiate a process of sharing content with a different electronic device according to method 700).
[0359] In some embodiments, such as Figure 6WIn some embodiments, in response to detecting a selection of a corresponding representation 634 of a different electronic device 610a, the first electronic device 500 initiates (741) a process of sharing content with the different electronic device. In some embodiments, the corresponding representation of the different electronic device is a selectable sharing option that, when selected, initiates a process of sharing content with the different electronic device. Optionally, when the orientation of the first electronic device is within a first predetermined orientation range, in response to detecting a selection of a representation of a different electronic device displayed in a first visual orientation, the first electronic device initiates a process of sharing content with the different electronic device, as described above with reference to method 700. In some embodiments, when the first electronic device displays the corresponding representation of the different electronic device in a second orientation, the corresponding orientation is updated according to the direction in which the first electronic device is pointed. For example, when the orientation of the first electronic device is outside the first predetermined orientation range and outside the second predetermined orientation range, if the first electronic device is repositioned to point at another different electronic device, the corresponding representation is updated, and in response to detecting a selection of the updated corresponding representation, the first electronic device initiates a process of sharing content with the other different electronic device. Optionally, the corresponding representation of the different electronic device with the second visual orientation is not updated according to the direction in which the first electronic device is pointed. For example, the corresponding representation is updated based on the direction the first electronic device is pointing when the orientation of the first electronic device is within a first predetermined orientation range, and the updating is abandoned if the orientation of the first electronic device changes to an orientation outside the first predetermined orientation range (e.g., within a second predetermined orientation range). In this example, in response to detecting a selection of the corresponding representation when the orientation of the first electronic device is outside the first predetermined orientation range, the first electronic device shares content with a different electronic device that was most recently identified (e.g., when the device orientation was last within the first predetermined orientation range).
[0360] The above-described manner of sharing content with different devices in response to detecting a selection of a corresponding representation when the orientation of the first electronic device is outside a first predetermined orientation range and a second predetermined orientation range reduces the amount of time spent sharing content (for example, by sharing content without requiring the user to reposition the first electronic device in an orientation within the first predetermined orientation range), which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient, which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0361] In some embodiments, when the first electronic device 500 is in the second orientation and when corresponding representations of different electronic devices are displayed, the first electronic device 500 receives (734) input via the one or more input devices selecting the corresponding representation of the different electronic device.
[0362] In some embodiments, such as Figure 6N In the embodiment of the present invention, in response to receiving input (745) selecting (e.g., using contact 603) a corresponding representation 616a of a different electronic device, based on determining that the second orientation of the first electronic device 500 is within a first predetermined range of orientations (e.g., such as in FIG. 6T ), the first electronic device initiates (747) a process of sharing content with the different electronic device, as shown in FIG. 6O . In some embodiments, when the orientation of the first electronic device is within the first predetermined range of orientations, in response to detecting the selection of the corresponding representation, the first electronic device initiates a process of sharing content with the different electronic device, as described with reference to method 700.
[0363] In some embodiments, such as Figures 6X to 6Y In some embodiments, in response to receiving input (745) selecting a corresponding representation 634 of a different electronic device 610a (e.g., using contact 603), based on determining that the second orientation of the first electronic device 500 is outside the first predetermined orientation range, the first electronic device 500 abandons (749) initiating a process for sharing content with the different electronic device. In some embodiments, when the orientation of the electronic device is outside the first predetermined orientation range (e.g., within the second predetermined orientation range), the first electronic device displays the corresponding representation without updating the corresponding representation based on the direction in which the first electronic device is pointed, and does not share the content in response to detecting a selection of the corresponding representation. In some embodiments, when the orientation of the first electronic device is outside the first predetermined orientation range and outside the second predetermined orientation range, the first electronic device updates the corresponding representation of the different electronic device based on the direction in which the first electronic device is pointed, but does not initiate a process for sharing content in response to detecting a selection of the corresponding representation.
[0364] The above-mentioned manner of sharing content in response to detecting a selection of a corresponding representation when the orientation of the first electronic device is within a first predetermined orientation range, and abandoning sharing content in response to detecting a selection of a corresponding representation when the orientation of the first electronic device is outside the first predetermined orientation range, avoids erroneously sharing content with a wrong different electronic device (for example, by abandoning sharing when the orientation of the first electronic device is outside the first predetermined orientation range), which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by avoiding having to try to share content multiple times due to errors), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0365] In some embodiments, such as Figures 6X to 6Y In response to detecting (e.g., using contact 603) an input selecting a corresponding representation 634 of a different electronic device 610a, based on determining that the second orientation θ of the first electronic device 500 is outside a first predetermined orientation range, the first electronic device displays (751) via a display device an error message 642 indicating that content sharing has not been initiated. In some embodiments, the error message is overlaid on the sharing user interface. Optionally, the error message indicates to the user that the content has not been shared because the orientation of the electronic device is outside the first predetermined orientation range, such as by including text indicating that the user tilts the first electronic device. In some embodiments, the error message includes a selectable option that, when selected, causes the first electronic device to stop displaying the error message. In some embodiments, the error message is displayed as an overlay on the corresponding representation and / or replaces the corresponding representation. The first electronic device optionally plays a sound and / or generates a tactile output while displaying the error message.
[0366] The above-mentioned manner of displaying an error message in response to detecting the selection of a corresponding representation when the orientation of the first electronic device is outside a first predetermined orientation range notifies the user that selecting the corresponding representation will not cause the first electronic device to share content and / or the reason why selecting the corresponding representation will not cause the first electronic device to share content, so that the user knows to reposition the first electronic device and select the corresponding representation again to successfully share the content, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by providing instructions to the user for sharing content without requiring the user to use a trial and error method to share content), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0367] In some embodiments, such as Figures 6X to 6Y In the embodiment of the present invention, in response to detecting (e.g., using contact 603) an input selecting a corresponding representation 634 of a different electronic device 610a, based on determining that the second orientation θ of the first electronic device is outside a first predetermined orientation range, the first electronic device 500 generates (753) a tactile output 646 indicating that content sharing has not been initiated. In some embodiments, the tactile output is a tactile output generated by the first electronic device in other contexts to indicate an error. For example, the tactile output optionally includes a pattern of three tactile pulses and is optionally the same tactile output as the tactile output generated by the electronic device in response to other errors experienced by the electronic device, such as the tactile output generated in response to a failure of the electronic device to biometrically authenticate the user (e.g., face, fingerprint, etc.) during the process of unlocking the electronic device or during the process of making a purchase using the electronic device. The electronic device optionally displays an error message and / or plays a sound while generating the tactile output.
[0368] The above-mentioned manner of generating tactile output in response to detecting selection of a corresponding representation when the orientation of the first electronic device is outside a first predetermined orientation range quickly and easily notifies the user that selection of the corresponding representation will not cause the first electronic device to share content due to an error at the first electronic device, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by helping the user identify the reason why the content is not shared), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0369] In some embodiments, such as Figure 6HH In some embodiments, a different device 610a is operable to share content with the first electronic device 500 via a first sharing protocol (e.g., a short-range wireless sharing protocol for sharing content from one electronic device to another electronic device), and the sharing user interface further includes a selectable option 616b (757) that, when selected, initiates a process of sharing the content with the other electronic device via a second sharing protocol different from the first sharing protocol (e.g., text message, email, social media, etc.). In some embodiments, a corresponding representation is presented in a sharing user interface that includes selectable options for sharing content in various ways, such as described with reference to method 700 or 900.
[0370] The above-mentioned manner of displaying the corresponding representation simultaneously with the optional option for sharing content using another sharing protocol also provides the user with an alternative way of sharing content that does not depend on the orientation of the first electronic device, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user-device interface more efficient (for example, by enabling the user to share content in different ways from the same user interface when the user cannot position the first electronic device within the first orientation range), which also reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0371] In some embodiments, such as Figure 6U , the different electronic device 610a may be used to share content with the first electronic device 500 via a first sharing protocol (eg, a short range wireless sharing protocol for sharing content from one electronic device to another electronic device) (757).
[0372] In some embodiments, such as Figure 6U In some embodiments, the sharing user interface further includes one or more selectable options 638c (759) that, when selected, initiate a corresponding process of sharing content with the corresponding other electronic device via the first sharing protocol. In addition to displaying the corresponding representation, the first electronic device also optionally simultaneously displays selectable options that are not updated based on where the first electronic device is pointed, each selectable option being associated with the corresponding other electronic device. In some embodiments, the selectable options are organized into categories, such as options for sharing with electronic devices associated with contacts of the first electronic device, options for sharing with electronic devices associated with the same user account as the user account associated with the first electronic device, and options for sharing with other electronic devices that are not associated with a known user account, as described with reference to method 700.
[0373] In some embodiments, such as Figure 6U In some embodiments, the sharing user interface does not include a selectable option (761) for sharing content with other electronic devices via a second sharing protocol that is different from the first sharing protocol. In some embodiments, the sharing user interface is dedicated to sharing via the first sharing protocol and does not include a selectable option for sharing using any other sharing protocol.
[0374] The above-mentioned manner of displaying corresponding representations in a user interface that includes an optional option for sharing content with other electronic devices using a first sharing protocol allows the user to share content using the first sharing protocol by selecting an option...
Claims
1. A method comprising: At a first electronic device in communication with a display device and one or more input devices: displaying, via the display device, a sharing user interface including a plurality of selectable content sharing options for sharing content with another device, the plurality of selectable content sharing options including a first content sharing option, wherein the first content sharing option displayed at a first position in the sharing user interface is selectable to initiate a process of sharing content with a second electronic device, and wherein the first content sharing option is displayed with a first visual indication indicating that the first content sharing option is selectable to initiate the process of sharing the content with the second electronic device; detecting a change in orientation of the first electronic device from a first orientation to a second orientation while displaying the plurality of selectable content sharing options and the first content sharing option selectable to initiate the process of sharing content with the second electronic device; as well as In response to detecting the change in the orientation of the first electronic device: Based on determining that the second orientation satisfies one or more sharing criteria associated with the second electronic device, maintaining the first content sharing option displayed at the first location in the sharing user interface as selectable to initiate the process of sharing content with the second electronic device using the first content sharing option, and maintaining the first content sharing option as displayed with the first visual indication indicating that the first content sharing option is selectable to initiate the process of sharing the content with the second electronic device; and Based on determining that the second orientation satisfies one or more sharing criteria associated with a third electronic device, updating the sharing user interface to include a content sharing option displayed at the first location in the sharing user interface, the content sharing option being selectable to initiate a process of sharing content with the third electronic device without initiating the process of sharing content with the second electronic device, wherein the one or more sharing criteria associated with the third electronic device include a first criterion that is satisfied when the second orientation is oriented toward the third electronic device and a second criterion that is satisfied when the second orientation is oriented toward the third electronic device for more than a threshold time, and wherein the content sharing option displayed at the first location in the sharing user interface that is selectable to initiate the process of sharing content with the third electronic device is displayed with a second visual indication indicating that the content sharing option is selectable to initiate the process of sharing the content with the third electronic device, and In response to determining that the second orientation is oriented toward the third electronic device and before the one or more shared criteria associated with the third electronic device are satisfied and before the second orientation is oriented toward the third electronic device for more than a threshold time, an indication is generated at the first electronic device indicating that the second orientation is oriented toward the third electronic device.
2. The method according to claim 1, further comprising: In response to detecting the change in the orientation of the first electronic device: Based on the determination that the second orientation satisfies the one or more sharing criteria associated with the third electronic device, updating the appearance of the first content sharing option to change from an appearance corresponding to the second electronic device to an appearance corresponding to the third electronic device.
3. The method according to claim 1, further comprising: In response to detecting the change in the orientation of the first electronic device: Based on the determining that the second orientation satisfies the one or more sharing criteria associated with the third electronic device, replacing the first content sharing option with the content sharing option selectable to initiate the process of sharing content with the third electronic device.
4. The method according to claim 1, further comprising: When the orientation of the first electronic device changes, one or more visual indications of one or more other electronic devices, including the second electronic device, are displayed along with the first content sharing option, the one or more other electronic devices being within a threshold distance of the first electronic device.
5. The method according to claim 4, further comprising: When the orientation of the first electronic device has not changed, ceasing to display the one or more visual indications of the one or more other electronic devices. The method of claim 4 , wherein the one or more visual indications of the one or more other electronic devices include a user interface element at least partially surrounding the first content sharing option.
7. The method of claim 6, wherein the user interface element at least partially surrounding the first content sharing option includes one or more corresponding indications of the one or more other electronic devices displayed on the user interface element at least partially surrounding the first content sharing option.
8. A method according to claim 7, wherein the one or more other electronic devices are devices associated with a user or one or more user accounts, the user or one or more user accounts have a predetermined relationship with the user or user account associated with the first electronic device, and the user interface element at least partially surrounding the first content sharing option does not include one or more corresponding indications of one or more other corresponding electronic devices, and the one or more other corresponding electronic devices are within the threshold distance of the first electronic device but are unknown to the first electronic device.
9. The method of claim 7 , wherein, prior to detecting the change in the orientation of the first electronic device, the user interface element at least partially surrounding the first content sharing option includes an indication to the third electronic device, the method further comprising: In response to detecting the change in the orientation of the first electronic device: Based on the determining that the second orientation satisfies the one or more sharing criteria associated with the third electronic device, displaying an animation in which the indication to the third electronic device changes to a visual representation of a user of the third electronic device.
10. The method of claim 9, wherein prior to detecting the change in the orientation of the first electronic device, the first content sharing option is displayed as a visual representation of a user with the second electronic device, the method further comprising: In response to detecting the change in the orientation of the first electronic device: Based on determining that the second orientation satisfies the one or more sharing criteria associated with the third electronic device, the visual representation of the user displaying the second electronic device changes to an animation of an indication of the second electronic device displayed on the user interface element that at least partially surrounds the first content sharing option.
11. The method according to claim 7, further comprising: The positions of the one or more corresponding indications of the one or more other electronic devices displayed on the user interface element that at least partially surrounds the first content sharing option are changed according to the change in the orientation between the first electronic device and the one or more other electronic devices, so that the positions of the one or more corresponding indications of the one or more other electronic devices on the user interface element that at least partially surrounds the first content sharing option correspond to the relative orientation of the one or more other electronic devices relative to the first electronic device.
12. The method according to claim 7, wherein: The one or more corresponding indications to the one or more other electronic devices include a corresponding indication to the second electronic device and a corresponding indication to the third electronic device, Based on determining that the second electronic device and the third electronic device have a first orientation difference relative to the first electronic device, the respective indication for the second electronic device and the respective indication for the third electronic device are separated by a first distance on the user interface element that at least partially surrounds the first content sharing option, and Based on determining that the second electronic device and the third electronic device have a second orientation difference relative to the first electronic device, the corresponding indication for the second electronic device and the corresponding indication for the third electronic device are separated by a second distance different from the first distance on the user interface element that at least partially surrounds the first content sharing option.
13. The method according to claim 1, further comprising: In response to detecting the change in the orientation of the first electronic device: Based on determining that the second orientation satisfies the one or more sharing criteria associated with the third electronic device, an indication is generated at the first electronic device, indicating that the content sharing option displayed at the first position in the sharing user interface can be selected to initiate the process of sharing content with the third electronic device without initiating the process of sharing content with the second electronic device.
14. The method of claim 1, wherein the second orientation satisfies the one or more sharing criteria associated with the third electronic device when the second orientation is oriented toward the third electronic device for a time longer than a time threshold.
15. The method according to claim 1, further comprising: receiving, via the one or more input devices, a selection of the content sharing option while displaying the sharing user interface via the display device; as well as In response to receiving the input selecting the content sharing option: sharing the content with the second electronic device based on determining that the content sharing option is selectable to initiate the process of sharing content with the second electronic device; as well as Based on determining that the content sharing option is selectable to initiate the process of sharing the content with the third electronic device, the content is shared with the third electronic device.
16. The method of claim 15, wherein the content sharing option is displayed along with one or more visual indications of one or more other electronic devices, including the second electronic device and the third electronic device, the one or more other electronic devices being within a threshold distance of the first electronic device, the method further comprising: In response to receiving the input selecting the content sharing option, the one or more visual indications of the one or more other electronic devices are replaced with a visual indication of a progress of the sharing of the content.
17. The method of claim 1, wherein the plurality of selectable content sharing options for sharing content with other devices further includes a second content sharing option, and wherein the second content sharing option does not change based on the orientation of the first electronic device.
18. The method of claim 1, wherein the sharing user interface is displayed in response to selection of a selectable sharing option displayed in a corresponding application on the first electronic device.
19. The method of claim 1 , wherein the first content sharing option is associated with a first sharing protocol and a corresponding other electronic device, and the sharing user interface further includes a second content sharing option associated with the first sharing protocol but not associated with the corresponding other electronic device, the method further comprising: receiving, via the one or more input devices, a selection of the second content sharing option while displaying the sharing user interface via the display device; as well as In response to receiving the input selecting the second content sharing option: displaying, via the display device, an enlarged sharing user interface associated with the first sharing protocol, the enlarged sharing user interface comprising: a corresponding content sharing option selectable to share content with another electronic device based on the orientation of the first electronic device using the first sharing protocol; and A plurality of visual representations of a plurality of electronic devices, including a visual representation of the second electronic device and a visual representation of the third electronic device, the plurality of electronic devices being within a threshold distance of the first electronic device and being available for sharing using the first sharing protocol.
20. The method of claim 19, wherein: Prior to receiving input selecting the second content sharing option, the first content sharing option is displayed in the sharing user interface along with one or more visual indications of the electronic device, other than an image representing the electronic device, within the threshold distance of the first electronic device, wherein the one or more visual indications are positioned relative to the first content sharing option based on a position of the electronic device relative to the first electronic device, and After receiving the input selecting the second content sharing option, the corresponding content sharing option is displayed in the enlarged sharing user interface together with one or more images representing the electronic device within the threshold distance of the first electronic device, wherein the one or more images are positioned relative to the corresponding content sharing option based on the position of the electronic device relative to the first electronic device.
21. A method according to claim 20, wherein the enlarged sharing user interface includes a first area, a second area and a third area, the first area including one or more visual representations of one or more electronic devices associated with a user account of a user of the first electronic device and capable of being used for sharing using the first sharing protocol, the second area including one or more visual representations of one or more electronic devices associated with contacts of the user of the first electronic device, and the third area including one or more visual representations of one or more electronic devices that are neither associated with the user account nor with the contacts of the user of the first electronic device but capable of being used for sharing using the first sharing protocol.
22. The method of claim 1, wherein the plurality of selectable content sharing options includes a second content sharing option associated with a respective user, the second content sharing option selectable to initiate a process of sharing content with the respective user regardless of the orientation of the first electronic device.
23. A method according to claim 22, wherein the first content sharing option is selectable to initiate sharing using a corresponding sharing protocol, the first content sharing option is displayed together with the rest of the multiple selectable content sharing options associated with other users in an area of the sharing user interface, and the rest of the multiple selectable content sharing options are selectable to initiate sharing with the other users using one or more sharing protocols other than the corresponding sharing protocol.
24. The method of claim 23, wherein the remaining portion of the plurality of selectable content sharing options comprises: a first respective content sharing option associated with a first respective user and a first respective sharing agreement, wherein the first respective content sharing option is displayed with a visual indication of the first respective sharing agreement; and A second respective content sharing option is associated with a second respective user and a second respective sharing agreement, wherein the second respective content sharing option is displayed with a visual indication of the second respective sharing agreement.
25. The method of claim 1, wherein prior to detecting the change in the orientation of the first electronic device: Based on determining that one or more first criteria are satisfied, regardless of the orientation of the first electronic device, the first content sharing option in the sharing user interface is selectable to initiate a process of sharing content with a first suggested electronic device, and Based on determining that one or more second criteria are met, regardless of the orientation of the first electronic device, the first content sharing option in the sharing user interface can be selected to initiate a process of sharing content with a second suggested electronic device.
26. The method of claim 1, wherein: In response to detecting the change in the orientation of the first electronic device: Based on determining that the second orientation satisfies one or more shared criteria associated with the first respective electronic device and the second respective electronic device: Based on determining that one or more first criteria are satisfied, regardless of the orientation of the first electronic device, the first content sharing option in the sharing user interface is selectable to initiate a process of sharing content with the first corresponding electronic device, and Based on determining that one or more second criteria are satisfied, regardless of the orientation of the first electronic device, the first content sharing option in the sharing user interface can be selected to initiate a process of sharing content with the second respective electronic device.
27. The method according to claim 26, further comprising: detecting a change in position of the first electronic device from a first position to a second position when the first electronic device is in the second orientation, the one or more first criteria are satisfied, and the first content sharing option in the sharing user interface is selectable to initiate the process of sharing content with the first corresponding electronic device; as well as In response to detecting the change in the position of the first electronic device from the first position to the second position: Based on determining that the second location satisfies one or more sharing criteria associated with the second respective electronic device, the first content sharing option can be selected to initiate a process of sharing content with the second respective electronic device.
28. An electronic device comprising: one or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the method according to any one of claims 1 to 27.
29. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method according to any one of claims 1 to 27.
Citation Information
Patent Citations
Method and apparatus for integrating manual input
US20020015024A1
Acceleration-based theft detection system for portable electronic devices
US20050190059A1
Methods and apparatuses for operating a portable device based on an accelerometer
US20060017692A1
Gestures for touch sensitive input devices
US20060026521A1
Gestures for touch sensitive input devices
US20060026536A1