Column interface for navigation in user interfaces

Abstract

To provide user interfaces for navigating and displaying content items.SOLUTION: An electronic device provides, for display on a display device, a user interface including a first set of columns, two or more columns in the first set of columns each including two or more menu items. The electronic device receives a selection input. In response to receiving the selection input, in accordance with a determination that the selection input corresponds to selection of a first column, the electronic device provides, for display on the display device, a second set of columns, two or more of the columns in the second set of columns corresponding to different subsets of menu items displayed in the first column selected in response to the selection input.SELECTED DRAWING: Figure 6G

Description

Technical Field

[0001] This application generally relates to a user interface for navigating and presenting content items.

Background Art

[0002] Electronic devices that provide a user interface for navigating and presenting content items are often cluttered and confusing to users. Further, presenting a user interface, for example, after viewing a video, can be unpleasant and an unintuitive experience.

[0003] (Cross - reference to related applications) This application claims the benefit of U.S. Provisional Patent Application No. 62 / 016,599, filed Jun. 24, 2014, the disclosure of which is hereby incorporated by reference in its entirety for all purposes.

Summary of the Invention

[0004] Many electronic devices have a graphical user interface that can navigate a user through a number of content items. There is a need to provide a fast, efficient, and convenient way to navigate a user through content items for consumption (e.g., viewing, listening, etc.) and select the same content items. The embodiments described below use a column user interface to provide a fast, efficient, and convenient way to navigate a user through content items for consumption and select the same content items.

[0005] For a better understanding of the various embodiments described, reference is made to the following "Detailed Description of the Invention" in conjunction with the following drawings, in which like reference numerals refer to corresponding parts throughout the figures.

Brief Description of the Drawings

[0006] [Figure 1A] This is a block diagram showing a multifunctional device equipped with a touch-sensitive display, according to several embodiments. [Figure 1B] This is a block diagram showing exemplary components for event handling according to several embodiments. [Figure 2] This figure shows a multifunctional device having a touchscreen according to several embodiments. [Figure 3] This is a block diagram of an exemplary multifunctional device comprising a display and a touch-sensitive surface, according to several embodiments. [Figure 4] This figure shows an exemplary user interface for a multifunctional device having a touch-sensitive surface separate from the display, according to several embodiments. [Figure 5] This is a block diagram of an exemplary structure relating to a device according to some embodiments of the present disclosure. [Figure 6A] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6B] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6C] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6D] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6E] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6F]This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6G] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6H] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6I] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6J] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6K] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6L] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6M] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6N] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6O] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6P] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6Q] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6R] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6S] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6T] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6U] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6V] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6W] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6X] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6Y]A diagram showing an exemplary user interface for navigating across and selecting content items according to some embodiments of the present disclosure. [Figure 6Z] A diagram showing an exemplary user interface for navigating across and selecting content items according to some embodiments of the present disclosure. [Figure 6AA] A diagram showing an exemplary user interface for navigating across and selecting content items according to some embodiments of the present disclosure. [Figure 6BB] A diagram showing an exemplary user interface for navigating across and selecting content items according to some embodiments of the present disclosure. [Figure 6CC] A diagram showing an exemplary user interface for navigating across and selecting content items according to some embodiments of the present disclosure. [Figure 6DD] A diagram showing an exemplary user interface for navigating across and selecting content items according to some embodiments of the present disclosure. [Figure 6EE] A diagram showing an exemplary user interface for navigating across and selecting content items according to some embodiments of the present disclosure. [Figure 6FF] A diagram showing an exemplary user interface for navigating across and selecting content items according to some embodiments of the present disclosure. [Figure 6GG] A diagram showing an exemplary user interface for navigating across and selecting content items according to some embodiments of the present disclosure. [Figure 6HH] A diagram showing an exemplary user interface for navigating across and selecting content items according to some embodiments of the present disclosure. [Figure 6II] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6JJ] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6KK] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6LL] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6MM] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 6NN] This figure shows an exemplary user interface for navigating across and selecting content items, according to some embodiments of the present disclosure. [Figure 7A] This flowchart illustrates a method for providing a column user interface according to several embodiments. [Figure 7B] This flowchart illustrates a method for providing a column user interface according to several embodiments. [Figure 7C] This flowchart illustrates a method for providing a column user interface according to several embodiments. [Figure 7D] This flowchart illustrates a method for providing a column user interface according to several embodiments. [Figure 7E] This flowchart illustrates a method for providing a column user interface according to several embodiments. [Figure 8A]This figure shows an exemplary translucent user interface according to some embodiments of the present disclosure. [Figure 8B] This figure shows an exemplary translucent user interface according to some embodiments of the present disclosure. [Figure 8C] This figure shows an exemplary translucent user interface according to some embodiments of the present disclosure. [Figure 8D] This figure shows an exemplary translucent user interface according to some embodiments of the present disclosure. [Figure 9A] This is a flowchart illustrating a method for providing a user interface having a translucent portion according to several embodiments. [Figure 9B] This is a flowchart illustrating a method for providing a user interface having a translucent portion according to several embodiments. [Figure 9C] This is a flowchart illustrating a method for providing a user interface having a translucent portion according to several embodiments. [Figure 10A] This figure shows a step-by-step display of a column user interface on passive content according to some embodiments of the present disclosure. [Figure 10B] This figure shows a step-by-step display of a column user interface on passive content according to some embodiments of the present disclosure. [Figure 10C] This figure shows a step-by-step display of a column user interface on passive content according to some embodiments of the present disclosure. [Figure 10D] This figure shows a step-by-step display of a column user interface on passive content according to some embodiments of the present disclosure. [Figure 10E] This figure shows a step-by-step display of a column user interface on passive content according to some embodiments of the present disclosure. [Figure 10F] This figure shows a step-by-step display of a column user interface on passive content according to some embodiments of the present disclosure. [Figure 11A]This flowchart illustrates a method for providing a user interface that appears in stages on visual content, according to several embodiments. [Figure 11B] This flowchart illustrates a method for providing a user interface that appears in stages on visual content, according to several embodiments. [Figure 12A] This figure shows an exemplary user interface, including an intelligent display of contextual information relating to a content series, according to some embodiments of the present disclosure. [Figure 12B] This figure shows an exemplary user interface, including an intelligent display of contextual information relating to a content series, according to some embodiments of the present disclosure. [Figure 12C] This figure shows an exemplary user interface, including an intelligent display of contextual information relating to a content series, according to some embodiments of the present disclosure. [Figure 12D] This figure shows an exemplary user interface, including an intelligent display of contextual information relating to a content series, according to some embodiments of the present disclosure. [Figure 12E] This figure shows an exemplary user interface, including an intelligent display of contextual information relating to a content series, according to some embodiments of the present disclosure. [Figure 13A] This flowchart illustrates an intelligent method for displaying contextual information about a content series, according to several embodiments. [Figure 13B] This flowchart illustrates an intelligent method for displaying contextual information about a content series, according to several embodiments. [Figure 13C] This flowchart illustrates an intelligent method for displaying contextual information about a content series, according to several embodiments. [Figure 14A]This figure shows an exemplary user interface for adding both content and non-content items to a viewing list, according to some embodiments of the present disclosure. [Figure 14B] This figure shows an exemplary user interface for adding both content and non-content items to a viewing list, according to some embodiments of the present disclosure. [Figure 14C] This figure shows an exemplary user interface for adding both content and non-content items to a viewing list, according to some embodiments of the present disclosure. [Figure 14D] This figure shows an exemplary user interface for adding both content and non-content items to a viewing list, according to some embodiments of the present disclosure. [Figure 14E] This figure shows an exemplary user interface for adding both content and non-content items to a viewing list, according to some embodiments of the present disclosure. [Figure 14F] This figure shows an exemplary user interface for adding both content and non-content items to a viewing list, according to some embodiments of the present disclosure. [Figure 14G] This figure shows an exemplary user interface for adding both content and non-content items to a viewing list, according to some embodiments of the present disclosure. [Figure 14H] This figure shows an exemplary user interface for adding both content and non-content items to a viewing list, according to some embodiments of the present disclosure. [Figure 15A] This flowchart illustrates a user interface method for adding both content and non-content items to a viewing list, according to several embodiments. [Figure 15B] This flowchart illustrates a user interface method for adding both content and non-content items to a viewing list, according to several embodiments. [Figure 16]This is a functional block diagram of an electronic device configured according to the principles of various embodiments described, according to some embodiments of this disclosure. [Figure 17] This is a functional block diagram of an electronic device configured according to the principles of various embodiments described, according to some embodiments of this disclosure. [Figure 18] This is a functional block diagram of an electronic device configured according to the principles of various embodiments described, according to some embodiments of this disclosure. [Figure 19] This is a functional block diagram of an electronic device configured according to the principles of various embodiments described, according to some embodiments of this disclosure. [Figure 20] This is a functional block diagram of an electronic device configured according to the principles of various embodiments described, according to some embodiments of this disclosure. [Modes for carrying out the invention]

[0007] The following description of the embodiments refers to accompanying drawings that constitute a portion of the embodiments, illustrating specific embodiments that can be implemented. It should be understood that other embodiments may be used and structural modifications may be implemented without departing from the scope of the disclosed embodiments.

[0008] Example device Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device, such as a mobile phone, which also includes other functions, such as PDA functionality and / or music playback functionality. Exemplary embodiments of portable multifunction devices include, without limitation, the iPhone®, iPod Touch®, and iPad® devices of Apple Inc., Cupertino, California. Other portable electronic devices, such as laptop or tablet computers with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads), may also be optionally used. Also, in some embodiments, it should be understood that the device is not a portable communication device but a desktop computer or television with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). In some embodiments, the device does not have a touchscreen display and / or touchpad, but rather can output display information (e.g., the user interfaces of this disclosure) for display on another display device and can receive input information from another input device having one or more input mechanisms (e.g., one or more buttons, touchscreen displays and / or touchpads). In some embodiments, the device has a display but can receive input information from another input device having one or more input mechanisms (e.g., one or more buttons, a touchscreen display and / or a touchpad).

[0009] The following discussion describes an electronic device comprising a display and a touch-sensitive surface. However, it should be understood that this electronic device optionally includes one or more other physical user interface devices such as a physical keyboard, mouse, and / or joystick. Furthermore, as stated above, it should be understood that the described electronic device, display, and touch-sensitive surface are optionally distributed among two or more devices. Therefore, as used in this disclosure, information displayed on or by an electronic device may optionally be used to describe information output by a display electronic device on another display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received on an electronic device (e.g., touch input received on the touch-sensitive surface of the electronic device) may optionally be used to describe input received on another input device. From this other input device, the electronic device receives input information.

[0010] The device generally supports a variety of applications, including drawing applications, presentation applications, word processing applications, website creation applications, disk authoring applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, training support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music playback applications, TV browsing applications, and / or digital video playback applications.

[0011] Various applications running on this device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and the corresponding information displayed on the device are optionally adjusted and / or modified from one application to the next, and / or within the corresponding applications. In this way, the device's common physical architecture (such as the touch-sensitive surface) optionally supports various applications that have an intuitive and transparent user interface for the user.

[0012] Here, we focus on embodiments of portable or non-portable devices equipped with a touch-sensitive display. However, as described above, these devices do not necessarily have to include a touch-sensitive display or a display. Figure 1A is a block diagram of a portable or non-portable multifunctional device 100 equipped with a touch-sensitive display 112 according to some embodiments. The touch-sensitive display 112 may be referred to as a “touchscreen” for convenience and is known or may be referred to as a touch-sensitive display system. Device 100 includes a memory 102 (optionally including one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input or control devices 116, and an external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more intensity sensors 165 for detecting the intensity of contact on Device 100 (e.g., a touch-sensitive surface such as the touch-sensitive display system 112 of Device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile output on Device 100 (e.g., generating tactile output on a touch-sensitive surface such as the touch-sensitive display system 112 of Device 100 or the touchpad 355 of Device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0013] As used herein and in the claims, the term “strength” of contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of contact (e.g., finger contact) on the touch-sensitive surface, or a substitute for the force or pressure of contact on the touch-sensitive surface. The strength of contact has a numerical range, including at least four different numerical values, and more typically including hundreds or more different numerical values ​​(e.g., at least 256). The strength of contact is determined (or measured) optionally using various methods and various sensors, or combinations of sensors. For example, one or more sensors placed below or adjacent to the touch-sensitive surface are optionally used to measure forces at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted average) to determine the estimated force of contact. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and / or change in the contact area detected on the touch-sensing surface, the capacitance and / or change in the touch-sensing surface adjacent to the contact, and / or the resistance and / or change in the touch-sensing surface adjacent to the contact may be optionally used as a substitute for the force or pressure of the contact on the touch-sensing surface. In some embodiments, the substitute measurement of the force or pressure of the contact is used directly to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some embodiments, the substitute measurement of the force or pressure of the contact is converted to an estimated force or pressure, and this estimated force or pressure is used to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure).

[0014] As used herein and in the claims, the term “tactile output” means a physical displacement of the device relative to its previous position, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, which will be detected by the user through the user’s sense of touch. For example, in a situation where the device or a component of the device is in contact with the touch-sensitive surface of the user (e.g., the user’s fingers, palm, or other part of their hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical properties of the device or a component of the device. For example, the movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) will be optionally interpreted by the user as a “down-click” or “up-click” of a physical actuator button. In some cases, the user will feel a tactile sensation such as a “down-click” or “up-click” even when there is no movement of a physical actuator button associated with a touch-sensitive surface that has been physically pressed (e.g., displaced) by the user’s movement. As another example, movement of a touch-sensitive surface can be optionally interpreted or perceived by the user as "roughness" of the touch-sensitive surface, even when there is no change in the smoothness of the touch-sensitive surface. Such user interpretations of touch are based on the user's individual sensory perception, but there are many touch sensory perceptions common to the majority of users. Therefore, when a tactile output is described as corresponding to a user's specific sensory perception (e.g., "up-click," "down-click," "roughness"), unless otherwise stated, the generated tactile output corresponds to the physical displacement of the device or its components that produce the described sensory perception of a typical (or average) user.

[0015] Device 100 is merely one embodiment of a portable or non-portable multifunctional device, and it should be understood that Device 100 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of components. The various components shown in Figure 1A are implemented in the form of hardware, software, or a combination of both hardware and software, including one or more signal processing circuits and / or application-specific integrated circuits. Furthermore, the various components shown in Figure 1A may optionally be implemented across two or more devices, such as display and audio circuits on a display device, a touch-sensing surface on an input device, and the remaining components on Device 100. In such embodiments, Device 100 may optionally communicate with, or optionally be optionally included within, the display and / or input device, the various components described herein relating to the display and / or input devices and the remaining display and / or input devices within Device 100, in order to facilitate the operation of the system described herein.

[0016] Memory 102 optionally includes high-speed random-access memory and optionally includes non-volatile memory such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile semiconductor memory devices. Access to memory 102 by other components of device 100, such as the CPU 120 and peripheral interface 118, is optionally controlled by the memory controller 122.

[0017] The input and output peripherals of this device can be connected to the CPU 120 and memory 102 using the peripheral interface 118. One or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 in order to perform various functions for device 100 and to perform data processing.

[0018] In some embodiments, the peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0019] The RF (radio frequency) circuit 108 transmits and receives RF signals, also known as electromagnetic signals. The RF circuit 108 converts electrical signals to electromagnetic signals, or electromagnetic signals to electrical signals, and communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 108 optionally includes, but is not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identification module (SIM) card, memory, and other well-known circuits for performing the above functions. The RF circuit 108 optionally communicates wirelessly with networks such as the Internet, also known as the Internet of Things (WWW), intranets such as cellular telephone networks and / or wireless networks, wireless local area networks (LANs) and / or metropolitan area networks (MANs), and other devices.Wireless communication uses any and all of the following communication standards, protocols, and technologies: Global System for Mobile Communications (GSM) (registered trademark), Extended Data GSM (EDGE), High-Speed ​​Downlink Packet Connection (HSDPA), High-Speed ​​Uplink Packet Connection (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), Long-Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth (registered trademark), Wireless Fidelity (Wi-Fi) (registered trademark) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, and / or IEEE 802.11g) Examples of suitable communication protocols include, but are not limited to, 802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, protocols for e-mail (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Use Extension (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocols, including those not yet developed as of the filing date of this document.

[0020] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral interface 118, converts the audio data into an electrical signal, and transmits the electrical signal to the speaker 111. The speaker 111 converts the electrical signal into human audible sound waves. The audio circuit 110 also receives the electrical signal converted from the sound waves by the microphone 113. The audio circuit 110 converts the electrical signal into audio data and sends the audio data to the peripheral interface 118 for processing. The audio data is optionally taken in by the peripheral interface 118 from memory 102 and / or RF circuit 108 and / or sent to memory 702 and / or RF circuit 708. In some embodiments, the audio circuit 110 further includes a headset jack (e.g., 212 in Figure 2). The headset jack provides an interface between the audio circuit 110 and a detachable audio input / output peripheral, such as output-only headphones or a headset that has both output (e.g., headphones for one or both ears) and input (e.g., a microphone).

[0021] The I / O subsystem 106 connects the input / output peripherals of device 100, such as the touchscreen 112 and other input control devices 116, to the peripheral interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. One or more input controllers 160 receive / transmit electrical signals to / from the other input or control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons), dials, slider switches, joysticks, click wheels, etc. In some alternative embodiments, one or more input controllers 160 are optionally connected to (or not connected to) any of the following: a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. One or more buttons (e.g., 208 in Figure 2) optionally include up / down buttons for adjusting the volume of speaker 111 and / or microphone 113. One or more buttons optionally include push buttons (e.g., 206 in Figure 2).

[0022] The touch-sensitive display 112 provides input and output interfaces between the device and the user. As described above, the touch-sensing operation and display operation of the touch-sensitive display 112 are optionally separated from each other, so that the display device is used for display purposes and the touch-sensing surface (whether or not it is a display) is used for input detection purposes. Accordingly, the components and functions described are modified. However, for the sake of brevity, the following description is provided with reference to the touch-sensitive display. The display controller 156 receives and / or transmits electrical signals to and from the touchscreen 112. The touchscreen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, images, and any combination thereof (collectively referred to as “graphics”). In some embodiments, some or all of the visual output corresponds to user interface objects.

[0023] The touchscreen 112 has a touch-sensing surface, sensor, or set of sensors that accept user input based on tactile and / or tactile contact. The touchscreen 112 and the display controller 156 (along with any associated modules and / or instruction sets in memory 102) detect contact (and any action or interruption of contact) on the touchscreen 112 and translate the detected contact into interaction with user interface objects displayed on the touchscreen 112 (e.g., one or more soft keys, icons, web pages, or images). In one exemplary embodiment, the contact between the touchscreen 112 and the user corresponds to the user's finger.

[0024] The touchscreen 112 optionally uses LCD (liquid crystal display) technology, LPD (polymer light-emitting display) technology, or LED (light-emitting diode) technology, but other display technologies are used in other embodiments. The touchscreen 112 and display controller 156 optionally detect contact and any movement or interruption using any of several currently known or future-developed touch sensing technologies, including but not limited to capacitive technology, resistive technology, infrared technology, and surface ultrasonic technology, as well as other proximity sensor arrays or other elements for determining one or more contact points with the touchscreen 112. In one exemplary embodiment, projected mutual capacitance sensing technology is used, as seen in iPhone®, iPod Touch®, and iPad® from Apple Inc. of Cupertino, California.

[0025] The touchscreen 112 optionally has a video resolution greater than 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. The user optionally touches the touchscreen 112 using any suitable object or accessory, such as a stylus or finger. In some embodiments, the user interface is designed to function primarily with finger-based touch and gestures, which may be less precise than stylus-based input due to the larger contact area of ​​the finger on the touchscreen. In some embodiments, the device translates rough finger-based input into precise pointer / cursor positions or commands to perform user-desired actions.

[0026] In some embodiments, in addition to the touchscreen, device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touchscreen, does not display a visual output. The touchpad is optionally a touch-sensitive surface separate from the touchscreen 112, or an extension of the touch-sensitive surface formed by the touchscreen.

[0027] Device 100 also includes a power system 162 for supplying power to various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharge system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., light-emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of power within a portable or non-portable device.

[0028] Device 100 also optionally includes one or more optical sensors 164. Figure 1A shows an optical sensor coupled to an optical sensor controller 158 in the I / O subsystem 106. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The optical sensor 164 receives light from the environment projected through one or more lenses and converts that light into data representing an image. Used in conjunction with an imaging module 143 (also referred to as a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the back of Device 100, opposite the touchscreen display 112 on the front of the device, so that the touchscreen display can be enabled as a viewfinder for acquiring still images and / or video. In some embodiments, another optical sensor is located on the front of the device to optionally obtain an image of the user for video conferencing while the user is viewing other video conference participants on the touchscreen display.

[0029] Device 100 also optionally includes one or more contact strength sensors 165. Figure 1A shows a contact strength sensor coupled to a strength sensor controller 159 in the I / O subsystem 106. The contact strength sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electric force sensors, pressure-power sensors, optical force sensors, capacitive touch-sensing surfaces, or other strength sensors (e.g., sensors used to measure the force (or pressure) of contact on a touch-sensing surface). The contact strength sensor 165 receives contact strength information (e.g., pressure information or a proxy for pressure information) from the environment. In some embodiments, at least one contact strength sensor is located juxtaposed with or in close proximity to a touch-sensing surface (e.g., a touch-sensing display system 112). In some embodiments, at least one contact strength sensor is located on the back of Device 100, opposite the touchscreen display 112 located on the front of Device 100.

[0030] Device 100 also optionally includes one or more proximity sensors 166. Figure 1A shows a proximity sensor 166 connected to a peripheral interface 118. Alternatively, the proximity sensor 166 is connected to an input controller 160 in the I / O subsystem 106. In some embodiments, if the multifunction device is positioned near the user's ear (for example, when the user is making a phone call), the proximity sensor is turned off and the touchscreen 112 is disabled.

[0031] Device 100 also optionally includes one or more tactile output generators 167. Figure 1A shows a tactile output generator coupled to a tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 optionally includes one or more electroacoustic devices such as a speaker or other sound component, and / or electromechanical devices that convert energy into linear motion, such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output component (e.g., a component that converts an electrical signal into a tactile output on the device). The contact intensity sensor 165 receives a tactile feedback generation command from the tactile feedback module 133 and generates a tactile output on device 100 that can be sensed by the user of device 100. In some embodiments, at least one tactile output generator is positioned juxtaposed with or adjacent to a touch-sensing surface (e.g., a touch-sensing display system 112) and optionally generates a tactile output by moving the touch-sensing surface vertically (e.g., inward / outward from the surface of device 100) or laterally (e.g., in the forward / backward direction on the same plane as the surface of device 100). In some embodiments, at least one tactile output generator sensor is positioned on the back of device 100, opposite the touchscreen display 112 which is positioned on the front of device 100.

[0032] Device 100 also optionally includes one or more accelerometers 168. Figure 1A shows an accelerometer 168 connected to a peripheral interface 118. Alternatively, the accelerometer 168 is optionally connected to an input controller 160 in the I / O subsystem 106. In some embodiments, information is displayed on the touchscreen display in portrait view or landscape view based on an analysis of data received from one or more accelerometers. Device 100 optionally includes, as necessary, a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information about the location and orientation of Device 100 (e.g., portrait or landscape), in addition to the accelerometer(s) 168.

[0033] In some embodiments, the software components stored in memory 102 include an operating system 126, a communications module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application (instruction set) 136. Furthermore, in some embodiments, as shown in Figures 1A and 3, memory 102 stores device / global internal state 157. The device / global internal state 157 includes one or more of the following: active application state, indicating which application is active, if any applications are currently active; display state, indicating which applications, views, or other information occupy various areas of the touchscreen display 112; sensor state, including information obtained from various sensors and input control devices 116 of the device; and position information relating to the location and / or orientation of the device.

[0034] An operating system 126 (for example, an embedded operating system such as Darwin®, RTXC®, LINUX®, UNIX®, OS X®, WINDOWS®, or VxWorks®) includes various software components and / or drivers for controlling and managing common system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.

[0035] The communication module 128 facilitates communication with other devices via one or more external ports 124 and includes various software components for processing data received by the RF circuit 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire®, etc.) are adapted to connect to other devices directly or indirectly via a network (e.g., the Internet, Wi-Fi, etc.). In some embodiments, the external ports are multi-pin (e.g., 30-pin) connectors identical to, or similar to, and / or compatible with, the 30-pin connector used on iPod (a registered trademark of Apple Inc.) devices.

[0036] The contact / motion module 130 optionally detects contact with the touchscreen 112 (in conjunction with the display controller 156) and contact with other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger being lowered), determining the intensity of contact (e.g., the force or pressure of contact, or a substitute for the force or pressure of contact), determining whether there is movement of contact and tracking movement across the touch-sensitive surface (e.g., detecting one or more events of a finger being dragged), and determining whether contact has stopped (e.g., detecting a finger being lifted or an interruption of contact). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of a contact point represented by a series of contact data optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. These actions are optionally applied to a single contact (e.g., a single finger contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger contacts). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.

[0037] In some embodiments, the contact / movement module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by the user (for example, whether the user has "clicked" on an icon). In some embodiments, at least a subset of the intensity thresholds is determined according to software parameters (for example, the intensity thresholds are not determined by activation thresholds of a particular physical actuator and can be adjusted without changing the physical hardware of device 100). For example, the mouse "click" threshold for a trackpad or touchscreen display can be set to one of a wide range of default thresholds without changing the trackpad or touchscreen display hardware. In addition, in some implementations, the user of the device is provided with software settings to adjust one or more of the set of intensity thresholds (for example, by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds immediately after a system-level click of the "intensity" parameter).

[0038] The contact / motion module 130 optionally detects gesture input from the user. Different gestures on the touch-sensitive surface have different contact patterns and contact intensities. Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture involves detecting a finger-down event, followed by a finger-up (lift-off) event at the same location (or substantially the same location) as the finger-down event (e.g., at the icon location). In another embodiment, detecting a finger-swipe gesture on the touch-sensitive surface involves detecting a finger-down event, followed by one or more finger-drag events, and then a finger-up (lift-off) event.

[0039] The graphics module 132 includes various known software components for rendering and displaying graphics on the touchscreen 112 or other display, including components for modifying the visual effects of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual properties). As used herein, the term “graphics” includes, but is not limited to, any objects that can be displayed to a user, such as text, web pages, icons (including user interface objects such as soft keys), digital images, videos, and animations.

[0040] In some embodiments, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes specifying the graphics to be displayed, along with coordinate data and other graphic property data, from an application or the like as needed, and generates screen image data to be output to the display controller 156.

[0041] The haptic feedback module 133 includes various software components for generating instructions used by a haptic output generator(s) 167 to generate haptic outputs at one or more locations on the device 100 in response to user interaction with the device 100.

[0042] The text input module 134 is optionally a component of the graphics module 132 and provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other applications that require text input).

[0043] The GPS module 135 determines the device's location and provides this information for use in various applications (for example, to the telephone 138 for use in location-based dialing, to the camera 143 as picture / video metadata, and to applications that provide location-based services such as weather widgets, local yellow pages widgets, and map / navigation widgets).

[0044] Application 136 optionally includes the following modules (or sets of instructions), or subsets or supersets thereof: • Contact module 137 (sometimes also called the address book or contact list), • Telephone module 138, • Video conferencing module 139, • Email client module 140, • Instant messaging (IM) module 141, • Training support module 142, • Camera module 143 for still images and / or video images, Image management module 144, • Browser module 147, • Calendar module 148, A widget module 149 optionally includes one or more of the following: weather widget 149-1, stock price widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, other widgets obtained by the user, and user-created widgets 149-6. • Widget creation module 150 for creating user-created widget 149-6. • Search module 151, • A video and music playback module 152, optionally composed of a video playback module and a music playback module. • Memo module 153, • Map module 154, • Online video module 155.

[0045] Examples of other applications 136 that may be optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, Java®-enabled applications, encryption, digital rights management, speech recognition, and speech duplication.

[0046] Together with the touchscreen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (stored, for example, in the application internal state 192 of the contact module 137 in memory 102 or memory 370), which includes adding one or more names to the address book, removing one or more names from the address book, associating one or more telephone numbers, one or more email addresses, one or more addresses, or other information with names, associating images with names, categorizing and sorting names, providing telephone numbers or email addresses to initiate and / or facilitate communication by telephone 138, video conferencing 139, email 140, or IM 141, etc.

[0047] Together with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the telephone module 138 is optionally used to input a telephone number and a corresponding set of characters, access one or more telephone numbers in the address book 137, modify an entered telephone number, dial a corresponding telephone number, conduct a conversation, and disconnect or hang up the phone when the conversation is complete. As described above, wireless communication optionally uses one of several communication standards, protocols, and technologies.

[0048] Together with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touchscreen 112, display controller 156, light sensor 164, light sensor controller 158, contact module 130, graphics module 132, text input module 134, contact list 137, and telephone module 138, the video conferencing module 139 includes executable commands for starting, conducting, and ending video conferences between the user and one or more other participants, according to user instructions.

[0049] Together with the RF circuit 108, touchscreen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the email client module 140 includes executable commands for creating, sending, receiving, and managing emails in response to user instructions. Together with the image management module 144, the email client module 140 makes it very easy to create and send emails containing still or video images captured by the camera module 143.

[0050] Together with the RF circuit 108, touchscreen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the instant messaging module 141 includes executable instructions for entering instant messages and corresponding strings, modifying entered characters, sending corresponding instant messages (e.g., using the Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocol for telephone-based instant messaging, or using XMPP, SIMPLE, or IMPS for internet-based instant messaging), and receiving and displaying instant messages. In some embodiments, transmitted and / or received instant messages optionally include graphics, photographs, audio files, video files, and / or other attachments, as supported by MMS and / or Enhanced Messaging Services (EMS). As used herein, “instant messaging” refers to both telephone-based messages (e.g., messages sent using SMS or MMS) and internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0051] Together with the RF circuit 108, touchscreen 112, display controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music playback module 146, the training support module 142 includes executable commands for generating training (e.g., having time, distance, and / or calorie consumption targets), communicating with training sensors (sports devices), receiving training sensor data, calibrating sensors used to monitor training, selecting and playing music for training, and displaying, storing, and transmitting training data.

[0052] Together with the touchscreen 112, display controller 156, light sensor(s) 164, light sensor controller 158, contact module 130, graphics module 132, and image management module 144, the camera module 143 includes executable instructions for capturing still images or videos (including video streams) and storing them in memory 102, modifying the characteristics of still images or videos, or deleting still images or videos from memory 102.

[0053] In relation to the touchscreen 112, display controller 156, contact module 130, graphics module 132, text input module 134, and camera module 143, the image management module 144 includes executable commands for arranging, modifying (e.g., editing), and otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or videos.

[0054] In association with the RF circuit 108, touchscreen 112, display system controller 156, contact module 130, graphics module 132, and text input module 134, the browser module 147 includes executable instructions for browsing the Internet, following user instructions, including navigating, linking, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.

[0055] In conjunction with the RF circuit 108, touchscreen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying, and storing a calendar and data associated with the calendar (e.g., calendar items, to-do lists, etc.) in accordance with user instructions.

[0056] Along with the RF circuit 108, touchscreen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, and browser module 147, the widget module 149 is a mini-application that can be optionally downloaded and used by the user (e.g., weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5), or a mini-application created by the user (e.g., user-created widget 149-6). In some embodiments, the widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript® file. In some embodiments, the widget includes an XML (Extensible Markup Language) file and a JavaScript® file (e.g., a Yahoo!® widget).

[0057] Together with the RF circuit 108, touchscreen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, and browser module 147, the widget creation module 150 is optionally used by the user to create widgets (for example, to convert a user-specified area of ​​a web page into a widget).

[0058] In association with the touchscreen 112, display system controller 156, contact module 130, graphics module 132, and text input module 134, the search module 151 includes executable instructions for navigating text, music, sound, images, videos, and / or other files in memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) according to user instructions.

[0059] In association with the touchscreen 112, display system controller 156, contact module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, and browser module 147, the video and music playback module 152 includes executable instructions that allow the user to download and play recorded music or other sound files stored in one or more file formats such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing video (on the touchscreen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player such as an iPod (a registered trademark of Apple Inc.).

[0060] Together with the touchscreen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the memo module 153 includes executable commands for creating and managing memos, to-do lists, etc., according to user instructions.

[0061] Together with the RF circuit 108, touchscreen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, the map module 154 optionally includes executable commands to receive, display, modify, and store maps and map-related data (e.g., driving directions, data about shops and other points of interest in or near a specific location, and other location-based data) in accordance with user instructions.

[0062] In relation to the touchscreen 112, display system controller 156, contact module 130, graphics module 132, audio circuit mechanism 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, the online video module 155 includes instructions that enable the user to access, browse, receive (e.g., by streaming and / or downloading), play (e.g., on the touchscreen or on an external display connected via external port 124), send emails containing links to specific online videos, and manage them in other ways. In some embodiments, an instant messaging module 141, rather than the email client module 140, is used to send links to specific online videos.

[0063] Each of the modules and applications identified above corresponds to an executable instruction set and a method of this application (e.g., a method performed by a computer and other information processing methods described herein) that perform one or more of the above functions. These modules (i.e., instruction sets) do not need to be implemented as separate software programs, procedures, or modules, and therefore various subsets of these modules can be optionally combined or rearranged in various embodiments. In some embodiments, memory 102 optionally stores a subset of the identified modules and data structures described above. Furthermore, memory 102 optionally stores additional modules and data structures not described above.

[0064] In some embodiments, device 100 is a device in which the operation of a default set of functions on the device is performed exclusively via a touchscreen and / or touchpad (whether included in device 100 or on another device such as an input device). By using a touchscreen and / or touchpad as the primary input control device for the operation of device 100, the number of physical input control devices on device 100 (such as push buttons, dials, and similar devices) is optionally reduced.

[0065] A default set of functions, performed exclusively via the touchscreen and / or touchpad, optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 from any user interface displayed on the device 100 to the main menu, home menu, or root menu. In such embodiments, the “menu button” is implemented using the touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device instead of a touchpad.

[0066] Figure 1B is a block diagram showing exemplary components for event processing according to several embodiments. In some embodiments, memory 102 (in Figure 1A) or 370 (in Figure 3) includes an event sorter 170 (e.g., in operating system 126) and corresponding applications 136-1 (e.g., any of the applications 137-151, 155, and 380-390 described above).

[0067] The event sorter 170 receives event information and determines the application 136-1 and the application view 191 of application 136-1 to which the event information will be distributed. The event sorter 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, application 136-1 includes an application internal state 192 that indicates the current application view(s) displayed on the touch-sensitive display 112 when the application is active or running. In some embodiments, the device / global internal state 157 is used by the event sorter 170 to determine which application is currently active, and the application internal state 192 is used by the event sorter 170 to determine the application view 191 to which the event information will be distributed.

[0068] In some embodiments, the application internal state 192 includes additional information such as resume information used when the application 136-1 resumes execution, user interface state information indicating that information is displayed or ready to be displayed by the application 136-1, state queues to allow the user to return to a previous state or view of the application 136-1, and redo / undo queues for actions previously performed by the user.

[0069] The event monitor 171 receives event information from the peripheral device interface 118. The event information includes information about sub-events (for example, a user touch on the touch-sensitive display 112 as part of a multi-touch gesture). The peripheral device interface 118 transmits information received from the I / O subsystem 106 or from sensors such as the proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via the audio circuit mechanism 110). The information received by the peripheral device interface 118 from the I / O subsystem 106 includes information from the touch-sensitive display 112 or touch-sensitive surface.

[0070] In some embodiments, the event monitor 171 sends requests to the peripheral interface 118 at predetermined intervals. In response, the peripheral interface 118 sends event information. In other embodiments, the peripheral interface 118 sends event information only when there is a significant event (e.g., exceeding a predetermined noise threshold and / or receiving input for longer than a predetermined time).

[0071] In some embodiments, the event sorter 170 also includes a hit view determination module 172 and / or an active event recognition determination module 173.

[0072] The hit view determination module 172 provides a software procedure for determining where in one or more views a sub-event occurred when the touch-sensitive display 112 displays two or more views. A view consists of a control unit and other elements that the user can see on the display.

[0073] Another aspect of the user interface associated with an application is a set of views, which may be referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures are performed. The application views (of each application) in which touches are detected optionally correspond to the program level within the application's program hierarchy or view hierarchy. For example, the lowest level view in which touches are detected is optionally called a hit view, and the set of events recognized as appropriate inputs is optionally determined, at least in part, based on the hit view of the first touch that initiates a touch-based gesture.

[0074] The hit view determination module 172 receives information associated with sub-events of touch-based gestures. If the application has multiple views organized hierarchically, the hit view determination module 172 identifies the hit view as the lowest-level view in the hierarchy that should process the sub-events. In most situations, the hit view is the lowest-level view where the first sub-event (i.e., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by the hit view determination module, the hit view typically accepts all sub-events associated with the same touch or input source that identified it as a hit view.

[0075] The active event recognition determination module 173 determines which view(s) in the view hierarchy should receive a particular sequence of sub-events. In some embodiments, the active event recognition determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, the active event recognition determination module 173 determines that all views, including the physical location of the sub-event, are actively involved views, and therefore all actively involved views should receive a particular sequence of sub-events. In other embodiments, even if the touch sub-event is entirely confined to a region associated with a particular view, higher-level views in the hierarchy will remain actively involved views.

[0076] The event dispatcher module 174 transmits event information to an event recognition unit (e.g., an event recognition unit 180). In embodiments including an active event recognition unit determination module 173, the event dispatcher module 174 distributes the event information to the event recognition unit determined by the active event recognition unit determination module 173. In some embodiments, the event dispatcher module 174 stores the event information acquired by each event receiving unit module 182 in an event queue.

[0077] In some embodiments, the operating system 126 includes an event sorter 170. Alternatively, application 136-1 includes an event sorter 170. In yet another embodiment, the event sorter 170 is a standalone module or part of another module stored in memory 102, such as a contact / motion module 130.

[0078] In some embodiments, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each containing instructions for handling touch events occurring within each view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognition units 180. Typically, each application view 191 includes a plurality of event recognition units 180. In other embodiments, one or more of the event recognition units 180 are part of a separate module, such as a user interface kit (not shown) or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, each event handler 190 includes one or more event data 179 received from a data updater 176, an object updater 177, a GUI updater 178, and / or an event sorter 170. The event handler 190 optionally uses or calls the data updater 176, object updater 177, or GUI updater 178 to update the application's internal state 192. Alternatively, one or more of the application views 191 include one or more respective event handlers 190. In some embodiments, one or more of the data updater 176, object updater 177, and GUI updater 178 are included within each application view 191.

[0079] Each event recognition unit 180 receives event information (e.g., event data 179) from the event sorter 170 and identifies an event from that event information. The event recognition unit 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event recognition unit 180 further includes metadata 183 and at least a subset of event distribution instructions 188 (optionally including sub-event distribution instructions).

[0080] The event receiver 182 receives event information from the event sorter 170. The event information includes, for example, information about sub-events such as touches or movement of touches. Depending on the sub-event, the event information may also include additional information such as the location of the sub-event. When the sub-event involves movement of a touch, the event information may optionally further include the velocity and direction of the sub-event. In some embodiments, an event includes rotation of the device from one direction to another (for example, from portrait orientation to landscape orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also called the device orientation).

[0081] The event comparison unit 184 compares event information with a default event or sub-event definition and determines an event or sub-event, or determines or updates the state of an event or sub-event based on the comparison. In some embodiments, the event comparison unit 184 includes an event definition 186. The event definition 186 includes an event definition (e.g., a default sequence of sub-events), such as event 1 (187-1) and event 2 (187-2). In some embodiments, sub-events within event 187 include, for example, touch start, touch end, touch movement, touch cancellation, and multiple touches. In one embodiment, the definition of event 1 (187-1) is a double tap on a displayed object. A double tap includes, for example, a first touch (touch start) for a predetermined stage on the displayed object, a first lift-off (touch end) for the predetermined stage, a second touch (touch start) for the predetermined stage on the displayed object, and a second lift-off (touch end) for the predetermined stage. In another embodiment, the definition of event 2(187-2) is a drag on a displayed object. Dragging includes, for example, touching (or contacting) a predetermined stage on the displayed object, moving the touch across the touch-sensitive display 112, and lifting off the touch (end of touch). In some embodiments, the event also includes information about one or more associated event handlers 190.

[0082] In some embodiments, the event definition 187 includes an event definition for each user interface object. In some embodiments, the event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view where three user interface objects are displayed on a touch-sensitive display 112, when a touch is detected on the touch-sensitive display 112, the event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with its respective event handler 190, the event comparison unit uses the results of the hit test to determine which event handler 190 needs to be activated. For example, the event comparison unit 184 selects the event handler associated with the object that triggers the sub-event and the hit test.

[0083] In some embodiments, the definition of each event 187 also includes a delay effect that delays the transmission of event information until it is determined whether the sequence of sub-events corresponds to the event type of the event recognition unit.

[0084] If each event recognition unit 180 determines that a series of sub-events does not match any of the events in the event definition 186, each event recognition unit 180 enters an event impossible, event failed, or event terminated state and thereafter ignores subsequent sub-events of the touch-based gesture. In this situation, any other event recognition units that remain active for the hit view continue to track and process the sub-events of the ongoing touch-based gesture.

[0085] In some embodiments, each event recognition unit 180 includes metadata 183 having configurable properties, flags, and / or lists that indicate how the event distribution system performs sub-event distribution to the event recognition unit in which it is actively involved. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists that indicate how the event recognition units interact with each other, or can interact with each other bidirectionally. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are distributed to various levels within the view hierarchy or program hierarchy.

[0086] In some embodiments, each event recognition unit 180 activates an event handler 190 associated with an event when one or more specific sub-events of an event are recognized. In some embodiments, each event recognition unit 180 distributes event information associated with the event to the event handler 190. Activating the event handler 190 is distinct from sending (and delaying sending) the sub-events to the respective hit view. In some embodiments, the event recognition unit 180 throws a flag associated with the recognized event, and the event handler 190 associated with the flag catches the flag and performs default processing.

[0087] In some embodiments, the event distribution command 188 includes a sub-event distribution command that distributes event information about a sub-event without activating an event handler. Instead, the sub-event distribution command distributes the event information to an event handler or an actively involved view associated with a set of sub-events. The event handler associated with the set of sub-events or the actively involved view receives the event information and performs predetermined processing.

[0088] In some embodiments, the data updater 176 creates and updates data used in application 136-1. For example, the data updater 176 updates telephone numbers used in contact module 137 or stores video files used in video playback module 145. In some embodiments, the object updater 177 creates and updates objects used in application 136-1. For example, the object updater 176 creates new user interface objects or updates the position of user interface objects. The GUI updater 178 updates the GUI. For example, the GUI updater 178 prepares display information and sends it to graphics module 132 for display on touch-sensitive display.

[0089] In some embodiments, the event handler(s) 190 includes, or has access to, a data updater 176, an object updater 177, and a GUI updater 178. In some embodiments, the data updater 176, the object updater 177, and the GUI updater 178 are included in one module of each application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0090] The aforementioned discussion of event processing of user touches on touch-sensitive displays and / or touchpads also applies to other forms of user input for operating the multifunction device 100 using input devices, but it will be understood that not all of these begin on the touchscreen. For example, mouse movements and mouse button presses optionally matched to single or multiple keyboard presses or holds, touch movements such as taps, drags, and scrolls on a touchpad, pen stylus input, device movement, verbal instructions, detected eye movements, biometric input, and / or any combination thereof may be optionally used as inputs corresponding to sub-events that define the event to be recognized.

[0091] Figure 2 shows a portable or non-portable multifunctional device 100 having a touchscreen 112 according to several embodiments. As described above, the multifunctional device 100 is described to have various structures (e.g., touchscreen 112, speaker 111, accelerometer 168, microphone 113, etc.). However, these structures are understood to belong to a different device at will. For example, display-related structures (e.g., display, speaker, etc.) and / or functions may at will belong to a different display device, input-related structures (e.g., touch-sensing surface, microphone, accelerometer, etc.) and / or functions may at will belong to a different input device, and the remaining structures and / or functions may at will belong to the multifunctional device 100.

[0092] The touchscreen 112 optionally displays one or more graphics within the user interface (UI) 200. In the embodiments described later and in this embodiment, the user can select one or more graphics by making gestures on the graphics using, for example, one or more fingers 202 (not shown in the figure to an exact scale) or one or more styluses 203 (not shown in the figure to an exact scale). In some embodiments, the selection of one or more graphics occurs when the user discontinues contact with one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, right to left, upward, and / or downward), and / or rolling of a finger in contact with the device 100 (from right to left, left to right, upward, and / or downward). In some implementations or situations, accidental contact with a graphic does not result in the selection of a graphic. For example, if the gesture corresponding to selection is a tap, a swipe gesture (swiping over an application icon) will not select the corresponding application.

[0093] Device 100 also optionally includes one or more physical buttons, such as a "Home" or menu button 204. As previously stated, the menu button 204 is optionally used to navigate to any application 136 within the set of applications that can be optionally run on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in the GUI displayed on the touchscreen 112.

[0094] In one embodiment, device 100 includes a touchscreen 112, a menu button 204, a push button 206 for turning the device on / off and locking the device, one or more volume buttons 208, a receiver identification module (SIM) card slot 210, a headset jack 212, and an external docking / charging port 124. The push button 206 is optionally used to turn the device on / off by pressing and holding the button for a predetermined time interval, and to lock and / or unlock the device, or to initiate an unlocking process, by pressing and releasing the button before the predetermined time interval has elapsed. In an alternative embodiment, device 100 also accepts verbal input through a microphone 113 to activate or deactivate certain functions. The device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of contact with the touchscreen 112 and / or one or more tactile output generators 167 for generating tactile output from the user of the device 100.

[0095] Figure 3 is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface according to several embodiments. Device 300 does not necessarily have to include a display and a touch-sensitive surface as described above, and rather, in some embodiments, optionally communicates with a display and a touch-sensitive surface on another device. In addition, device 300 does not have to be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia playback device (e.g., a television or set-top box), a navigation device, an educational device (e.g., a children's learning toy), a game system, or a control device (e.g., a home or commercial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. The communication buses 320 optionally include circuits (sometimes referred to as chipsets) that interconnect and control communication between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touchscreen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 (similar to the tactile output generator 167 described above with reference to Figure 1A) for generating tactile output on device 300, and a sensor 359 (e.g., an optical sensor, an accelerometer, a proximity sensor, a touch sensor, and / or a contact intensity sensor similar to the contact intensity sensor 165 described above with reference to Figure 1A). Memory 370 includes high-speed random-access memory, such as DRAM, SRAM, DDR RAM, or other random-access semiconductor memory devices, and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile semiconductor storage devices. Memory 370 optionally includes one or more storage devices located away from the CPU(s) 310.In some embodiments, memory 370 stores programs, modules, and data structures similar to, or subsets thereof, that are stored in memory 102 of the portable or non-portable multifunction device 100 (Figure 1A). Furthermore, memory 370 may store additional programs, modules, and data structures that are not present in memory 102 of the portable or non-portable multifunction device 100. For example, memory 370 of device 300 may optionally store a drawing module 380, a presentation module 382, ​​a document creation module 384, a website creation module 386, a disk authoring module 388, and / or a spreadsheet module 390, while memory 102 of the portable or non-portable multifunction device 100 (Figure 1A) does not optionally store these modules.

[0096] Each of the elements of Figure 3 identified above is optionally stored in one or more of the aforementioned memory devices. Each of the modules identified above corresponds to an instruction set for performing the function described above. The identified modules or programs (i.e., instruction sets) do not need to be implemented as separate software programs, procedures, or modules; therefore, in various embodiments, various subsets of these modules are optionally combined or otherwise rearranged. In some embodiments, memory 370 optionally stores subsets of the identified modules and data structures described above. Furthermore, memory 370 optionally stores additional modules and data structures not described above.

[0097] Figure 4 shows an exemplary user interface on a device (e.g., device 300 in Figure 3) that has a touch-sensitive surface 451 (e.g., tablet or touchpad 355 in Figure 3) separate from the display 450 (e.g., touchscreen display 112). Device 300 also includes one or more contact intensity sensors (e.g., one or more of sensors 357) for detecting the intensity of contact on the touch-sensitive surface 451, and / or one or more tactile output generators 359 for generating tactile output to the user of device 300.

[0098] Some of the following embodiments will be described with reference to input on a touchscreen display 112 (when the touch-sensing surface and the display are combined), but in some embodiments, the device detects input on a touch-sensing surface separate from the display, as shown in Figure 4. In some embodiments, this touch-sensing surface (e.g., 451 in Figure 4) has a principal axis (e.g., 452 in Figure 4) corresponding to a principal axis (e.g., 453 in Figure 4) on the display (e.g., 450). According to these embodiments, the device detects contact (e.g., 460 and 462 in Figure 4) with the touch-sensing surface 451 at locations corresponding to each location on the display (e.g., 460 corresponds to 468 and 462 corresponds to 470 in Figure 4). In this method, if the touch-sensitive surface is separate from the display, user input (e.g., touches 460 and 462, and their movement) detected by the device on the touch-sensitive surface (e.g., 451 in Figure 4) is used by the device to operate the user interface on the display of the multifunction device (e.g., 450 in Figure 4). It should be understood that a similar method may be optionally used for other user interfaces described herein.

[0099] Furthermore, while the following description primarily refers to finger input (e.g., finger touch, finger tap gesture, finger swipe gesture), it should be understood that in some embodiments, one or more of these finger inputs may be replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture may be optionally replaced with a mouse click (e.g., instead of touch), followed by cursor movement along the swipe path (e.g., instead of touch movement). In another embodiment, a tap gesture may be optionally replaced with a mouse click (e.g., instead of stopping touch detection after touch detection). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice may be used simultaneously or optionally, or that a mouse and finger touch may be used simultaneously.

[0100] As used herein, the term “focus selector” refers to an input element that indicates the current portion of the user interface that the user is interacting with. In some implementations, including a cursor or other location marker, the cursor functions as a “focus selector” when input (e.g., a press input) is detected on a touch-sensitive surface (e.g., the touchpad 355 in Figure 3, or the touch-sensitive surface 451 in Figure 4) and the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), and the particular user interface element is adjusted according to the detected input. In some implementations, including a touchscreen display (e.g., the touch-sensitive display system 112 in Figure 1A, or the touchscreen 112 in Figure 4A) that enables direct interaction with user interface elements on the touchscreen display, the contact detected on the touchscreen acts as a “focus selector” so that when input (e.g., a press input) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display, that particular user interface element is adjusted according to the detected input. In some implementations, focus is moved from one area of ​​the user interface to another without corresponding cursor movement or touch movement on the touchscreen (e.g., by moving focus from one button to another using the tab key or arrow keys). In these implementations, the focus selector moves in accordance with the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector as a whole is a user-controlled user interface element (or touch on the touchscreen display) that communicates the user's intended interaction with the user interface (e.g., by instructing the device to interact with the user interface element the user wishes to interact with).For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen), the position of the focus selector (e.g., cursor, touch, or selection box) above each button indicates (in contrast to other user interface elements displayed on the device's display) that the user is trying to activate that button.

[0101] In some embodiments described herein, one or more actions are performed in response to the detection of a gesture including each pressing input, or in response to the detection of each pressing input performed at each (or more) contact, each of which pressing inputs is detected, at least in part, on the detection of an increasing intensity of the contact (or more) above a pressing input intensity threshold. In some embodiments, each action is performed in response to the detection of an increasing intensity of the contact (e.g., a "downstroke" of each pressing input) above a pressing input intensity threshold. In some embodiments, the pressing input includes an increasing intensity of the contact above a pressing input intensity threshold and a decreasing intensity of the contact below a subsequent pressing input intensity threshold, and each action is performed in response to the detection of a decreasing intensity of the contact (e.g., an "upstroke" of each pressing input) below a subsequent pressing input threshold.

[0102] In some embodiments, the device employs intensity hysteresis to avoid accidental inputs, which may be referred to as "jitter," and the device defines or selects a hysteresis intensity threshold that has a predetermined relationship with a press input intensity threshold (for example, the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable ratio of the press input intensity threshold). Thus, in some embodiments, the press input includes an increase in the intensity of each contact above the press input intensity threshold, and a subsequent decrease in the intensity of the contact below the hysteresis intensity threshold corresponding to the press input intensity threshold, and each action is performed in response to the detection of a subsequent decrease in the intensity of each contact below that hysteresis intensity threshold (for example, an "upstroke" of each press input). Similarly, in some embodiments, a press input is detected only when the device detects an increase in contact intensity from an intensity below a hysteresis intensity threshold to an intensity above a press input intensity threshold, and optionally a decrease in subsequent contact intensity to an intensity below the hysteresis intensity, and each action is performed in response to the detection of that press input (e.g., an increase in contact intensity or a decrease in contact intensity, depending on the situation).

[0103] For the sake of clarity, the description of an action performed in response to a press input associated with a press input intensity threshold, or in response to a gesture including such press input, is that it is optionally triggered in response to the detection of any of the following: an increase in contact intensity above the press input intensity threshold, an increase in contact intensity from below the hysteresis intensity threshold to above the press input intensity threshold, a decrease in contact intensity below the press input intensity threshold, and / or a decrease in contact intensity below the hysteresis intensity threshold corresponding to the press input intensity threshold. Furthermore, in embodiments described as being performed in response to the detection of a decrease in contact intensity below the press input intensity threshold, the action is optionally performed in response to the detection of a decrease in contact intensity below the hysteresis intensity threshold, which is corresponding to the press input intensity threshold and is lower than the press input intensity threshold.

[0104] Figure 5 shows a block diagram of an exemplary structure relating to device 500 according to some embodiments of the present disclosure. In the embodiment of Figure 5, media content is optionally received by device 500 via a network interface 502. The network interface 502 is optionally wireless or wired. One or more processors 504 optionally execute any number of programs stored in memory 506 or storage. Memory 506 or storage optionally includes instructions that execute one or more methods and / or processes described herein (e.g., methods 700, 900, 1100, 1300, and / or 1500).

[0105] In some embodiments, the display controller 508 causes the various user interfaces of this disclosure to be displayed on the display 500. Furthermore, input to the device 500 is optionally provided by the remote control 510 via the remote interface 512. The remote interface 512 is optionally wireless or wired. It is understood that the embodiment in Figure 5 is not intended to limit the mechanisms of the devices of this disclosure, and that other components that facilitate other mechanisms described in this disclosure may optionally be included in the structure of Figure 5. In some embodiments, the device 500 optionally corresponds to one or more of the multifunction device 100 in Figures 1A and 2, and the device 300 in Figure 3. The network interface 502 optionally corresponds to one or more of the RF circuit 108, external port 124, and peripheral interface 118 in Figures 1A and 2, and the network communication interface 360 ​​in Figure 3. The processor 504 optionally corresponds to one or more of the (multiple) processors 120 in Figure 1A and the (multiple) CPUs 310 in Figure 3. The display controller 508 optionally corresponds to one or more of the display controller 156 in Figure 1A and the I / O interface 330 in Figure 3. The memory 506 optionally corresponds to one or more of the memory 102 in Figure 1A and the memory 307 in Figure 3. The remote interface 512 optionally corresponds to one or more of the peripheral device interface 118 and the I / O subsystem 106 (and / or its components) in Figure 1A, and the I / O interface 330 in Figure 3. The remote control 512 optionally corresponds to and / or includes one or more of the following: speaker 111, touch-sensitive display system 112, microphone 113, (multiple) light sensors 164, (multiple) contact intensity sensors 165, (multiple) tactile output generators 167, other input control devices 116, (multiple) accelerometers 168, proximity sensor 166, and I / O subsystem 106 in Figure 1A, as well as the keyboard / mouse 350, touchpad 355, (multiple) tactile output generators 357, and (multiple) contact intensity sensors 359 in Figure 3, and the touch-sensitive surface 451 in Figure 4.The display 514 can be arbitrarily selected to correspond to one or more of the touch-sensitive display systems 112 in Figures 1A and 2 and the display 340 in Figure 3. User interface and related processes Column User Interface

[0106] Many electronic devices have graphical user interfaces that allow users to navigate across a large number of content items. There is a need to provide a fast, efficient, and convenient way for users to navigate across and select content items for consumption (e.g., viewing, listening). The embodiments described below use a column user interface to provide a fast, efficient, and convenient way for users to navigate across and select content items for consumption.

[0107] Figures 6A to 6NN show exemplary user interfaces for navigating across and selecting content items according to several embodiments. These user interfaces are used to illustrate the processes described below, including those described below with reference to Figures 7A to 7E.

[0108] Figures 6A–6U show an example of a column user interface. The column user interface is displayed on the display 514 of a device (e.g., device 500) and is responsive to user input, for example, on a touch-sensitive surface 451 and / or remote control 510. The column user interface in Figures 6A–6U includes columns 6002-1, 6002-2, 6002-3, 6002-4, 6002-5, and 6002-6. These columns contain headings such as “On Now,” “Watch List,” “TV Shows,” “Movies,” “Sports,” and “Just Kids,” respectively. The columns contain one or more menu items that are optionally selected by the user from among other possibilities for accessing content and / or navigating further throughout the user interface.

[0109] For example, each menu item in the "On Now" column 6002-1 corresponds to currently airing video content, and users can view the corresponding video content by selecting one of the menu items. Menu items corresponding to live video content, such as 6004-1, 6004-2, 6004-3, and 6004-4, are optionally displayed in the user interface via live video. Each menu item in the "Viewing List" column 6002-2 corresponds to on-demand video content, and users can view the corresponding on-demand video content by selecting one of the menu items in the "Viewing List" column. Menu items corresponding to live video content, such as 6006-1, 6006-2, 6006-3, 6006-4, and 6006-5, are optionally displayed in the user interface via one or more still images and / or text. Furthermore, the text optionally indicates the number of unviewed episodes of the content series corresponding to the menu item. For example, menu item 6006-1 indicates that the user has three unwatched episodes of Game of Thrones in their viewing list.

[0110] In Figure 6B, column 6002-2 is currently highlighted, as indicated by column focus indicators 6010-1 and 6010-2. Furthermore, the heading "Viewing List" 6014 is currently highlighted, as indicated by item focus indicator 6008. Upon receiving user input selecting the heading "Viewing List" 6014, the "Viewing List" column interface (shown in Figures 6V to 6BB) is optionally presented on display 514. In Figure 6C, column 6002-2 remains highlighted, and the menu item "Game of Thrones" 6006-1 is currently highlighted by item focus indicator 6008. The focus is optionally changed in response to detection of user input using an input device such as the remote control 510. For example, when the down button is optionally pressed on the remote control, or when a swipe-down gesture is optionally received on the remote control, a down navigation action is optionally received accordingly, and the item focus indicator 6008 optionally moves down from the “Viewing List” heading 6014 to the menu item “Game of Thrones” 6006-1, as shown in Figures 6B and 6C. In Figure 6D, the item focus indicator 6008 moves down towards the next menu item, “Mad Men” 6006-2.

[0111] In some embodiments, the background color of the user interface is selectively changed based on the currently highlighted menu item. For example, if the "Game of Thrones" menu item 6006-1 is highlighted by the item focus indicator 6008 because the "Game of Thrones" logo includes brown, the background of the user interface may be brown. If the "Mad Men" menu item 6006-2 is highlighted by the item focus indicator 6008 because the "Mad Men" logo includes red, the background of the user interface may be red.

[0112] In Figure 6E, columns 6002-3 are currently highlighted, as indicated by column focus indicators 6010-1 and 6010-2. Furthermore, the menu item "Mad Men" 6012 is currently highlighted, as indicated by item focus indicator 6008. Upon receiving a rightward navigation action, item focus indicator 6008 optionally moves from a column (e.g., column 6002-2) to the adjacent column to its right (e.g., column 6002-3), as shown in Figures 6D-6E.

[0113] In some embodiments, one or more columns optionally contain multiple menu items in a single row, as shown in Figures 6F to 6I. In Figures 6F to 6I, each column of columns 6002-3 contains multiple menu items. For example, menu items 6016-1 and 6016-2 are in the same column in column 6002-3. In such cases, a rightward navigation operation typically does not navigate to the next column. In Figures 6F to 6I, a series of three rightward navigation operations optionally navigate from menu item 6006-2 (Figure 6F) to menu item 6016-1 (Figure 6G), menu item 6016-2 (Figure 6H), and menu item 6018 (Figure 6I). However, in this embodiment, only the first and third rightward navigation operations navigate to the next column. Only the second rightward navigation operation moves from 6016-1 to 6016-2 within column 6002-3.

[0114] Figures 6J to 6M illustrate horizontal scrolling of columns in a column interface. In some embodiments, one or more columns are optionally off-screen. The user can scroll the columns to navigate to further columns. For example, Figures 6K, 6L, and 6M show further columns 6002-6 labeled "Kids Only," which are off-screen in Figure 6J and are being moved on display 514.

[0115] In Figures 6J to 6M, the position of a column highlighted relative to the display 514 is arbitrarily proportional to the position of a column highlighted relative to other columns. In Figure 6J, column 6002-2 is highlighted, and its position is approximately 1 / 3 of the way from the left edge of the display 514, since column 6002-2 is the second of the six columns. In Figure 6K, column 6002-3 is highlighted, and its position is approximately 1 / 2 of the way from the left edge of the display 514, since column 6002-3 is the third of the six columns. In Figure 6L, column 6002-4 is highlighted, and its position is approximately 2 / 3 of the way from the left edge of the display 514, since column 6002-4 is the fourth of the six columns. In Figure 6M, column 6002-6 is highlighted, and since column 6002-6 is the sixth of the six columns, its position is approximately the length of the display 514 from the left edge of the display.

[0116] Figures 6N–6P show vertical scrolling of columns in the column interface. While columns scroll horizontally together (as shown in Figures 6J–6M), Figures 6N–6P show columns 6002-2 that scroll vertically independently of the other columns. In some embodiments, one or more menu items in a column are optionally off-screen, allowing the user to scroll the column to navigate to further menu items. For example, Figure 6P shows a further menu item 6006-6 labeled "Road House." Menu item 6006-6 is off-screen in Figures 6N and 6O and is being moved on display 514.

[0117] Figures 6Q to 6U show vertical scrolling of a column containing fixed headings 6020-1, 6020-2, 6020-3, and 6020-4 in the column interface. When column 6020-3 is scrolled vertically, headings 6020-1, 6020-2, 6020-3, and 6020-4, as menu items, stop scrolling at the top of the column and continue scrolling below them. For example, the menu item below heading 6020-1 scrolls up into the heading and disappears in Figures 6Q, 6R, and 6S. In Figures 6S and 6T, when heading 6020-2 approaches heading 6020-1, heading 6020-2 replaces heading 6020-1 and stops scrolling at the top of the column as a menu item, while heading 6020-2 below it continues scrolling. The menu items below heading 6020-2 are hidden within the heading itself and disappear in Figures 6S, 6T, and 6U.

[0118] Figures 6V to 6BB show the interface of the viewing list column according to several embodiments. The column interface described herein allows the user to optionally navigate the column hierarchy. For example, the user optionally selects the heading 6014 “Viewing List” in column 6002-2 in the first set of columns in Figure 6A to navigate to the second set of columns in the viewing list column interface in Figures 6V to 6BB. The multiple menu items in column 6002-2 correspond to the columns in the viewing list column interface in Figures 6V to 6BB.

[0119] In some embodiments, multiple menu items in columns of a first set of columns are optionally grouped together in one column of a second set of columns. For example, Figure 6V shows multiple episodes of "Game of Thrones" as menu items 6026-1, 6026-2, and 6026-3 in column 6022-1. When the user selects column header 6024, the second set of columns may be displayed on display 514, in which case the first episode 6026-1 is displayed in its own column, and the remaining episodes 6026-2 and 6026-3 are grouped as menu items in further columns.

[0120] Figures 6W to 6BB show various embodiments of highlighting a column. In Figures 6W and 6X, the highlighting column is indicated by column focus indicators 6010-1 and 6010-2. In Figures 6Y and 6Z, the highlighting column is indicated by widening the width of the highlighting column relative to the other columns. In Figures 6AA and 6BB, the highlighting column is indicated by displaying more information within the highlighting column relative to the other columns.

[0121] Figures 6CC to 6DD show content series page column interfaces according to several embodiments. For example, the content series pages shown in Figures 6CC and 6DD are optionally displayed on the display 514 depending on the selection of menu item 6006-2 in Figure 6A or heading 6032 in Figure 6V. The splash area 6028 optionally includes still images corresponding to the content series, the title of the content series, and other information corresponding to the content series. Multiple columns 6030-1, 6030-2, 6030-3, 6030-4, and 6030-5 are optionally displayed within the content series page column interface. In Figure 6DD, the "Extras" column 6030-5 includes menu items corresponding to intelligently selected content based on its relevance to the content series. For example, column 6030-5 includes menu items corresponding to clips of talk shows featuring the cast of the content series and clips of parodies of the content series.

[0122] Figure 6EE shows a recent content column interface according to several embodiments. Columns 6034-1, 6034-2, 6034-3, 6034-4, and 6034-5 each correspond to recently viewed content in a specific category.

[0123] Figures 6FF to 6MM show a search column interface according to several embodiments. The columns optionally include a search input column 6036-1, a search suggestion column 6036-2, and a search results column 6036-3. The user optionally enters characters into a partial search term 6038 using the on-screen keyboard 6040. As characters are entered, both the search suggestion column 6036-2 and the search results column 6036-3 are automatically updated. While characters are being entered, the search results optionally reflect an incremental search, including results that sequentially begin with the partial search term 6038. For example, in Figure 6FF, the partial search term 6038 is "s", and all results in column 6036-3 begin with "s". Similarly, in Figure 6GG, the partial search term 6038 is "su", and all results in column 6036-3 begin with "su". In Figure 6HH, the partial search term 6038 is "super," and all results in column 6036-3 begin with "super." However, if a search suggestion is highlighted in the search suggestion column 6036-2, the search results column 6036-3 optionally reflects the search suggested in the search suggestion. Therefore, in Figure 6JJ, if the suggestion "superheroes" is selected, the results in column 6036-3 become content items about superheroes (e.g., superhero movies). In Figures 6KK and 6LL, the menu item in the search results column 6036-3 navigates to either optionally select one of the results (as in Figure 6KK) or optionally add the search to a viewing list (as in Figure 6LL). Adding the search to a viewing list optionally arranges the viewing list containing the search results. Figure 6MM shows the search results column interface, which is optionally displayed depending on the selection of the search result heading 6042. In Figure 6MM, each column corresponds to a menu item in the search results column 6036-3 in Figures 6FF to 6LL.

[0124] Figure 6NN shows a sports column interface according to several embodiments. The sports column interface is optionally displayed on the display 514 according to the selection of the sports heading 6044 in Figures 6A to 6U. The sports column interface optionally includes columns 6046-1, 6046-2, and 6046-3, corresponding to yesterday, today, and tomorrow, respectively. However, in some embodiments, further columns may correspond to further days. The menu items in column 6046-1 correspond to games that have already taken place and can be viewed on demand. By selecting any menu item in column 6046-1, the corresponding game is played from among other possibilities, or highlights of the corresponding game are optionally played. Menu item 6048-1 in today's column 6046-2 corresponds to a game currently being broadcast live, and menu item 6048-1 is optionally displayed as live video of the live game. By selecting menu item 6048-1, the channel on which the live game is currently being broadcast is optionally changed. By selecting any menu item in the upcoming games 6048-2, 6048-3, or column 6046-3, the user is optionally prompted to add the corresponding game to their viewing list or to view more information about the corresponding game, from among other possibilities.

[0125] Figures 7A to 7E are flowcharts illustrating a method for providing a column user interface according to several embodiments. This method is optionally performed in the electronic devices described above with reference to Figures 1A to 1B and Figures 2 to 5 (e.g., electronic devices 100, 300, or 500). Some operations of method 700 are optionally combined and / or the order of some operations is optionally changed.

[0126] As described below, Method 700 provides a method by which a device can display a column user interface. This method reduces the cognitive burden on the user when interacting with the user interface on the device by providing an intuitive user interface for selecting content items, thereby creating a more efficient human-machine interface. With respect to battery-operated electronic devices, power is saved and the interval between battery charging is extended by improving the efficiency of the user's interaction with the user interface.

[0127] In some embodiments, an electronic device comprising one or more processors and memory (e.g., a set-top box or another user interface generating device in communication with a display device) provides a user interface comprising a first set of columns for display on a display device (e.g., another display such as a television or computer monitor, or an integrated display that is part of an electronic device) (702). Each of two or more columns in the first set of columns comprises two or more menu items (e.g., text, images, and / or video content (which may optionally include some or all links to the content), applications, and / or other user interfaces). For example, Figures 6A to 6NN show a user interface comprising a set of columns (e.g., columns 6002-1, 6002-2, 6002-3, 6002-4, 6002-5, and 6002-6). Each example column has two or more menu items (for example, menu items 6004-1, 6004-2, 6004-3, and 6004-4 in column 6002-1, and menu items 6006-1, 6006-2, 6006-3, 6006-4, and 6006-5 in column 6002-2). In some embodiments, the user interface optionally has at least one background color (706).

[0128] In some embodiments, the columns of a first set are optionally configured to move together when scrolled in a first direction (e.g., horizontally) and to move separately when scrolled in a second direction different from the first direction (e.g., vertically) (704) (for example, when scrolling horizontally, all columns are scrolled, and when scrolling vertically, only selected columns are scrolled. When scrolling horizontally, the horizontal position of the selected column on the screen may also be proportional to the relative position of the selected column among all multiple columns, including those outside the screen). For example, Figures 6J to 6M show columns 6002-1, 6002-2, 6002-3, 6002-4, 6002-5, and 6002-6 that move together when scrolled horizontally from right to left. Furthermore, Figures 6N to 6P show column 6002-2 that moves separately from the other columns when scrolled horizontally.

[0129] In some embodiments, the electronic device receives a selection input (718). In response to the receipt of the selection input (720), and in accordance with the determination that the selection input corresponds to a selection of a first column (for example, an input that selects the heading of the first column, e.g., the “Viewing List” heading for the Viewing List column), the electronic device provides a second set of columns (different from the first set of columns) for display on the display device (722). Two or more columns in the second set of columns correspond to different subsets of menu items displayed in the first column selected in response to the selection input (for example, each column in the second set of columns corresponds to an item in the user’s Viewing List) (and one or more further columns, e.g., each subset contains episodes of a television series, and one or more further columns contain extra content related to the television series). In some embodiments, the first column in the second set of columns optionally corresponds to a first menu item (and only the first menu item) from the first column (724), and the second column in the second set of columns optionally corresponds to a second menu item (and only the second menu item) from the first column that is different from (e.g., distinguishable) the first menu item from the first column. For example, Figure 6B shows a selection of the “Viewing List” heading in Viewing List column 6002-2, which results in the set of Viewing List columns shown in Figure 6V. Multiple Viewing List columns in Figure 6V correspond to different subsets of menu items in Viewing List column 6002-2 in Figure 6B (for example, the “Chronicle” menu item 6006-3 corresponds to the “Chronicle” column 6022-3, the “WALL-E” menu item 6006-4 corresponds to the “WALL-E” column 6022-4, etc.).

[0130] In some embodiments, the first column in the second set of columns optionally corresponds to a first set of menu items from the first column (726), and the second column in the second set of columns optionally corresponds to a second set of menu items from the first column that are different from (e.g., distinguishable from) the first set of menu items from the first column (e.g., subsets for each letter in the alphabet, subsets for each artist in the music collection, subsets for each television in the "viewing list"). For example, Figure 6V shows multiple episodes of "Veep" grouped in columns 6022-5.

[0131] In some embodiments, in response to a selection input (720), and in accordance with the determination that the selection input corresponds to a selection of a menu item from a first column (e.g., an input selecting to display episodes of a television program from a viewing list column), the electronic device optionally provides a user interface associated with the selected menu item (e.g., content associated with the menu item, a set of columns associated with the menu item, a grid associated with the menu item, a set of columns associated with the menu item, etc.) for display on the display device (730). In some embodiments, the menu item optionally corresponds to a content series containing multiple episodes (e.g., a set of television series, miniseries, webisodes, etc., among other possibilities) (732). Each episode of the multiple episodes is in a viewing list (e.g., a list of movies, content series, episodes, music, actors, genres, search, etc.). For example, Figure 6D shows the selection of the “Mad Men” menu item 6006-2, and this selection results in the user interface associated with the content series “Mad Men” shown in Figure 6CC.

[0132] In some embodiments, the electronic device optionally generates one or more links to incidental content related to each episode (e.g., among other possibilities, a talk show clip focusing on the actors appearing in the episode, a parody clip of the episode, or a song featured in the episode) (734). A second set of columns optionally contains one or more links to incidental content related to each episode. For example, Figure 6DD shows columns 6030-5 containing multiple links to incidental content related to episodes of the content series "Mad Men".

[0133] In some embodiments, a first set of columns is optionally scrolled in a first direction (736). The selected column display position (e.g., a given horizontal position on the display for the user interface) is optionally determined based on the position of the currently selected column relative to the total number of columns (738) (e.g., the position may be the first column out of a total of 12 columns or the sixth column out of a total of 6 columns). Multiple columns are optionally scrolled so that the currently selected column moves to the selected column display position on the display device (740) (e.g., if there are a total of 100 columns, including columns currently off-screen, and the selected column is the 20th column, the selected column may be at a horizontal position 20% of the total horizontal length of the display. Similarly, if there are a total of 100 columns, and the selected column is the 90th column, the selected column may be at a horizontal position 90% of the total horizontal length of the display, etc.). For example, Figures 6J to 6M show columns 6002-1, 6002-2, 6002-3, 6002-4, 6002-5, and 6002-6 having proportional scrolling, as described above with reference to Figures 6J to 6M.

[0134] In some embodiments, a second input is optionally received to move from a first column to a second column (742). In response to the second input, the visual features of one or both of the first and second columns are optionally altered (744). In some embodiments, altering the visual features optionally includes increasing the visual emphasis of the second column (e.g., by increasing the brightness, contrast, opacity, saturation, or other visual properties of the second column) relative to the visual emphasis of the first column (746). For example, Figures 6W and 6X show increasing the visual emphasis of column 6022-3 as navigation moves from column 6022-2 to column 6022-3. In some embodiments, altering the visual features optionally includes displaying additional information above the second column (748) (and / or removing information from the first column). For example, Figures 6AA and 6BB show that when navigation moves from column 6022-2 to column 6022-3, additional information for column 6022-3 is displayed. In some embodiments, changing the visual features optionally includes increasing the spatial characteristics of the second column (for example, by increasing the width, height, z-position, or other spatial characteristics of the second column) relative to the spatial characteristics of the first column (750). For example, Figures 6Y and 6Z show that when navigation moves from column 6022-2 to column 6022-3, the width of column 6022-3 is increased.

[0135] In some embodiments, a second input is optionally received to move from a first menu item in the first column to a second menu item in the first column (752). Accordingly, the color associated with the logo of the second menu item is optionally obtained (754), and the background color of the user interface is optionally changed according to the color associated with the logo of the second menu item (756). For example, Figures 6C and 6D show navigation from menu item 6006-1 to menu item 6006-2, and the background color of the user interface is optionally changed as described above with reference to Figures 6C and 6D.

[0136] In some embodiments, the first column optionally includes first and second headings (e.g., subheadings of the first column) (728). Scroll input corresponding to the first column is optionally received (758). In response to the scroll input (760), the menu items of the first column are optionally scrolled (762), while the first heading remains stationary during the scrolling of the menu items of the first column. If the first heading is optionally scrolled outside the edge of the user interface (764), the first heading is no longer visible in the user interface after it has been scrolled outside the edge of the user interface. If the first heading is optionally replaced with the second heading (766), the second heading remains stationary during scrolling after it has replaced the first heading. For example, Figures 6Q to 6U show vertical scrolling of column 6002-3, which includes fixed headings 6020-1, 6020-2, 6020-3, and 6020-4.

[0137] In some embodiments, a first set of columns is optionally generated based on a partial search term (708). To display, a search suggestion column is optionally generated in the first set of columns (770). The search suggestion column optionally contains multiple search suggestions, each of which is optionally highlighted. To display, a search results column is optionally generated in the first set of columns (772). The search suggestion column optionally contains multiple search results corresponding to each search suggestion. The selection of each search suggestion is optionally received (774), and, in accordance with the selection of each search suggestion, multiple search results columns are optionally generated for display (776). The multiple search results columns each contain two or more search results columns corresponding to one of the multiple search results. For example, Figures 6FF-6LL show a search user interface including search results columns 6036-6. Figure 6MM shows a corresponding search results column interface including columns corresponding to the search that yields the search results columns 6036-6.

[0138] In some embodiments, providing a user interface including a first set of columns includes generating a display of multiple content items, including multiple on-demand content items (e.g., content items stored locally on this electronic device or in other local storage, or content items stored remotely on a server) and multiple live content items (e.g., content items being live-streamed over the Internet, live-broadcast content items, or other live content items) (710). Two or more of the displays of on-demand content items optionally include still images corresponding to the on-demand content (e.g., movie posters, production art, screenshots, or other placeholder images). Two or more of the displays of live content items optionally include live video corresponding to the live content. In some embodiments, the live video optionally includes live video of a live sporting event (712), and the still images optionally represent one or more of a completed sporting event, an upcoming sporting event, and highlight footage. For example, Figure 6NN shows a sports user interface that includes live video 6048-1 of a live sports event and still images representing upcoming sports events (e.g., menu items 6048-2 and 6048-3).

[0139] In some embodiments, it is optionally determined whether the first content item of a group of content items is an on-demand content item or a live content item (778). If the first content item is determined to be an on-demand content item, a still image corresponding to the on-demand content item is optionally acquired (780). If the first content item is determined to be a live content item, a live video corresponding to the live content item is optionally acquired (784). In some embodiments, acquiring a still image optionally includes capturing a still image from a video corresponding to an on-demand content item. For example, Figure 6A shows live content items 6004-1, 6004-2, 6004-3, and 6004-4, and on-demand content items 6006-1, 6006-2, 6006-3, 6006-4, and 6006-5. A still image of 6006-4 is optionally acquired by capturing its image from the corresponding "WALL-E" video content.

[0140] In some embodiments, the first set of columns optionally includes a first recent content column and a second recent content column (714). Each of the first and second recent content columns optionally includes content corresponding to a different category of recent content (e.g., recent TV column, recent movie column, recent song column). In some embodiments, the first recent content column includes only content that has been viewed for more than a predetermined threshold (e.g., only content that has been viewed for at least 8 minutes, only content that has been viewed for at least 10% of its running time, etc., where the threshold may differ for different content categories, for example, a 2-minute threshold for television, a 10-minute threshold for movies, a 30-second threshold for songs, etc.) (716). For example, Figure 6EE shows a recent content column user interface including recent content columns 6034-2, 6034-3, 6034-4, and 6034-5, corresponding to recent music, recent TV, recent movies, and recent sports, respectively.

[0141] In some embodiments, the first column of the first set of columns is optionally a first type of column (e.g., a column containing only one menu item in each column of the column) (786), and the second column of the first set of columns is optionally a second type of column (e.g., a column containing multiple menu items in one or more columns of the column). While the first column is selected, a first navigation input (e.g., swipe left or swipe right) is optionally received (788). In response to the receipt of the first navigation input, a different column of the first set of columns (e.g., a column immediately to the left or right of the first column) is optionally selected (790). While the second column is selected, a second navigation input (e.g., swipe left or swipe right) is optionally received (792). Upon receiving a second navigation input, the selection in the second column is optionally maintained (794), and the user is optionally navigated among multiple menu items within the second column. For example, Figures 6F to 6I show that column 6002-2 contains only one item per column (e.g., menu item 6006-2), and column 6002-3 contains two items per column (e.g., menu items 6016-1 and 6016-2). The first navigation input moves the selection from column 6002-2 in Figure 6F to column 6002-3 in Figure 6G. Meanwhile, the second navigation input moves the selection within column 6002-3 from menu item 6016-1 in Figure 6G to menu item 6016-2 in Figure 6H, while the selection in column 6002-3 is maintained.

[0142] The operation of the information processing method described above is optionally performed by activating one or more functional modules within the information processing device, such as a general-purpose processor (for example, those described above in relation to Figures 1A and 3) or an application-specific chip.

[0143] The operations described above, with reference to Figures 7A to 7E, are optionally performed by the components shown in Figures 1A to 1B. For example, the providing operation 702, receiving operation 718, and providing operation 722 are optionally performed by the event sorter 170, event recognition unit 180, and event handler 190. The event monitor 171 of the event sorter 170 detects contact on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to application 136-1. Each event recognition unit 180 of application 136-1 compares the event information with its respective event definition 186 to determine whether the first contact at the first location on the touch-sensitive surface corresponds to a default event or sub-event, such as the selection of an object on the user interface. When a default event or sub-event is detected, the event recognition unit 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 optionally uses or calls either the data updater 176 or the object updater 177 to update the application's internal state 192. In some embodiments, the event handler 190 accesses the respective GUI updaters 178 to update what is displayed by the application. Similarly, it will be obvious to those skilled in the art how other processes can be performed based on the components shown in Figures 1A and 1B.

[0144] It should be understood that the specific order of operations described in Figures 7A to 7E is merely illustrative and is not intended to indicate that the described order is the only order in which the operations can be performed. Those skilled in the art will recognize various methods for rearranging the operations described herein. In addition, it should be noted that details of other processes described herein with respect to other methods described herein (e.g., methods 900, 1100, 1300, and 1500) are also applicable in a manner similar to method 700 described above in relation to Figures 7A to 7E. For example, the user interface, columns, menu items, content items, and display devices described above with reference to method 700 optionally have one or more features of the user interface, columns, menu items, content items, and display devices described herein with reference to other methods described herein (e.g., methods 900, 1100, 1300, and 1500). For brevity, these details are not repeated here. Semi-transparent menu

[0145] Many electronic devices have graphical user interfaces that overlay some other visual content. The sudden appearance of a new graphical user interface can be disruptive to a smooth user experience. The embodiments described below first display a semi-transparent graphical user interface on top of the visual content, and then, as the user continues to interact with the interface, reduce its transparency to provide a smooth transition to the graphical user interface.

[0146] Figures 8A to 8D show exemplary translucent user interfaces according to several embodiments. These user interfaces are used to illustrate the processes described below, including those described below with reference to Figures 9A to 9C.

[0147] Figures 8A and 8B show an example of a semi-transparent user interface. The user interface is displayed on a display 514 of a device (e.g., device 500) and is responsive to user input, for example, on a touch-sensitive surface 451 and / or remote control 510. The user interface in Figures 8A and 8B includes columns 8002-1 and 8002-2 overlaid on the user interface over visual content 8006 (playing video content, paused video content, still images, etc.) in the background. At least a portion of the user interface is semi-transparent with a first degree of transparency so that the display of the background visual content 8006 is visible through the semi-transparent portion. For example, the non-text and non-image portions of column 8002-2 are optionally semi-transparent with a first degree of transparency. Figures 8A and 8B show navigation from column 8002-1 to column 8002-2. Based on navigation to the right, the first translucency may decrease from the first translucency to the second translucency. This makes the display of the background visual content 8006 almost invisible through the translucent portion. In some embodiments, based on navigation in the opposite direction (e.g., from column 8002-2 back to column 8002-1), the translucency of the translucent portion optionally increases from the second translucency to the first translucency. In some embodiments, any further interaction in any direction optionally causes the translucency to continue decreasing until the user interface becomes opaque to the background visual content 8006.

[0148] Figures 8C and 8D show another example of a semi-transparent user interface. The user interface is overlaid on visual content 8006 in the background of the user interface. At least a portion of the user interface is semi-transparent with a first degree of transparency, so that the display of the background visual content 8006 is visible through the semi-transparent portion. The user interface includes a checkbox 8004, and Figures 8C and 8D optionally show that the checkbox changes from an unchecked state to a checked state depending on the selection of the checkbox. By checking the checkbox, the semi-transparent portion of the user interface optionally reduces its transparency from a first degree of transparency to a second degree of transparency.

[0149] Figures 9A to 9C are flowcharts illustrating a method for providing a user interface having a translucent portion according to several embodiments. This method is optionally performed in the electronic devices described above with reference to Figures 1A to 1B and Figures 2 to 5 (e.g., electronic devices 100, 300, or 500). Some operations in method 900 are optionally combined, and / or the order of some operations is optionally changed.

[0150] As described below, Method 900 provides a method by which a device can display a user interface having a semi-transparent portion. This method reduces the cognitive burden on the user when interacting with the user interface on the device by providing a smooth and intuitive user interface for selecting content items, thereby creating a more efficient human-machine interface. With respect to battery-operated electronic devices, power is saved and the interval between battery charging is extended by improving the efficiency of the user's interaction with the user interface.

[0151] In some embodiments, an electronic device having one or more processors and memory (e.g., a set-top box or another user interface generating device in communication with a display device) receives a request to display a menu for controlling the visual content displayed within the user interface while the user interface, which includes visual content (e.g., video, still images, animations, etc.), is displayed on the display (902).

[0152] In some embodiments, upon receiving a request to display a menu, the electronic device provides an updated user interface including the menu for display on a display device (904). In this case, the menu includes at least one translucent portion having a first degree of translucency (or amount of translucency) (in some examples, the entire menu is translucent). This allows the display of visual content in the user interface to be seen through the translucent portion of the menu by the first degree of translucency. In some embodiments, the menu optionally includes a first set of columns (906), where two or more columns in the first set of columns each include two or more menu items (e.g., text, images, and / or video content (which may optionally include links to the content in some or all), applications, and / or other user interfaces). For example, Figure 8A shows a user interface including columns 8002-1 and 8002-2, where at least a portion of the columns is optionally translucent, thereby allowing the visual content 8006 to be seen through the translucent portion.

[0153] In some embodiments, while a menu having a translucent portion is displayed on the display device, the electronic device receives requests to perform operations within the menu (for example, menu navigation operations such as switching from one displayed column to another displayed column, or moving from a first menu item to a second menu item) (908). In some embodiments, the menu operations are optionally navigation operations that correspond to requests to move the menu in each direction (910).

[0154] In some embodiments, upon receiving a request to perform an action within the menu (912), the electronic device performs the action within the menu (914). For example, Figures 8A and 8B show a navigation operation from column 8002-1 to column 8002-2.

[0155] In some embodiments, performing an action within a menu optionally includes changing the state of an item in the menu (e.g., selecting a menu item, activating a checkbox, or manipulating a slider, among other possibilities) (916). Thus, in some embodiments, performing an action within a menu includes performing an action other than navigating across the entire menu (e.g., by scrolling from an item in the menu). For example, Figures 8C and 8D show checking checkbox 8004 in column 8002-1.

[0156] Furthermore, in response to receiving a request to perform an action within the menu (912), the electronic device changes the translucency of the translucent portion of the menu from a first translucency to a second translucency different from the first translucency (918) (for example, when a user indicates an intention to interact with the menu, the visual characteristics of the menu change to make the menu easier to read). For example, in Figures 8B and 8D, the translucency of a portion of the interface may be different from the translucency in Figures 8A and 8C, respectively. As a result, the background visual content 8006 is less visible in Figures 8B and 8D than in Figures 8A and 8C.

[0157] In some embodiments, the transparency of the translucent portion of the menu is optionally increased according to the determination that each direction is a first direction (920). For example, Figure 8A to Figure 8B shows navigation to the right and a decrease in the transparency of the translucent portion. As a result, the background visual content 8006 is less visible in Figure 8B than in Figure 8A. The transparency of the translucent portion of the menu is optionally decreased according to the determination that each direction is a second direction different from the first direction (e.g., the opposite direction) (922). For example, Figure 8B to Figure 8A shows navigation to the left and an increase in the transparency of the translucent portion. As a result, the background visual content 8006 is more visible in Figure 8A than in Figure 8B.

[0158] In some embodiments, while a menu having a translucent portion is displayed on a display device, a request to perform a navigation operation in a second direction (e.g., the opposite direction to the first direction) is optionally received (924). In response to the receipt of a request to perform a navigation operation in the second direction, the navigation operation is optionally performed in the second direction (926), and the translucency of the translucent portion of the menu is optionally reduced (928).

[0159] In some embodiments, a request to close a menu is optionally received while a menu having a semi-transparent portion is displayed on the display device (930). In response to the request to close the menu, a user interface including visual content but without the menu is optionally provided for display on the display device (932). In some embodiments, the visual content optionally includes video content (934). In response to the request to display the menu, the video content is optionally stopped (936), and in response to the request to close the menu, the video content is optionally resumed (938).

[0160] The operation of the information processing method described above is optionally performed by activating one or more functional modules within the information processing device, such as a general-purpose processor (for example, those described above in relation to Figures 1A and 3) or an application-specific chip.

[0161] The operations described above, with reference to Figures 9A to 9C, are optionally performed by the components shown in Figures 1A to 1B. For example, the receiving operation 902, providing operation 904, receiving operation 908, execution operation 914, and modification operation 918 are optionally performed by the event sorter 170, event recognition unit 180, and event handler 190. The event monitor 171 of the event sorter 170 detects contact on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to application 136-1. Each event recognition unit 180 of application 136-1 compares the event information with its respective event definition 186 to determine whether the first contact at the first location on the touch-sensitive surface corresponds to a default event or sub-event, such as the selection of an object on the user interface. When a default event or sub-event is detected, the event recognition unit 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 optionally uses or calls either the data updater 176 or the object updater 177 to update the application's internal state 192. In some embodiments, the event handler 190 accesses the respective GUI updaters 178 to update what is displayed by the application. Similarly, it will be obvious to those skilled in the art how other processes can be performed based on the components shown in Figures 1A and 1B.

[0162] It should be understood that the specific order of operations described in Figures 9A to 9C is merely illustrative and not intended to indicate that the described order is the only order in which the operations can be performed. Those skilled in the art will recognize various methods for rearranging the operations described herein. In addition, it should be noted that details of other processes described herein with reference to other methods described herein (e.g., methods 700, 1100, 1300, and 1500) are also applicable in a manner similar to method 900 described above in relation to Figures 9A to 9C. For example, the user interface, columns, menu items, content items, and display devices described above with reference to method 900 optionally have one or more features of the user interface, columns, menu items, content items, and display devices described herein with reference to other methods described herein (e.g., methods 700, 1100, 1300, and 1500). For brevity, these details are not repeated here. Step-by-step user interface

[0163] Many electronic devices have graphical user interfaces that overlay some other visual content. The sudden appearance of a new graphical user interface can be disruptive to a smooth user experience. The embodiments described below provide a smooth transition to a graphical user interface by presenting a first column after column display conditions (e.g., among other possibilities, detecting the presence of a user, detecting movement near the electronic device, or detecting the user's face using a light sensor) are met, and then progressively presenting further columns of the column user interface after receiving input (e.g., among other possibilities, a swipe, tap, or other input to expose one or more further columns).

[0164] Figures 10A to 10F show a step-by-step display of a column user interface on content (e.g., passive content) according to several embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes described below with reference to Figures 11A to 11B.

[0165] Figure 10A shows the display of passive content, including time, date, and weather information. Other passive content may optionally include splash images, screen savers, background images, etc. In some embodiments, the column user interface may optionally be displayed incrementally over active content, such as video content.

[0166] Figures 10B to 10D show the animation of the first column 10004-1 emerging from the right edge of the display 514. In some embodiments, the first column 10004-1 appears selectively depending on the column display conditions (e.g., detecting the presence of a user, detecting movement near an electronic device, or detecting a user's face using a light sensor, among other possibilities). The first column 10004-1 appears incrementally in an animation, selectively until it is fully on screen, as shown in Figure 10C. In some embodiments, the first column 10004-1 appears incrementally in an animation, as shown in Figure 10D, until it is fully on screen and a portion of the second column 10004-2 is also selectively visible.

[0167] Figures 10D to 10F show an animation of multiple columns appearing in stages until all of columns 10004-1, 10004-2, 10004-3, 10004-4, and 10004-5 are visible on display 514. In this example, the multiple columns occupy a portion of the display from the left edge to the right edge. The animation is displayed selectively in response to the reception of input (e.g., a swipe, tap, or other input to expose one or more additional columns, among other possibilities).

[0168] Figures 11A to 11B are flowcharts illustrating a method for providing a user interface that appears sequentially on visual content according to several embodiments. This method is optionally performed in the electronic devices described above (e.g., electronic devices 100, 300, or 500, etc.) with reference to Figures 1A to 1B and Figures 2 to 5. Some operations of method 1100 are optionally combined, and / or the order of some operations is optionally changed.

[0169] As described below, Method 1100 provides a method by which a device can display a user interface step-by-step over visual content. This method reduces the cognitive burden on the user when interacting with the user interface on the device by providing a smooth and intuitive user interface for selecting content items, thereby creating a more efficient human-machine interface. With respect to battery-operated electronic devices, power is saved and the interval between battery charging is extended by improving the efficiency of the user's interaction with the user interface.

[0170] In some embodiments, an electronic device having one or more processors and memory (e.g., a set-top box or another user interface generating device in communication with a display device) detects that column display conditions (e.g., among other possibilities, detecting the presence of a user, detecting movement near the electronic device, or detecting the user's face using a light sensor) are met (1102).

[0171] In some implementations, upon detection that the column display conditions are met, the electronic device provides a user interface for presentation on a display (e.g., another display device or an integrated display that is part of this electronic device) (1114). The user interface optionally includes at least a portion of the first column near (e.g., on or near) a first edge of the display (e.g., the rightmost edge). For example, Figure 10B shows a portion of column 10004-1 overlaid on visual content 10002.

[0172] In some embodiments, the device optionally receives input (e.g., a swipe, tap, or other input to expose one or more further columns, among other possibilities) (1122). In some embodiments, in response to the input, the electronic device provides an animation for display (1128). The animation includes a first column moving from a first edge of the display toward a position on the display closer to (e.g., on or near) a second edge of the display (e.g., the leftmost edge). The second edge is opposite the first edge. The animation further includes a second column appearing in stages from the first edge of the display. As a result, the multiple columns, including the first and second columns, fill the display from the first edge to the second edge (for example, the multiple columns fill the user interface from the rightmost edge of the display to the leftmost edge of the display, provided that parts of the user interface above and / or below the multiple columns do not need to be filled by the columns, and in some situations there may be a margin between one or more of the columns and the edge of the display). In some embodiments, the multiple columns are optionally included in a first set of columns (1132), and two or more columns in the first set of columns each contain two or more menu items (for example, text, images, and / or video content (which may optionally include some or all of which include links to the content), applications, and / or other user interfaces).

[0173] For example, Figures 10C to 10F show an animation including a first column 10004-1 that moves from the right edge of the display 514 to a position close to the left edge of the display, and a second column 10004-2 that appears gradually from the right edge of the display. As a result, multiple columns fill the display from the right edge to the left edge.

[0174] In some embodiments, detecting that the column display condition is met optionally does not involve receiving a directional input (1104), while receiving an input optionally involves receiving a directional input in a first direction (e.g., a swipe, tap, or other input in a direction such as left, right, up, or down) (1124). In some embodiments, the directional input optionally includes a magnitude (e.g., the amount of contact movement or the speed of contact movement) (1126). The animation optionally further includes moving a second column according to the magnitude of the directional input (1130) (e.g., by direct manipulation of the second column, such as a swipe to the left corresponding to the movement of contact, the second column moves to the left by an amount corresponding to the distance moved by the contact during the left swipe gesture, or the speed of contact during the left swipe gesture).

[0175] In some embodiments, when column display conditions are met, video content is optionally displayed on the display (1112), the user interface optionally includes an overlay on the video content (1116), and the first column optionally includes content selected based on the displayed video content (e.g., menu items in the first column) (1120) (for example, if the video content is a particular movie, the selected content included in the first column may be information related to that particular movie, if the video content is a particular television program, the selected content included in the first column may be further episodes of that particular television program, etc.).

[0176] In some embodiments, when column display conditions are met, video content is optionally displayed on the display (1112), the user interface optionally includes an overlay on the video content (1116), and detecting the column display conditions optionally includes detecting the selection of a menu button (e.g., on a touch-sensitive device, on a remote control, and / or on a mobile device) (1108).

[0177] In some embodiments, when a column display condition is met, passive content (e.g., splash image, screen saver, background image, etc.) is optionally displayed on the display (1110), the user interface optionally includes an overlay on the passive content (1118), and detecting the column display condition optionally includes detecting the presence of a user near the display (e.g., detecting motion near an electronic device, detecting a user's face using a light sensor, or detecting the presence of a mobile device) (1106). For example, Figures 10A to 10F show that when a column display condition is met, passive content 10002 is displayed, and the first column 10004-1 is displayed thereafter.

[0178] The operation of the information processing method described above is optionally performed by activating one or more functional modules within the information processing device, such as a general-purpose processor (for example, those described above in relation to Figures 1A and 3) or an application-specific chip.

[0179] The operations described above, with reference to Figures 11A to 11B, are optionally performed by the components shown in Figures 1A to 1B. For example, detection operation 1102, provision operation 1114, reception operation 1122, and provision operation 1128 are optionally performed by the event sorter 170, event recognition unit 180, and event handler 190. The event monitor 171 of the event sorter 170 detects contact on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to application 136-1. Each event recognition unit 180 of application 136-1 compares the event information with its respective event definition 186 to determine whether the first contact at the first position on the touch-sensitive surface corresponds to a default event or sub-event, such as the selection of an object on the user interface. When a default event or sub-event is detected, the event recognition unit 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 optionally uses or calls either the data updater 176 or the object updater 177 to update the application's internal state 192. In some embodiments, the event handler 190 accesses the respective GUI updaters 178 to update what is displayed by the application. Similarly, it will be obvious to those skilled in the art how other processes can be performed based on the components shown in Figures 1A and 1B.

[0180] It should be understood that the specific order of operations described in Figures 11A and 11B is merely illustrative and not intended to indicate that the described order is the only order in which the operations can be performed. Those skilled in the art will recognize various methods for rearranging the operations described herein. In addition, it should be noted that details of other processes described herein with reference to other methods described herein (e.g., methods 700, 900, 1300, and 1500) are also applicable in a manner similar to method 1100 described above in relation to Figures 11A and 11B. For example, the user interface, columns, menu items, content items, and display devices described above with reference to method 1100 optionally have one or more features of the user interface, columns, menu items, content items, and display devices described herein with reference to other methods described herein (e.g., methods 700, 900, 1300, and 1500). For brevity, these details are not repeated here. Smart Episode User Interface

[0181] Many electronic devices have graphical user interfaces for accessing episodes of various content item series. It can be difficult for users to record which episodes they have already watched. Furthermore, for content series that have not been watched, it may be more intuitive to present either the first episode of the series or a recent episode within the series, depending on the release status of the content series. The embodiments described below provide a more intuitive user interface by intelligently presenting contextual information about the content series based on its release status.

[0182] Figures 12A to 12E illustrate exemplary user interfaces that include the intelligent presentation of contextual information regarding a content series, according to several embodiments. These user interfaces are used to illustrate the processes described below, including those described below with reference to Figures 13A to 13C.

[0183] Figure 12A shows an example content series user interface. The content series user interface is displayed on the display 514 of a device (e.g., device 500) and is responsive to user input, for example, on a touch-sensitive surface 451 and / or remote control 510. The content series user interface includes information related to the last released episode of a content series and includes selectable affordances 12002 for viewing the last released episode of the content series. In some embodiments, the information related to the last released episode of a content series is optionally displayed based on the determination that the content series is currently being released and the last released episode has not been marked as viewed.

[0184] Figure 12B shows an example content series user interface that displays information 12004 regarding the upcoming release date and / or time of the next episode to be released. In some embodiments, the information 12004 is optionally selectable to add the next episode to be released to the viewing list. In some embodiments, the information 12004 regarding the upcoming release date and time of the next episode to be released is optionally displayed based on the determination that the content series is currently being released and that the last released episode has been marked as viewed.

[0185] Figure 12C shows an example content series user interface that includes information related to the first episode of the content series and an affordance 12006 that allows selection to view the first episode of the content series. In some embodiments, the information related to the first episode of the content series is optionally displayed based on a determination that the content series has been discontinued.

[0186] Figure 12D shows an example content series user interface that includes information related to the first unwatched episode and an affordance 12008 that allows selection to watch the first unwatched episode of the content series. In some embodiments, the information related to the first unwatched episode is optionally displayed based on the determination that one or more other episodes of the content series have been marked as watched.

[0187] Figure 12E shows an example content series user interface that includes information related to an episode currently being broadcast live on a channel and includes an affordable 12010 that can be selected to change the channel on which the episode is currently being broadcast live. In some embodiments, the information related to an episode currently being broadcast live on a channel is optionally displayed based on the determination that the content series is currently being released and an episode of the content series is currently being broadcast live on a channel.

[0188] Figures 13A to 13C are flowcharts illustrating methods for intelligently presenting contextual information about a content series according to several embodiments. This method is optionally performed in the electronic devices described above (e.g., electronic devices 100, 300, or 500, etc.) with reference to Figures 1A to 1B and Figures 2 to 5. Some operations of method 1300 are optionally combined, and / or the order of some operations is optionally changed.

[0189] As described below, Method 1300 provides a method by which a device can display a user interface that includes an intelligent display of contextual information about a content series. This method reduces the cognitive burden on the user when interacting with the user interface on the device by providing an intuitive user interface for selecting content items, thereby creating a more efficient human-machine interface. With respect to battery-operated electronic devices, power is saved and the interval between battery charging is extended by improving the efficiency of the user's interaction with the user interface.

[0190] In some embodiments, an electronic device having one or more processors and memory (e.g., a set-top box or another user interface generating device in communication with a display device) receives a request for information about a content series having a release status (e.g., among other possibilities, a television series, a miniseries, a set of webisodes) (e.g., among other possibilities, whether the series is still being produced, whether the series has been discontinued, or whether there are remaining episodes that have not yet been released) (1302).

[0191] In some embodiments, upon receiving a request, the electronic device provides a user interface containing information about a content series for display on a display (e.g., a television or other display device) (1304). The information includes contextual information based on the release status of the content series. In some embodiments, the user interface optionally includes a plurality of columns (1312), two or more of which include two or more menu items (e.g., text, images, and / or video content (which may optionally include links to the content in some or all of which), applications, and / or other user interfaces). The first column of the plurality optionally includes contextual information based on the release status of the content series (e.g., a column dedicated to a content series, such as a "Game of Thrones" column, and / or a column dedicated to a content provider of the content series, such as an HBO column containing menu items related to "Game of Thrones"). For example, Figures 12A to 12E show multiple columns related to the content series "Mad Men," and each figure shows various possible contextual information 12002 to 12010.

[0192] In some embodiments, according to the determination that the release state is a first release state (1306), the respective context information is first context information provided based on the recent release state activity (current or upcoming episodes) of the content series.

[0193] In some embodiments, according to the determination that the release state is a second release state different from a first release state (1308), the respective context information is second context information (different from the first context information) provided without referring to the activity of the recent release state of the content series (current or upcoming episodes).

[0194] In some embodiments, the first context information optionally includes, if selected, affordances that provide for displaying an episode of a content series on the display (1314) (in some embodiments, the device receives a selection of affordances and, in response to the receipt of the selection of affordances, presents for displaying an episode of the content series). In some embodiments, the second context information optionally includes information indicating when the next episode of the content series will be available, which, if selected, does not include affordances that present for displaying an episode of the content series (1322). For example, Figure 12B shows information 12004 indicating when the next episode of "Mad Men" will be available, which, if selected, does not include affordances that present for displaying an episode of "Mad Men".

[0195] In some embodiments, the release state is optionally aborted (1310), and each context information optionally includes the first episode of the content series (or the last unviewed episode of the content series). For example, Figure 12C shows information 12006 including the first episode of "Mad Men".

[0196] In some embodiments, the first release status is optionally currently released (1316) (e.g., a content series is currently airing and / or has a new episode released), and the last released episode is marked as watched. Providing the first contextual information based on recent release status activity optionally includes, for display, providing the date of the next episode to be released (e.g., the air date of the upcoming episode in the content series). For example, Figure 12B shows information 12004 containing the date of the next episode to be released for "Mad Men".

[0197] In some embodiments, the first release state is optionally currently released (1318) (for example, the content series is currently airing and / or has a new episode released), and the last released episode is not marked as watched. Providing the first contextual information based on recent release state activity optionally includes providing an affordance for displaying the last released episode of the content series. In some embodiments, a selection of affordances is optionally received (1324), and in response to the receipt of the selection of affordances (1326), the last released episode of the content series is optionally provided for display (1328). For example, Figure 12A shows affordance 12002 for displaying the last released episode of "Mad Men".

[0198] In some embodiments, a first release state is optionally currently released (1320) (for example, a content series is currently airing and a new episode has been released), and episodes of the content series are currently airing live on their respective channels. Providing first contextual information based on recent release state activity optionally includes providing affordances to provide each channel that is currently airing an episode live for display. In some embodiments, a selection of affordances is optionally received (1324), and in response to the receipt of a selection of affordances (1326), each channel that is currently airing an episode live for display is optionally provided (1330). For example, Figure 12E shows affordance 12010 to provide each channel that is currently airing an episode of "Mad Men" live for display.

[0199] The operation of the information processing method described above is optionally performed by activating one or more functional modules within the information processing device, such as a general-purpose processor (for example, those described above in relation to Figures 1A and 3) or an application-specific chip.

[0200] The operations described above, with reference to Figures 13A to 13C, are optionally performed by the components shown in Figures 1A to 1B. For example, receiving operation 1302, providing operation 1304, and receiving operation 1324 are optionally performed by the event sorter 170, event recognition unit 180, and event handler 190. The event monitor 171 of the event sorter 170 detects contact on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to application 136-1. Each event recognition unit 180 of application 136-1 compares the event information with its respective event definition 186 to determine whether the first contact at the first location on the touch-sensitive surface corresponds to a default event or sub-event, such as the selection of an object on the user interface. When a default event or sub-event is detected, the event recognition unit 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 optionally uses or calls either the data updater 176 or the object updater 177 to update the application's internal state 192. In some embodiments, the event handler 190 accesses the respective GUI updaters 178 to update what is displayed by the application. Similarly, it will be obvious to those skilled in the art how other processes can be performed based on the components shown in Figures 1A and 1B.

[0201] It should be understood that the specific order of operations described in Figures 13A and 13B is merely illustrative and not intended to indicate that the described order is the only order in which the operations can be performed. Those skilled in the art will recognize various methods for rearranging the operations described herein. In addition, it should be noted that details of other processes described herein with reference to other methods described herein (e.g., methods 700, 900, 1100, and 1500) are also applicable in a manner similar to method 1300 described above with reference to Figures 13A and 13C. For example, the user interface, columns, menu items, content items, and display devices described above with reference to method 1300 optionally have one or more features of the user interface, columns, menu items, content items, and display devices described herein with reference to other methods described herein (e.g., methods 700, 900, 1100, and 1500). For brevity, these details are not repeated here. Viewing list including content items and non-content items

[0202] Many electronic devices have a graphical user interface that allows users to directly add content items to a viewing list for later viewing. However, it can be difficult for users to remember content items they might be interested in as they are released. The embodiments described below provide a user interface for quickly adding both content and non-content items (e.g., actors, search terms, genres, sports leagues / players, etc.) to a viewing list. This allows content items related to non-content items to be automatically placed in the viewing list.

[0203] Figures 14A to 14H show exemplary user interfaces for adding both content and non-content items to a viewing list, according to several embodiments. These user interfaces are used to illustrate the processes described below, including those described below with reference to Figures 15A to 15B.

[0204] Figure 14A shows an exemplary content series user interface. The content series user interface is displayed on the display 514 of a device (e.g., device 500) and is responsive to user input, for example, on a touch-sensitive surface 451 and / or remote control 510. The content series user interface includes affordances 14002 and 14004, which are selectable for adding a content series to the viewing list and for adding individual episodes of a content series to the viewing list, respectively. Furthermore, in Figure 14A, each affordance is displayed near information related to the item being added to the viewing list. Affordance 14002 is near general information about the content series, and affordance 14004 is in a column related to individual episodes of the content series. By adding individual episodes to the viewing list, menu items and columns corresponding to the individual episodes are displayed in the viewing list user interface (e.g., as shown in Figure 14H). By adding a content series to the viewing list, menu items and / or columns corresponding to the content series, and / or some / all of the individual episodes of the content series, are displayed in the viewing list user interface. In some embodiments, episodes of a content series released after it has been added to the viewing list are optionally automatically added to the viewing list as they are released.

[0205] Figures 14B and 14C show exemplary movie and actor user interfaces. The movie user interface includes an affordable 14006 that can be selected to add a movie to the viewing list. Affordance 14006 is displayed near information about the movie being added to the viewing list. By adding a movie to the viewing list, a menu item and / or column corresponding to the movie is displayed in the viewing list user interface. The movie user interface further includes a menu item 14008 that can be selected to display an actor user interface, corresponding to an actor in the movie's cast, as shown in Figure 14C. The actor user interface includes an affordable 14010 that can be selected to add an actor to the viewing list. In some embodiments, affordances 14006 and 14010 are substantially identical, each containing the words “Add to Viewing List,” although there are some optional variations in font size, spacing, position, etc. Affordance 14010 is displayed near information related to the actor being added to the viewing list. By adding an actor to the viewing list, menu items and / or columns corresponding to one or more content items in which the actor appears are displayed in the viewing list user interface. In some embodiments, content items containing the actor that are released after the actor has been added to the viewing list are optionally added to the viewing list automatically when they are released.

[0206] Figure 14D shows an exemplary search user interface. The search user includes an affordable 14012 that can be selected to add a search term to the interface viewing list. The affordable 14012 is displayed near the search results for the search term "superheroes" to be added to the viewing list. By adding a search term to the viewing list, menu items and / or columns corresponding to one or more search results for the search term are displayed in the viewing list user interface. In some embodiments, search results released after the search term has been added to the viewing list are optionally added to the viewing list automatically when they are released.

[0207] Figure 14E shows an exemplary genre user interface. The genre user interface includes an affordable 14014 that can be selected to add a genre to the viewing list. The affordable 14014 is displayed near the name of the genre to be added to the viewing list, "Romantic Comedy". By adding a genre to the viewing list, menu items and / or columns corresponding to one or more content items in the genre are displayed in the viewing list user interface, respectively. In some embodiments, content items in the genre that are released after the genre has been added to the viewing list are optionally added to the viewing list automatically when they are released.

[0208] Figure 14F shows an exemplary sports player user interface. The sports player user interface includes an affordable 14016 that can be selected to add a sports player to the viewing list. The affordable 14016 is displayed near information related to the sports player being added to the viewing list. By adding a sports player to the viewing list, menu items and / or columns corresponding to one or more games associated with the sports player, as well as other content items, are displayed in the viewing list user interface. In some embodiments, content items related to the sports player that are released after the sports player has been added to the viewing list are optional, and are automatically added to the viewing list when they are released.

[0209] Figure 14G shows an exemplary sports league user interface. The sports league user interface includes an affordable 14018 that can be selected to add a sports league to the viewing list. The affordable 14018 is displayed near information related to the sports league being added to the viewing list. By adding a sports league to the viewing list, menu items and / or columns corresponding to one or more games associated with the sports league, as well as other content items, are displayed in the viewing list user interface. In some embodiments, content items related to the sports league that are released after the sports league has been added to the viewing list are optional, and are automatically added to the viewing list when they are released.

[0210] Figure 14H shows an exemplary viewing list user interface. The viewing list user interface includes columns 14020-1, 14020-2, 14020-3, 14020-4, and 14020-5, each corresponding to a content item or content series added based on a content item or non-content item added to the viewing list. In some embodiments, information related to why a content item is in the viewing list is optionally displayed near the information related to the content item. For example, in column 14020-1, "The Dark Knight" is present in the viewing list because actor Christian Bale, who appears in "The Dark Knight," was added to the viewing list. In column 14020-2, the series "Mad Men" is present in the viewing list because the series was added to the viewing list. In column 14020-3, "27 Dresses" is present in the viewing list because the genre "Romantic Comedy" was added to the viewing list. In column 14020-4, player Blake Griffin (who plays for Clippers) was added to the viewing list, so the basketball game "Clippers vs. Magic" is present in the viewing list. In column 14020-5, the search term "superheroes" was added to the uchi list, so "The Amazing Spider-Man" is present in the viewing list.

[0211] Figures 15A and 15B are flowcharts illustrating a user interface method for adding both content and non-content items to a viewing list, according to several embodiments. This method is optionally performed in the electronic devices described above with reference to Figures 1 to 5. The electronic devices include a set-top box or a remote control and other user interface generating devices in communication with a display device. Some operations of method 1500 are optionally combined, and / or the order of some operations is optionally changed.

[0212] As described below, Method 1500 provides a method by which a device can display a user interface for adding both content and non-content items to a viewing list. This method reduces the cognitive burden on the user when interacting with the user interface on the device by providing an intuitive user interface for selecting content items, thereby creating a more efficient human-machine interface. With respect to battery-operated electronic devices, power is saved and the interval between battery charging is extended by improving the efficiency of the user's interaction with the user interface.

[0213] In some embodiments, an electronic device having one or more processors and memory (e.g., a set-top box or another user interface generating device in communication with a display device) provides, for display, a first affordance (e.g., a button, checkbox, or other selectable user interface object) associated with a first content item (e.g., a movie, episode, song, video clip, etc.) and a second affordance associated with a non-content item (e.g., an actor, genre, search term, etc.) (1504). For example, Figures 14A to 14F show affordances 14002, 14004, and 14006 associated with content items (content series, episode, and movie, respectively) and affordances 14010, 14012, 14014, 14016, and 14018 (actors, search term, genre, athlete, and sports league, respectively).

[0214] In some embodiments, the electronic device receives inputs to select a first affordance (e.g., a tap gesture on a touch-sensitive surface) and inputs to select a second affordance (e.g., an input to add a first content item and a non-content item to a viewing list) (1522). For example, it can receive inputs to select any of the affordances 14002, 14004, 14006, 14010, 14012, 14014, 14016, and 14018 in Figures 14A to 14F.

[0215] In some embodiments, the electronic device provides a list of content items for display (for example, a viewing list displayed as multiple columns or as multiple menu items in a menu) (1528). The list includes a first content item and one or more further content items associated with a non-content item (for example, if the non-content item is an actor, movies starring that actor; if the non-content item is a genre, movies from that genre; or if the non-content item is a search, the results of that search). For example, Figure 14G shows a viewing list of content items, including items associated with various non-content items (for example, "The Dark Knight" is associated with the actor Christian Bale, and "27 Dresses" is associated with the genre "Romantic Comedy").

[0216] In some embodiments, the first and second affordances are optionally identical (1506) (for example, the first and second affordances are buttons containing the text "Add to Viewing List"). In some embodiments, the first and second affordances are substantially identical (for example, both affordances are buttons containing the text "Add to Viewing List"), making it clear to the user that both buttons add content associated with the currently displayed content or non-content item to the user's viewing list, even if the shape, color, or font used in the buttons differs. For example, Figures 14A to 14F show affordances 14006, 14010, 14016, and 14018 as substantially identical. Including substantially identical affordances in different parts of the user interface provides feedback to the user that selecting an affordance will add the content associated with that affordance to the user's viewing list, even if the affordances appear near different types of content (e.g., actors, athletes, movies, genres, etc.).

[0217] In some embodiments, a list of search results based on a search term is optionally provided for display (1502). A second affordance is optionally provided near the list of search results (e.g., associated with the list) (1508) (and the second affordance is generated near the list of search results for display; for example, the affordance includes the text “Add search to viewing list”). In some embodiments, providing a list of content items optionally includes searching based on a search term to obtain a further list of search results (1530) (and at least one of the further search results is included in the list of content items). For example, Figure 14D shows an affordance 14012 near the list of search results.

[0218] In some embodiments, providing to display a first affordance associated with a first content includes receiving a request to display information about the first content item on the display (1510). In response to receiving a request to display information about the first content item on the display, the information about the first content item is optionally displayed (1512), and the first affordance is optionally displayed adjacent to the information about the first content item. For example, in Figure 14B, affordance 14006 is displayed adjacent to the information related to "The Dark Knight".

[0219] While displaying a first affordance adjacent to information about a first content item, the system optionally receives input corresponding to the activation of the first affordance (1524) (for example, receiving a selection command while the “Add to viewing list” affordance is highlighted). Providing a second affordance for display in association with a non-content item optionally includes receiving a request to display information about the non-content item on the display while displaying information about the first content item (1514). In response to receiving a request to display information about the non-content item on the display, the system optionally replaces the display of information about the first content item with the display of information about the non-content item (1516). The system optionally displays the second affordance adjacent to the information about the non-content item. For example, in Figure 14B, a request to display information about Christian Bale may be received when the user selects affordance 14008. Then, in Figure 14C, affordance 14010 is displayed adjacent to the information about Christian Bale.

[0220] Receiving input to select a second affordance optionally includes receiving input corresponding to the activation of the second affordance while displaying a second affordance adjacent to information about a non-content item (1526) (for example, receiving a selection command while the “Add to Viewing List” affordance is highlighted). In some embodiments, one or more further affordances are selected while navigating across an entire user interface containing content corresponding to multiple types of content items and non-content items (for example, while navigating across a series of menus or an entire user interface corresponding to different content items and non-content items, the user has the choice of selecting from multiple types of affordances corresponding to non-content items and multiple affordances corresponding to content items). For example, the multiple affordances 14002, 14004, 14006, 14010, 14012, 14014, 14016, and 14018 in Figures 14A to 14F are optionally selected while navigating across various column user interfaces.

[0221] In some embodiments, multiple affordances corresponding to non-content items are optionally provided (1518). The multiple affordances optionally include affordances corresponding to each non-content item (e.g., a sports player) and affordances corresponding to groupings of non-content items that include each non-content item and one or more other non-content items (e.g., a team containing a sports player or a league containing a team). For example, Figure 14G shows affordance 14018 corresponding to a sports league.

[0222] In some embodiments, multiple affordances corresponding to content items are optionally provided (1520). The multiple affordances optionally include affordances corresponding to each content item (e.g., an episode of a TV show) and affordances corresponding to a group of content items that includes each content item and one or more other content items (e.g., a TV show including episodes). For example, Figure 14A includes affordance 14004 corresponding to an episode of "Mad Men" and affordance 14002 corresponding to the content series "Mad Men" itself.

[0223] The operation of the information processing method described above is optionally performed by activating one or more functional modules within the information processing device, such as a general-purpose processor (for example, those described above in relation to Figures 1A and 3) or an application-specific chip.

[0224] The operations described above, with reference to Figures 15A to 15B, are optionally performed by the components shown in Figures 1A to 1B. For example, providing operations 1502, 1504, 1518, 1520, receiving operations 1522, and 1528 are optionally performed by the event sorter 170, event recognition unit 180, and event handler 190. The event monitor 171 in the event sorter 170 detects contact on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to application 136-1. Each event recognition unit 180 in application 136-1 compares the event information with its respective event definition 186 to determine whether the first contact at the first location on the touch-sensitive surface corresponds to a default event or sub-event, such as the selection of an object on the user interface. When a default event or sub-event is detected, the event recognition unit 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 optionally uses or calls either the data updater 176 or the object updater 177 to update the application's internal state 192. In some embodiments, the event handler 190 accesses the respective GUI updaters 178 to update what is displayed by the application. Similarly, it will be obvious to those skilled in the art how other processes can be performed based on the components shown in Figures 1A and 1B.

[0225] It should be understood that the specific order of operations described in Figures 15A and 15B is merely illustrative and not intended to indicate that the described order is the only order in which the operations can be performed. Those skilled in the art will recognize various methods for rearranging the operations described herein. In addition, it should be noted that details of other processes described herein with respect to other methods described herein (e.g., methods 700, 900, 1100, and 1300) are also applicable in a manner similar to method 1500 described above in relation to Figures 15A and 15B. For example, the user interface, columns, menu items, content items, and display devices described above with reference to method 1500 optionally have one or more features of the user interface, columns, menu items, content items, and display devices described herein with reference to other methods described herein (e.g., methods 700, 900, 1100, and 1300). For brevity, these details are not repeated here.

[0226] In some embodiments, Figure 16 shows a functional block diagram of an electronic device 1600 configured according to the principles of the various embodiments described. The functional blocks of this device are optionally implemented by hardware, software, or a combination of hardware and software to carry out the principles of the various embodiments described. Those skilled in the art will understand that the functional blocks described in Figure 16 can be optionally combined or separated into subblocks to carry out the principles of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or division of the functional blocks described herein, or further definitions.

[0227] As shown in FIG. 16, the electronic device 1600 optionally includes a display unit 1602 configured to display a user interface including one or more user interface objects (e.g., content items, headings, etc.), an input unit 1604 (e.g., a touch-sensitive surface, keyboard, mouse, or other input unit) for receiving user input, selections, etc., and a processing unit 1610 coupled to the display unit 1602 and the input unit 1604. In some embodiments, the processing unit 1610 optionally includes a display enabling unit 1612, a receiving unit 1614, a determination unit 1616, and an acquisition unit 1618.

[0228] In some embodiments, the processing unit 1610 is configured to provide (e.g., by the display enabling unit 1612) a user interface including a first set of columns for display on a display device, and two or more columns in the first set of columns each include two or more menu items. The processing unit 1610 is configured to receive a selection input (e.g., by the receiving unit 1614). In response to receiving the selection input, according to the determination that the selection input corresponds to a selection of a first column, the processing unit 1610 is further configured to provide (e.g., by the display enabling unit 1612) a second set of columns for display on the display device, and two or more columns in the second set of columns correspond to different subsets of the menu items displayed in the first column selected according to the selection input.

[0229] In some embodiments, the processing unit 1610 is further configured to provide (e.g., by the display enabling unit 1612) a user interface associated with the selected menu item for display on the display device according to the determination that the selection input corresponds to a selection of a menu item from the first column in response to the selection input.

[0230] In some embodiments, the menu item corresponds to a content series including a plurality of episodes, and each of the plurality of episodes is in the viewing list. The processing unit 1610 is further configured to generate one or more links to the accompanying content related to each episode (e.g., by the display enabling unit 1612), and the second set of columns includes one or more links to the accompanying content related to each episode.

[0231] In some embodiments, the first column in the second set of columns corresponds to the first menu item from the first column, and the second column in the second set of columns corresponds to the second menu item from the first column, which is different from the first menu item from the first column. In some embodiments, the first column in the second set of columns corresponds to the first plurality of menu items from the first column, and the second column in the second set of columns corresponds to the second plurality of menu items from the first column, which is different from the first plurality of menu items from the first column.

[0232] In some embodiments, the first set of columns is configured to scroll and move in a first direction and to move separately when scrolled in a second direction different from the first direction. In some embodiments, scrolling the first set of columns in the first direction includes determining (e.g., by the determination unit 1616) the selected column display position based on the position of the currently selected column relative to the total number of columns, and scrolling the plurality of columns (e.g., by the display enabling unit 1612) such that the currently selected column moves to the selected column display position on the display device. [[ID=⑨]] [[ID=⑩]]

[0233] [[ID=⑪]] In some embodiments, the processing unit 1610 is further configured to receive a second input (e.g., by a receiving unit 1614) for moving from a first column to a second column, and to change the visual features of one or both of the first and second columns (e.g., by a display enablement unit 1612) in response to the second input. In some embodiments, changing the visual features includes enhancing the visual emphasis of the second column (e.g., by a display enablement unit 1612) relative to the visual emphasis of the first column. In some embodiments, changing the visual features includes displaying additional information in the second column (e.g., by a display enablement unit 1612). In some embodiments, changing the visual features includes enhancing the spatial characteristics of the second column (e.g., by a display enablement unit 1612) relative to the spatial characteristics of the first column.

[0234] In some embodiments, the user interface has at least one background color, and the processing unit 1610 is further configured to receive a second input (e.g., by a receiving unit 1614) to advance from a first menu item in a first column to a second menu item in a first column, to retrieve a color associated with the logo of the second menu item (e.g., by a retrieval unit 1618), and to change the background color of the user interface according to the color associated with the logo of the second menu item (e.g., by a display enablement unit 1612).

[0235] In some embodiments, the first column includes first and second headings, and the processing unit 1610 is further configured to receive a scroll input corresponding to the first column (e.g., by a receiving unit 1614). In response to the scroll input, the processing unit 1610 is further configured to scroll the menu items of the first column (e.g., by a display enablement unit 1612) (where the first heading remains stationary while the menu items of the first column are scrolled), to scroll the first heading (e.g., by the display enablement unit 1612) outside the edge of the user interface (so that the first heading is no longer visible in the user interface after it has been scrolled outside the edge of the user interface), and to replace the first heading with the second heading (e.g., by the display enablement unit 1612) (so that the second heading remains stationary while scrolling after it has replaced the first heading).

[0236] In some embodiments, a first set of columns is generated based on a partial search term, and the processing unit 1610 is further configured to generate a search suggestion column in the first set of columns for display (e.g., by a display enablement unit 1612) (the search suggestion column contains multiple search suggestions, where each of the multiple search suggestions is highlighted), generate a search results column in the first set of columns for display (e.g., by a display enablement unit 1612) (the search suggestion column contains multiple search results corresponding to each of the multiple search suggestions), and receive a selection of each search suggestion (e.g., by a receiving unit 1614). Depending on the selection of each search suggestion, the processing unit 1610 is further configured to generate multiple search results columns for display (e.g., by a display enablement unit 1612), where each of the multiple search results columns contains two or more search results columns, each corresponding to one of the multiple search results.

[0237] In some embodiments, providing a user interface including a first set of columns includes generating a display of multiple content items (e.g., by a display activation unit 1612) including multiple on-demand content items and multiple live content items, where two or more displays of on-demand content items include still images corresponding to the on-demand content, and two or more displays of live content items include live videos corresponding to the live content.

[0238] In some embodiments, the processing unit 1610 is further configured to determine (e.g., by a determination unit 1616) whether a first content item of a plurality of content items is an on-demand content item or a live content item, to acquire a still image corresponding to the on-demand content item (e.g., by an acquisition unit 1618) according to the determination that the first content item is an on-demand content item, and to acquire a live video corresponding to the live content item (e.g., by an acquisition unit 1618) according to the determination that the first content item is a live content item. In some embodiments, acquiring a still image includes capturing a still image (e.g., by an acquisition unit 1618) from a video corresponding to the on-demand content item. In some embodiments, the live video includes live video of a live sports event, and the still image represents one or more of a completed sports event, an upcoming sports event, and a highlight reel.

[0239] In some embodiments, the first set of columns includes a first recent content column and a second recent content column, each containing content corresponding to recent content of a different category. In some embodiments, the first recent content column contains only content viewed beyond a predetermined threshold.

[0240] In some embodiments, the first column of the first set of columns is a first type column, the second column of the first set of columns is a second type column, and the processing unit 1610 is further configured to receive a first navigation input (e.g., by a receiving unit 1614) while the first column is being selected. In response to receiving the first navigation input, the processing unit 1610 is further configured to select a different column of the first set of columns (e.g., by a display enablement unit 1612) and receive a second navigation input (e.g., by a receiving unit 1614) while the second column is being selected. In response to receiving the second navigation input, the processing unit 1610 is further configured to maintain the selection of the second column (e.g., by a display enablement unit 1612) and to navigate (e.g., by a display enablement unit 1612) among a plurality of menu items in the second column.

[0241] In some embodiments, Figure 17 shows a functional block diagram of an electronic device 1700 configured according to the principles of the various embodiments described. The functional blocks of this device are optionally implemented by hardware, software, or a combination of hardware and software to carry out the principles of the various embodiments described. Those skilled in the art will understand that the functional blocks described in Figure 17 can be optionally combined or separated into subblocks to carry out the principles of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or division of the functional blocks described herein, or further definitions.

[0242] As shown in Figure 17, the electronic device 1700 optionally includes a display unit 1702 configured to display a user interface including one or more user interface objects (e.g., content items, headings, etc.), an input unit 1704 (e.g., a touch-sensitive surface, keyboard, mouse, or other input unit) that receives user input, selections, etc., and a processing unit 1710 connected to the display unit 1702 and the input unit 1704. In some embodiments, the processing unit 1710 optionally includes a display activation unit 1712 and a receiving unit 1714.

[0243] In some embodiments, the processing unit 1710 is configured to receive (e.g., by a receiving unit 1714) requests to display a menu for controlling the visual content displayed in the user interface while the user interface containing the visual content is displayed on the display. In response to receiving a request to display a menu, the processing unit 1710 is further configured to provide (e.g., by a display enablement unit 1712) an updated user interface containing the menu for display on the display device, the menu including at least one translucent portion having a first degree of translucency. This allows the display of the visual content in the user interface to be seen through the translucent portion of the menu that conforms to the first degree of translucency. While the menu with the translucent portion is displayed on the display device, the processing unit 1710 is further configured to receive (e.g., by a receiving unit 1714) requests to perform actions within the menu. In response to a request to perform an action within the menu, the processing unit 1710 is further configured to perform an action in the menu (for example, by the display activation unit 1712) and change the transparency of the translucent portion of the menu from a first level of transparency to a second level of transparency different from the first level of transparency (for example, by the display activation unit 1712).

[0244] In some embodiments, the operation is a first navigation operation in a first direction, which involves changing the translucency of the translucent portion of the menu, which includes increasing the translucency (e.g., by the display enablement unit 1712). While the menu having the translucent portion is displayed on the display device, the processing unit 1710 is further configured to receive (e.g., by the receiving unit 1714) a request to perform a navigation operation in a second direction. In response to receiving a request to perform a navigation operation in a second direction, the processing unit 1710 is further configured to perform the navigation operation in the second direction (e.g., by the display enablement unit 1712), which involves decreasing the translucency of the translucent portion of the menu (e.g., by the display enablement unit 1712).

[0245] In some embodiments, the operation is a navigation operation that responds to requests to move the menu in each direction, and changing the translucency of the translucent portion of the menu includes increasing the translucency of the translucent portion of the menu (e.g., by the display enablement unit 1712) according to the determination that each direction is a first direction, and decreasing the translucency of the translucent portion of the menu (e.g., by the display enablement unit 1712) according to the determination that each direction is a second direction different from the first direction.

[0246] In some embodiments, performing an action in a menu includes changing the state of an item in the menu (for example, by the display activation unit 1712).

[0247] In some embodiments, the processing unit 1710 is further configured to receive a request to close the menu (e.g., by a receiving unit 1714) while the menu, including a translucent portion, is displayed on the display device, and to provide a user interface (e.g., by a display enablement unit 1712) that includes visual content but does not include the menu for display on the display device in response to the receipt of the request to close the menu.

[0248] In some embodiments, the visual content includes video content, and the processing unit 1710 is further configured to stop the video content (e.g., by the display enablement unit 1712) in response to a request to display the menu, and to resume the video content (e.g., by the display enablement unit 1712) in response to a request to close the menu. In some embodiments, the menu includes a first set of columns, where two or more columns in the first set of columns each include two or more menu items.

[0249] In some embodiments, Figure 18 shows a functional block diagram of an electronic device 1800 configured according to the principles of the various embodiments described. The functional blocks of this device are optionally implemented by hardware, software, or a combination of hardware and software to carry out the principles of the various embodiments described. Those skilled in the art will understand that the functional blocks described in Figure 18 can be optionally combined or separated into subblocks to carry out the principles of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or division of the functional blocks described herein, or further definitions.

[0250] As shown in Figure 18, the electronic device 1800 optionally includes a display unit 1802 configured to display a user interface including one or more user interface objects (e.g., content items, headings, etc.), an input unit 1804 (e.g., a touch-sensitive surface, keyboard, mouse, or other input unit) that receives user input, selections, etc., and a processing unit 1810 connected to the display unit 1802 and the input unit 1804. In some embodiments, the processing unit 1810 optionally includes a display activation unit 1812, a receiving unit 1814, and a detection unit 1816.

[0251] In some embodiments, the processing unit 1810 is configured to detect (e.g., by the detection unit 1816) that the column display condition is satisfied. In response to the detection that the column display condition is satisfied, the processing unit 1810 is further configured to provide (e.g., by the display activation unit 1812) a user interface for presentation on the display, and the user interface includes at least a portion of the first column near the first edge of the display. The processing unit 1810 is further configured to receive an input (e.g., by the receiving unit 1814). In response to the input, the processing unit 1810 is further configured to provide (e.g., by the display activation unit 1812) an animation for display. The animation includes the first column moving from the first edge of the display toward a position on the display near the second edge of the display. The second edge is opposite the first edge, and the second column appears step by step from the first edge of the display. Thereby, a plurality of columns including the first and second columns fill the display from the first edge toward the second edge.

[0252] In some embodiments, detecting that the column display condition is satisfied does not include receiving a directional input, and receiving an input includes receiving a directional input in a first direction (e.g., by the receiving unit 1814). In some embodiments, the directional input includes a magnitude, and the animation further includes moving the second column (e.g., by the display activation unit 1812) according to the magnitude of the directional input. In some embodiments, when the column display condition is satisfied, video content is displayed (e.g., by the display activation unit 1812) on the display, the user interface includes an overlay on the video content, and the first column includes content selected based on the displayed video content.

[0253] In some embodiments, when a column display condition is met, video content is displayed on the display (e.g., by a display activation unit 1812), the user interface includes an overlay on the video content, and detecting the column display condition includes detecting the selection of a menu button (e.g., by a detection unit 1816). In some embodiments, when a column display condition is met, passive content is displayed on the display (e.g., by a display activation unit 1812), the user interface includes an overlay on the passive content, and detecting the column display condition includes detecting the presence of a user near the display (e.g., by a detection unit 1816). In some embodiments, the plurality of columns include a first set of columns, and two or more columns in the first set of columns each include two or more menu items.

[0254] In some embodiments, Figure 19 shows a functional block diagram of an electronic device 1900 configured according to the principles of the various embodiments described. The functional blocks of this device are optionally implemented by hardware, software, or a combination of hardware and software to carry out the principles of the various embodiments described. Those skilled in the art will understand that the functional blocks described in Figure 19 can be optionally combined or separated into subblocks to carry out the principles of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or division of the functional blocks described herein, or further definitions.

[0255] As shown in Figure 19, the electronic device 1900 optionally includes a display unit 1902 configured to display a user interface including one or more user interface objects (e.g., content items, headings, etc.), an input unit 1904 (e.g., a touch-sensitive surface, keyboard, mouse, or other input unit) that receives user input, selections, etc., and a processing unit 1910 connected to the display unit 1902 and the input unit 1904. In some embodiments, the processing unit 1910 optionally includes a display activation unit 1912 and a receiving unit 1914.

[0256] In some embodiments, the processing unit 1910 is configured to receive requests for information about content series having a release state (e.g., by the receiving unit 1914). Upon receiving a request, the processing unit 1910 is further configured to provide a user interface containing information about the content series for display on a display (e.g., by the display enablement unit 1912), the information including respective context information based on the release state of the content series. According to the determination that the release state is a first release state, the respective context information is first context information provided based on the recent release state activity of the content series. According to the determination that the release state is a second release state different from the first release state, the respective context information is second context information provided without referring to the recent release state activity of the content series.

[0257] In some embodiments, the first contextual information includes affordances that, if selected, provide for displaying an episode of the content series on the display (e.g., by the display enablement unit 1912). The second contextual information includes information indicating when the next episode of the content series will be available for presentation, without including affordances that, if selected, present for displaying an episode of the content series (e.g., by the display enablement unit 1912).

[0258] In some embodiments, the release state is terminated, and the context information for each includes the first episode of the content series. In some embodiments, the first release state is currently being released, and the last released episode is marked as watched. Providing the first context information based on recent release state activity includes providing the date of the next episode to be released for display (e.g., by the display enablement unit 1912).

[0259] In some embodiments, the first release state is currently being released, and the last released episode is not marked as watched. Providing first contextual information based on recent release state activity includes providing affordances (e.g., by display enablement unit 1912) for presenting the last released episode of the content series, and the processing unit 1910 is further configured to receive a selection of affordances (e.g., by receiving unit 1914). In response to receiving a selection of affordances, the processing unit 1910 is further configured to provide the last released episode of the content series (e.g., by display enablement unit 1912) for display.

[0260] In some embodiments, a first release state is currently being released, and episodes of a content series are currently being broadcast live on their respective channels. Providing first contextual information based on recent release state activity includes providing affordances (e.g., by a display enablement unit 1912) for displaying each channel that is currently broadcasting an episode live, and the processing unit 1910 is further configured to receive a selection of affordances (e.g., by a receiving unit 1914). In response to receiving a selection of affordances, the processing unit 1910 is further configured to provide each channel that is currently broadcasting an episode live (e.g., by a display enablement unit 1912) for display.

[0261] In some embodiments, the user interface includes multiple columns, two or more of which include two or more menu items, and the first column of which includes contextual information based on the release status of the content series.

[0262] In some embodiments, Figure 20 shows a functional block diagram of an electronic device 2000 configured according to the principles of the various embodiments described. The functional blocks of this device are optionally implemented by hardware, software, or a combination of hardware and software to carry out the principles of the various embodiments described. Those skilled in the art will understand that the functional blocks described in Figure 20 can be optionally combined or separated into subblocks to carry out the principles of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or division of the functional blocks described herein, or further definitions.

[0263] As shown in Figure 20, the electronic device 2000 optionally includes a display unit 2002 configured to display a user interface including one or more user interface objects (e.g., content items, headings, etc.), an input unit 2004 (e.g., a touch-sensitive surface, keyboard, mouse, or other input unit) for receiving user input, selections, etc., and a processing unit 2010 connected to the display unit 2002 and the input unit 2004. In some embodiments, the processing unit 2010 optionally includes a display activation unit 2012, a receiving unit 2014, and a search unit 2016.

[0264] In some embodiments, the processing unit 2010 is configured to provide (e.g., by a display enablement unit 2012) a first affordance associated with a first content item and a second affordance associated with a non-content item for display. The processing unit 2010 is further configured to receive (e.g., by a receiving unit 2014) inputs for selecting a first affordance and an input for selecting a second affordance, and to provide (e.g., by a display enablement unit 2012) a list of content items for display, the list including a first content item and one or more further content items associated with a non-content item. In some embodiments, the first and second affordances are identical.

[0265] In some embodiments, the processing unit 2010 is further configured to provide a list of search results based on a search term (e.g., by a display enablement unit 2012) for display, and to provide a second affordance near the list of search results. In some embodiments, providing a list of content items includes searching based on a search term (e.g., by a search unit 2016) to obtain a further list of search results.

[0266] In some embodiments, providing a first affordance associated with a first content for display includes receiving a request (e.g., by a receiving unit 2014) to display information about the first content item on the display, and in response to receiving a request to display information about the first content item on the display, displaying information about the first content item (e.g., by a display activation unit 2012) and displaying a first affordance adjacent to the information about the first content item. Receiving an input to select a first affordance includes receiving an input (e.g., by a receiving unit 2014) corresponding to activating the first affordance while displaying the first affordance adjacent to the information about the first content item. Providing a second affordance associated with a non-content item for display includes receiving a request (e.g., by the receiving unit 2014) to display information about a non-content item on the display while information about a first content item is being displayed, and in response to receiving the request to display information about a non-content item on the display, replacing the display of information about the first content item with a display of information about the non-content item (e.g., by the display enablement unit 2012) and displaying a second affordance adjacent to the information about the non-content item (e.g., by the display enablement unit 2012). Receiving an input to select a second affordance includes receiving an input (e.g., by the receiving unit 2014) corresponding to activating the second affordance while the second affordance adjacent to the information about the non-content item is being displayed.

[0267] In some embodiments, the processing unit 2010 is further configured to provide a plurality of affordances corresponding to non-content items (for example, by the display activation unit 2012). The plurality of affordances include affordances corresponding to each non-content item and affordances corresponding to groupings of non-content items that include each non-content item and one or more other non-content items.

[0268] In some embodiments, the processing unit 2010 is further configured to provide a plurality of affordances corresponding to content items (for example, by the display activation unit 2012). The plurality of affordances include affordances corresponding to each content item and affordances corresponding to groupings of content items that include each content item and one or more other content items.

[0269] The above description is provided with reference to specific embodiments for illustrative purposes. However, the above illustrative description is not intended to be exhaustive or to limit the invention to the exact form disclosed. Many modifications and variations are possible considering the above teachings. These embodiments have been selected and described in order to best illustrate the principles of the invention and its practical applications, thereby enabling other persons skilled in the art to best use the invention and its various embodiments with various improvements suitable for specific applications that may be conceived.

Claims

1. In an electronic device that communicates with a display and one or more input devices, The system receives a request to display the viewing list user interface via one or more input devices, In response to receiving the request to display the viewing list user interface, display the viewing list user interface via the display, which includes a plurality of displays of a plurality of content items available via the electronic device, wherein the plurality of displays of the plurality of content items are selected to be included in the viewing list user interface based on user input associated with the plurality of content items. A method including, The aforementioned viewing list user interface A first display of the first content item of the plurality of content items, wherein the first content item has already been released when user input associated with adding the first content item to the viewing list user interface is detected, and the first content item is an on-demand content item, and a first display of the first content item, In accordance with the determination that a second content item different from the first content item was not yet released when the user input associated with adding the second content item to the viewing list user interface was detected, and in accordance with the determination that the second content item is now released, the second display of the second content item and Includes, A method in which, when the user input associated with adding the second content item to the viewing list user interface is detected, the viewing list user interface does not include a second display of the second content item, according to the determination that the second content item has not yet been released and according to the determination that the second content item is not currently released.

2. The method according to claim 1, wherein the first content item is one episode of a content episode series.

3. The method according to claim 1, wherein the first content item is a movie.

4. The method according to claim 1, wherein the second content item is one episode of a content episode series.

5. The method according to claim 4, wherein the user input associated with adding the second content item to the viewing list user interface is an input to add an episode series of the content to the viewing list user interface associated with the viewing list user interface.

6. The method according to claim 4, wherein the user input associated with adding the second content item to the viewing list user interface is an input to add the episode to the viewing list user interface.

7. The method according to claim 1, wherein the second content item is a movie.

8. The method according to claim 7, wherein the user input associated with adding the second content item to the viewing list user interface is an input to add an actor in the movie to the viewing list user interface associated with the viewing list user interface.

9. The method according to claim 7, wherein the user input associated with adding the second content item to the viewing list user interface is an input to add the movie to the viewing list associated with the viewing list user interface.

10. The method according to claim 1, wherein the second content item is a movie.

11. The method according to claim 10, wherein the user input associated with adding the second content item to the viewing list user interface is an input to add a sports player related to a sports game to the viewing list user interface associated with the viewing list user interface.

12. The method according to claim 10, wherein the user input associated with adding the second content item to the viewing list user interface is an input to add a sports league related to a sports game to the viewing list user interface.

13. While the viewing list user interface is displayed, selection inputs directed to the first display of the first content item are received via one or more input devices. In response to receiving the selection input directed to the first display of the first content item, playback of the first content item is started via the display, While the viewing list user interface is displayed, selection inputs directed to the second display of the first content item are received via one or more input devices. In response to receiving the selection input directed to the second display of the second content item, playback of the second content item is started via the display, The method according to claim 1, further comprising:

14. The method according to claim 1, wherein the user input associated with adding the second content item to the viewing list user interface is different from the user input for adding the second content item to the viewing list, and is a user input for adding a content category to the viewing list associated with the viewing list user interface.

15. After displaying the viewing list user interface in response to receiving a request to display the viewing list user interface, and while the viewing list user interface is not displayed, a second request to display the viewing list user interface is received via one or more input devices. In response to receiving a second request to display the viewing list user interface, the viewing list user interface, including the display of a third content item, is displayed via the display. It further includes, The method according to claim 1, wherein the third content item has not yet been released when a request to display the viewing list user interface is received, and the display of the third content item is included in the viewing list user interface displayed in response to receiving the second request to display the viewing list user interface based on the user input associated with adding the second content item to the viewing list user interface.

16. It is an electronic device, One or more processors, Memory and One or more programs, Equipped with, The one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing any of the methods according to claims 1 to 15. Electronic devices.

17. A non-temporary computer-readable storage medium for storing one or more programs, wherein the one or more programs include instructions, and when the instructions are executed by an electronic device having one or more processors and memory, the electronic device causes the electronic device to execute any of the methods according to claims 1 to 15.

Images