Shared content session user interface

The method enhances shared content session management by detecting inputs and providing notifications to streamline interactions, addressing inefficiencies and conserving power in electronic devices.

JP2025108423APending Publication Date: 2025-07-23APPLE INC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2025039121
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-04-28
Filing Date
2025-03-12
Publication Date
2025-07-23

AI Technical Summary

Technical Problem

Existing communication and information sharing techniques using electronic devices are cumbersome and inefficient, often requiring multiple key presses or keystrokes, wasting time and energy, particularly in battery-operated devices.

Method used

A method and system for managing shared content sessions that includes detecting inputs for outputting content, determining active shared content sessions, and providing notifications and outputs to efficiently manage content sharing, reducing cognitive burden and conserving power.

Benefits of technology

The solution provides faster, more efficient methods for managing shared content sessions, reducing user interaction and conserving battery power in electronic devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025108423000001_ABST
    Figure 2025108423000001_ABST
Patent Text Reader

Abstract

To provide a method and a user interface for managing a shared content session.SOLUTION: A method includes detecting 702 a first set of one or more inputs corresponding to a request to output content via one or more input devices, and in response to detecting 704 the first set of one or more inputs corresponding to the request to output content, enabling a computer system to output the respective content when the shared content session is active 706 in accordance with a determination that an active shared content session exists between the computer system and a computer system associated with the external computer system, outputting 708 a first notification and / or an audible notification including an indication that the content is being output by the external computer system via an output generating component of one or more output generating components 710.SELECTED DRAWING: Figure 7
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] (Cross - Reference to Related Applications) This application claims the benefit of priority of U.S. Provisional Patent Application No. 63 / 189,156, filed May 15, 2021, entitled "SHARED - CONTENT SESSION USER INTERFACES"; U.S. Provisional Patent Application No. 63 / 197,445, filed Jun. 6, 2021, entitled "SHARED - CONTENT SESSION USER INTERFACES"; U.S. Provisional Patent Application No. 63 / 302,511, filed Jan. 24, 2022, entitled "SHARED - CONTENT SESSION USER INTERFACES"; U.S. Patent Application No. 17 / 483,542, filed Sep. 23, 2021, entitled "SHARED - CONTENT SESSION USER INTERFACES"; U.S. Patent Application No. 17 / 483,564, filed Sep. 23, 2021, entitled "SHARED - CONTENT SESSION USER INTERFACES"; U.S. Patent Application No. 17 / 483,549, filed Sep. 23, 2021, entitled "SHARED - CONTENT SESSION USER INTERFACES"; U.S. Patent Application No. 17 / 483,679, filed Sep. 23, 2021, entitled "SHARED - CONTENT SESSION USER INTERFACES"; U.S. Patent Application No. 17 / 483,582, filed Sep. 23, 2021, entitled "SHARED - CONTENT SESSION USER INTERFACES"; U.S. Patent Application No. 17 / 484,899, filed Sep. 24, 2021, entitled "SHARED - CONTENT SESSION USER INTERFACES"; and U.S. Patent Application No. 17 / 732,204, filed Apr. 28, 2022, entitled "SHARED - CONTENT SESSION USER INTERFACES". The contents of these applications are hereby incorporated by reference in their entirety into this specification.

[0002] This disclosure generally relates to computer user interfaces, and more particularly, to techniques for managing shared content sessions. BACKGROUND OF THE INVENTION

[0003] A computer system can include hardware and / or software for displaying interfaces for various types of communication and information sharing. SUMMARY OF THE INVENTION

[0004] Some techniques for communication and information sharing using electronic devices are generally cumbersome and inefficient. For example, some existing techniques use complex and time-consuming user interfaces that may involve multiple key presses or keystrokes. Existing techniques take more time than necessary and waste the user's time and the device's energy. This latter consideration is particularly important in battery-operated devices.

[0005] The present technology provides an electronic device with faster and more efficient methods and interfaces for managing shared content sessions. Such methods and interfaces optionally complement or replace other methods for managing shared content sessions. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. In the case of battery-operated computing devices, such methods and interfaces conserve power and increase the battery charge interval.

[0006] According to some embodiments, a method is described. The method is executed on a computer system that communicates with one or more output generation components and one or more input devices. The method includes detecting, via one or more input devices, a first set of one or more inputs corresponding to a request to output content, and, in response to detecting the first set of one or more inputs corresponding to a request to output content, determining that there is an active shared content session between the computer system and an external computer system, the shared content session enabling the computer system to output individual content while the individual content is being output by the external computer system when the shared content session is active, and outputting, via an output generation component of the one or more output generation components, a first notification including an indication that the content is being output by the external computer system when the content is being output by the computer system, and outputting the content via an output generation component of the one or more output generation components.

[0007] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs detect a first set of one or more inputs corresponding to a request to output content via the one or more input devices, and in response to detecting the first set of one or more inputs corresponding to the request to output content, determine that there is an active shared content session between the computer system and an external computer system, where the shared content session, when active, enables the computer system to output individual content while the external computer system is outputting individual content. According to the determination, a first notification is output via an output generation component of the one or more output generation components, the first notification including an indication that when the content is output by the computer system, the content is also output by the external computer system, and instructions to output the content via the output generation component of the one or more output generation components are included.

[0008] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs detect a first set of one or more inputs corresponding to a request to output content via the one or more input devices, and in response to detecting the first set of one or more inputs corresponding to the request to output content, determine that there is an active shared content session between the computer system and an external computer system, where the shared content session enables the computer system to output individual content while the individual content is being output by the external computer system when the shared content session is active. According to the determination, a first notification is output via an output generation component of the one or more output generation components, the first notification including an indication that the content is being output by the external computer system when the content is being output by the computer system, and instructions to output the content via an output generation component of the one or more output generation components are included.

[0009] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more output generation components and one or more input devices. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs detect a first set of one or more inputs corresponding to a request to output content via the one or more input devices, and in response to detecting the first set of one or more inputs corresponding to the request to output content, determine that there is an active shared content session between the computer system and an external computer system, where when the shared content session is active, the computer system is enabled to output individual content while individual content is being output by the external computer system. According to the determination that there is an active shared content session, a first notification is output via an output generation component of the one or more output generation components, the first notification including an indication that the content is being output by the external computer system when the content is output by the computer system, and includes an instruction to output the content via an output generation component of the one or more output generation components.

[0010] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more output generation components and one or more input devices. The computer system includes means for detecting, via the one or more input devices, a first set of one or more inputs corresponding to a request to output content, and, in response to detecting the first set of one or more inputs corresponding to a request to output content, a determination that there exists an active shared content session between the computer system and an external computer system, the shared content session enabling the computer system to output individual content while the external computer system is outputting individual content when the shared content session is active, and outputting, via an output generation component of the one or more output generation components, a first notification including an indication that the content is output by the external computer system when the content is output by the computer system, and means for outputting the content via an output generation component of the one or more output generation components.

[0011] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs detect a first set of one or more inputs corresponding to a request to output content via the one or more input devices, and in response to detecting the first set of one or more inputs corresponding to the request to output content, determine that there is an active shared content session between the computer system and an external computer system, where the shared content session, when active, enables the computer system to output individual content while the individual content is being output by the external computer system. According to the determination that there is a shared content session, a first notification is output via an output generation component of the one or more output generation components, the first notification including an indication that the content is being output by the external computer system when the content is being output by the computer system, and includes instructions to output the content via an output generation component of the one or more output generation components.

[0012] According to some embodiments, a method is described that is executed in a computer system communicating with one or more output generation components and one or more input devices. The method includes receiving an indication that first content, which is associated with a first application on the computer system, has been selected for a shared content session in an external computer system while displaying a first user interface via an output generation component of the one or more output generation components during an active shared content session between the computer system and the external computer system; outputting a first notification generated by a second application different from the first application associated with the first content via an output generation component of the one or more output generation components in response to receiving the indication that the first content has been selected for the shared content session; and after outputting the first notification, outputting the first content using the first application associated with the first content via an output generation component of the one or more output generation components during an active shared content session between the computer system and the external computer system.

[0013] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs, via an output generation component among the one or more output generation components, while displaying a first user interface while a shared content session between the computer system and an external computer system is active, receive an indication that a first content, which is related to a first application on the computer system and is the first content for the shared content session in the external computer system, has been selected. In response to receiving the indication that the first content has been selected for the shared content session, output a first notification generated by a second application different from the first application associated with the first content, via the output generation component among the one or more output generation components. After outputting the first notification, while the shared content session between the computer system and the external computer system is active, output the first content using the first application associated with the first content, via the output generation component among the one or more output generation components. The instructions include.

[0014] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generating components and one or more input devices. The one or more programs, via an output generating component among the one or more output generating components, while displaying a first user interface while a shared content session between the computer system and an external computer system is active, for the shared content session in the external computer system, receive an indication that a first content, which is associated with a first application on the computer system, has been selected. In response to receiving the indication that the first content has been selected for the shared content session, output a first notification generated by a second application different from the first application associated with the first content, via the output generating component among the one or more output generating components. After outputting the first notification, while the shared content session between the computer system and the external computer system is active, via the output generating component among the one or more output generating components, use the first application associated with the first content to output the first content, including instructions.

[0015] According to some embodiments, a computer system configured to communicate with one or more output generation components and one or more input devices is described. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs, while displaying a first user interface via an output generation component among the one or more output generation components while a shared content session between the computer system and an external computer system is active, receive an indication that, for the shared content session in the external computer system, first content, which is associated with a first application on the computer system, has been selected. In response to receiving the indication that the first content has been selected for the shared content session, output a first notification generated by a second application different from the first application associated with the first content via an output generation component among the one or more output generation components. After outputting the first notification, while the shared content session between the computer system and the external computer system is active, output the first content using the first application associated with the first content via an output generation component among the one or more output generation components.

[0016] According to some embodiments, a computer system configured to communicate with one or more output generation components and one or more input devices is described. The computer system, while a shared content session between the computer system and an external computer system is active, displays a first user interface via an output generation component of the one or more output generation components, and receives an indication that first content, which is associated with a first application on the computer system, has been selected for the shared content session in the external computer system. In response to receiving the indication that the first content has been selected for the shared content session, the computer system outputs a first notification generated by a second application different from the first application associated with the first content via an output generation component of the one or more output generation components. After outputting the first notification, while the shared content session between the computer system and the external computer system is active, the computer system outputs the first content using the first application associated with the first content via an output generation component of the one or more output generation components.

[0017] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicate with one or more output generation components and one or more input devices. The one or more programs, via an output generation component among the one or more output generation components, receive an indication that, while a shared content session between the computer system and an external computer system is active and a first user interface is being displayed, first content associated with a first application on the computer system has been selected for the shared content session in the external computer system. In response to receiving the indication that the first content has been selected for the shared content session, output, via an output generation component among the one or more output generation components, a first notification generated by a second application different from the first application associated with the first content, and after outputting the first notification, while the shared content session between the computer system and the external computer system is active, output the first content using the first application associated with the first content, via an output generation component among the one or more output generation components.

[0018] According to some embodiments, a method is described. The method is executed on a computer system that communicates with one or more output generating components and one or more input devices. The method includes receiving, via one or more input devices, an input corresponding to a request to add first content to a shared content session between the computer system and an external computer system, and in response to receiving the input, outputting an alert that includes an option to cancel adding the first content to the shared content session before the first content is added to the shared content session, according to a determination that the first content is of a first type of content, and an alert that the first content will be added to the shared content session; and adding the first content to the shared content session without outputting an alert that the first content will be added to the shared content session before the first content is added to the shared content session, according to a determination that the first content is of a second type of content that is different from the first type of content.

[0019] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs receive an input corresponding to a request to add first content to a shared content session between the computer system and an external computer system via the one or more input devices, and in response to receiving the input, before adding the first content to the shared content session, according to a determination that the first content is of a first type of content, an alert including an option to cancel adding the first content to the shared content session before the first content is added to the shared content session outputs an alert that the first content will be added to the shared content session, and according to a determination that the first content is of a second type of content different from the first type, without outputting an alert indicating that the first content is added to the shared content session before the first content is added to the shared content session, add the first content to the shared content session, including instructions.

[0020] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs receive, via the one or more input devices, an input corresponding to a request to add first content to a shared content session between the computer system and an external computer system, and in response to receiving the input, according to a determination that the first content is of a first type of content, and before adding the first content to the shared content session, an alert including an option to cancel adding the first content to the shared content session before the first content is added to the shared content session outputs an alert that the first content is going to be added to the shared content session, and according to a determination that the first content is of a second type of content different from the first type, without outputting an alert indicating that the first content is added to the shared content session before the first content is added to the shared content session, includes instructions to add the first content to the shared content session.

[0021] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more output generating components and one or more input devices. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs receive an input corresponding to a request to add first content to a shared content session between the computer system and an external computer system via the one or more input devices, and in response to receiving the input, according to a determination that the first content is of a first type of content and before adding the first content to the shared content session, an alert including an option to cancel adding the first content to the shared content session before the first content is added to the shared content session outputs an alert that the first content is going to be added to the shared content session, and according to a determination that the first content is of a second type of content different from the first type, without outputting an alert indicating that the first content is to be added to the shared content session before the first content is added to the shared content session, add the first content to the shared content session, including instructions.

[0022] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more output generation components and one or more input devices. The computer system includes means for receiving, via one or more input devices, an input corresponding to a request to add first content to a shared content session between the computer system and an external computer system, and, in response to receiving the input, an alert including an option to cancel adding the first content to the shared content session before the first content is added to the shared content session, according to a determination that the first content is of a first type of content, outputting an alert that the first content is going to be added to the shared content session, and means for adding the first content to the shared content session without outputting an alert that the first content is going to be added to the shared content session before the first content is added to the shared content session, according to a determination that the first content is of a second type of content different from the first type of content.

[0023] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs receive, via the one or more input devices, an input corresponding to a request to add first content to a shared content session between the computer system and an external computer system, and in response to receiving the input, according to a determination that the first content is of a first type of content, and before adding the first content to the shared content session, an alert including an option to cancel the addition of the first content to the shared content session before the first content is added to the shared content session outputs an alert that the first content will be added to the shared content session, and according to a determination that the first content is of a second type of content different from the first type, before the first content is added to the shared content session, without outputting an alert indicating that the first content will be added to the shared content session, includes instructions to add the first content to the shared content session.

[0024] According to some embodiments, a method is described. The method is executed on a computer system that communicates with one or more output generation components and one or more input devices. The method includes receiving, via one or more input devices, input corresponding to a request to display a first user interface of a first application, and, in response to receiving the input, determining that a first set of criteria is met, when a shared content session between the computer system and an external computer system is active, the shared content session enabling the computer system to output individual content while the individual content is being output by the external computer system, and the first application is capable of playing content that can be added to the shared content session, outputting, via one of the one or more output generation components, an indication that the first application is capable of playing content that can be added to the shared content session, and outputting the first user interface for the first application, and, in accordance with a determination that the first set of criteria is not met, outputting the first user interface for the first application without outputting an indication that the first application is capable of playing content that can be added to the shared content session.

[0025] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs receive, via the one or more input devices, an input corresponding to a request to display a first user interface of a first application, and in response to receiving the input, a shared content session between the computer system and an external computer system, where when the shared content session is active, the computer system is enabled to output individual content while the individual content is being output by the external computer system. When the shared content session is active and the first application can play content that can be added to the shared content session, according to a determination that a first set of criteria is met, an indication that the first application can play content that can be added to the shared content session is output via one of the one or more output generation components, the first user interface for the first application is output, and according to a determination that the first set of criteria is not met, the first user interface for the first application is output without outputting an indication that the first application can play content that can be added to the shared content session. The instructions include.

[0026] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs receive, via the one or more input devices, an input corresponding to a request to display a first user interface of a first application, and in response to receiving the input, a shared content session between the computer system and an external computer system, wherein when the shared content session is active, the computer system is enabled to output individual content while the individual content is being output by the external computer system. When the first application can play content that can be added to the shared content session and a determination is made that a first set of criteria is met, an indication that the first application can play content that can be added to the shared content session is output via one of the one or more output generation components, the first user interface for the first application is output, and when a determination is made that the first set of criteria is not met, the first user interface for the first application is output without outputting an indication that the first application can play content that can be added to the shared content session. The instructions include.

[0027] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more output generation components and one or more input devices. The computer system includes one or more processors, one or more programs configured to be executed by the one or more processors, and a memory storing the one or more programs. The one or more programs receive an input corresponding to a request to display a first user interface of a first application via the one or more input devices, and in response to receiving the input, a shared content session between the computer system and an external computer system, where when the shared content session is active, the computer system is enabled to output individual content while the individual content is being output by the external computer system. When the shared content session is active and the first application can play content that can be added to the shared content session, according to a determination that a first set of criteria is met, an indication that the first application can play content that can be added to the shared content session is output via one of the one or more output generation components, the first user interface for the first application is output, and according to a determination that the first set of criteria is not met, the first user interface for the first application is output without outputting an indication that the first application can play content that can be added to the shared content session.

[0028] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more output generation components and one or more input devices. The computer system includes means for receiving, via the one or more input devices, an input corresponding to a request to display a first user interface of a first application, and, in response to receiving the input, a shared content session between the computer system and an external computer system, where when the shared content session is active, the computer system is able to output individual content while the individual content is being output by the external computer system, and if the first application is able to play content that can be added to the shared content session, outputting, via one of the one or more output generation components, an indication that the first application can play content that can be added to the shared content session according to a determination that a first set of criteria is met, outputting the first user interface for the first application, and, according to a determination that the first set of criteria is not met, outputting the first user interface for the first application without outputting an indication that it is possible to play content that the first application can be added to the shared content session.

[0029] According to some embodiments, a computer program product is described. The computer program product includes one or more processors of a computer system that communicate with one or more output generation components and one or more input devices. The one or more programs receive, via the one or more input devices, an input corresponding to a request to display a first user interface of a first application, and in response to receiving the input, a shared content session between the computer system and an external computer system, where the shared content session, when active, enables the computer system to output individual content while the individual content is being output by the external computer system. When the first application can play content that can be added to the shared content session and a determination is made that a first set of criteria is met, an indication that the first application can play content that can be added to the shared content session is output via one of the one or more output generation components, the first user interface for the first application is output, and when a determination is made that the first set of criteria is not met, the first user interface for the first application is output without outputting an indication that the first application can play content that can be added to the shared content session. The instructions include this.

[0030] According to some embodiments, a method is described. The method is executed on a computer system that communicates with one or more output generation components and one or more input devices. The method includes receiving first data associated with a request to add first content to a shared content session between an external computer system and the computer system, and in response to receiving the first data associated with the request to add the first content to the shared content session, outputting the first content via an output generation component of the one or more output generation components according to a determination that content output criteria are met based on whether the content is available for being output by the computer system in a predetermined manner, and outputting a notification that the first content has been added to the shared content session without outputting the first content in the computer system via an output generation component of the one or more output generation components according to a determination that the content output criteria are not met.

[0031] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices, and the one or more programs receive first data associated with a request to add first content to a shared content session between an external computer system and the computer system, and in response to receiving the first data associated with the request to add the first content to the shared content session, according to a determination that content output criteria are met based on whether the content is available for being output by the computer system in a predetermined manner, output the first content via an output generation component among the one or more output generation components, and according to a determination that the content output criteria are not met, output a notification that the first content has been added to the shared content session without outputting the first content in the computer system via an output generation component among the one or more output generation components, including instructions.

[0032] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs receive first data associated with a request to add first content to a shared content session between an external computer system and the computer system, and in response to receiving the first data associated with the request to add the first content to the shared content session, according to a determination that content output criteria are met based on whether the content is available for output by the computer system in a predetermined manner, output the first content via an output generation component among the one or more output generation components, and according to a determination that the content output criteria are not met, output a notification that the first content has been added to the shared content session without outputting the first content in the computer system via an output generation component among the one or more output generation components, including instructions.

[0033] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more output generation components and one or more input devices. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs receive first data associated with a request to add first content to a shared content session between an external computer system and the computer system, and in response to receiving the first data associated with the request to add the first content to the shared content session, according to a determination that content output criteria are met, which is based on whether the content is available for being output by the computer system in a predetermined manner, output the first content via an output generation component among the one or more output generation components, and according to a determination that the content output criteria are not met, output a notification that the first content has been added to the shared content session without outputting the first content in the computer system via an output generation component among the one or more output generation components, including instructions.

[0034] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more output generation components and one or more input devices. The computer system includes means for receiving first data associated with a request to add first content to a shared content session between an external computer system and the computer system, and in response to receiving the first data associated with the request to add first content to the shared content session, according to a determination that content output criteria are met based on whether the content is available for being output by the computer system in a predetermined manner, output the first content via an output generation component among the one or more output generation components, and according to a determination that the content output criteria are not met, output a notification that the first content has been added to the shared content session without outputting the first content in the computer system via an output generation component among the one or more output generation components.

[0035] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs receive first data associated with a request to add first content to a shared content session between an external computer system and the computer system, and in response to receiving the first data associated with the request to add the first content to the shared content session, according to a determination that content output criteria are met based on whether the content is available for output by the computer system in a predetermined manner, output the first content via an output generation component of the one or more output generation components, and according to a determination that the content output criteria are not met, output, via an output generation component of the one or more output generation components, a notification that the first content has been added to the shared content session without outputting the first content in the computer system.

[0036] According to some embodiments, a method is described. The method is executed on a computer system that communicates with one or more output generation components and one or more input devices. The method includes, via one of the one or more output generation components, displaying a messaging interface for an individual message conversation in a message display area for the individual message conversation among two or more participants of the individual message conversation, the message display area including a plurality of messages from different participants to other participants in the message conversation, and a graphical representation of an ongoing shared content session with one or more participants of the message conversation, the graphical representation of the ongoing shared content session including first information regarding one or more parameters of the shared content session, the content of the shared content session and the participant status of the shared content session. After displaying the messaging interface and after one or more parameters of the ongoing shared content session change, receiving a request to display a portion of the individual message conversation that includes the graphical representation of the shared content session. In response to receiving the request to display a portion of the individual message conversation that includes the graphical representation of the shared content session, displaying, together with an updated graphical representation of the ongoing shared content session, which includes second information regarding one or more parameters of the shared content session that is different from the first information and includes different content in the shared content session and / or different participant status in the shared content session, a plurality of messages from different participants to other participants in the message conversation.

[0037] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs, via one of the one or more output generation components, display a messaging interface for an individual message conversation that includes a message display area for messages between two or more participants of the individual message conversation, the messages including a plurality of messages from different participants of the message conversation to other participants, and a graphical representation of an ongoing shared content session with one or more participants of the message conversation. The graphical representation of the ongoing shared content session includes first information regarding one or more parameters of the ongoing shared content session, including content in the shared content session and participant status in the shared content session. After displaying the messaging interface and after one or more parameters of the ongoing shared content session change, receive a request to display a portion of the individual message conversation that includes the graphical representation of the ongoing shared content session. In response to receiving the request to display a portion of the individual message conversation that includes the graphical representation of the ongoing shared content session, display, along with an updated graphical representation of the ongoing shared content session, which includes second information regarding one or more parameters of the ongoing shared content session that is different from the first information, including different content in the shared content session and / or different participant status in the shared content session, a plurality of messages from different participants to other participants in the message conversation.

[0038] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generating components and one or more input devices. The one or more programs, via one of the one or more output generating components, cause a message display area of an individual message conversation including a plurality of messages from different participants to other participants among two or more participants of the individual message conversation and a graphical representation of an ongoing shared content session with one or more participants of the message conversation to be simultaneously displayed, where the graphical representation of the ongoing shared content session includes first information regarding one or more parameters of the shared content session, including content in the shared content session and participant status in the shared content session. After displaying the messaging interface and after one or more parameters of the ongoing shared content session change, a request to display a portion of the individual message conversation including the graphical representation of the shared content session is received. In response to receiving the request to display a portion of the individual message conversation including the graphical representation of the shared content session, a message conversation including a plurality of messages from different participants to other participants in the message conversation is displayed together with an updated graphical representation of the ongoing shared content session, the updated graphical representation of the ongoing shared content session including second information regarding one or more parameters of the shared content session that is different from the first information, including different content in the shared content session and / or different participant status in the shared content session.

[0039] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more output generating components and one or more input devices. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include displaying a messaging interface for an individual message conversation, which includes a message display area for a plurality of messages from different participants to other participants among two or more participants of the individual message conversation via an output generating component among the one or more output generating components, and a graphical representation of an ongoing shared content session with one or more participants of the message conversation, where the graphical representation of the ongoing shared content session includes first information about one or more parameters of the shared content session, including content within the shared content session and participant status within the shared content session. After displaying the messaging interface and after one or more parameters of the ongoing shared content session change, receiving a request to display a portion of the individual message conversation that includes the graphical representation of the shared content session, and in response to receiving the request to display a portion of the individual message conversation that includes the graphical representation of the shared content session, displaying, together with an updated graphical representation of the ongoing shared content session, which includes second information different from the first information about one or more parameters of the shared content session, including different content in the shared content session and / or different participant status in the shared content session, a plurality of messages from different participants to other participants in the message conversation, including instructions.

[0040] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more output generating components and one or more input devices. The computer system, via an output generating component among the one or more output generating components, displays simultaneously a message display area for an individual message conversation between two or more participants of the individual message conversation, including a plurality of messages from different participants to other participants in the message conversation, and a graphical representation of an ongoing shared content session with one or more participants of the message conversation, including first information regarding one or more parameters of the shared content session, including content in the shared content session and participant status in the shared content session, for means of displaying a messaging interface for the individual message conversation; after displaying the messaging interface, after one or more parameters of the ongoing shared content session are changed, means for receiving a request to display a part of the individual message conversation including the graphical representation of the shared content session; in response to receiving a request to display a part of the individual message conversation including the graphical representation of the shared content session, an updated graphical representation of the ongoing shared content session, including second information regarding one or more parameters of the shared content session, different from the first information, including different content in the shared content session and / or different participant status in the shared content session, and means for displaying a plurality of messages from different participants to other participants in the message conversation, together with the updated graphical representation of the ongoing shared content session.

[0041] According to some embodiments, a computer program product is described. The computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs include displaying a messaging interface for an individual message conversation that includes, via one of the one or more output generation components, a message display area for messages of the individual message conversation including a plurality of messages from different participants to other participants among two or more participants of the individual message conversation, and a graphical representation of an ongoing shared content session with one or more participants of the message conversation, the graphical representation of the ongoing shared content session including first information regarding one or more parameters of the ongoing shared content session including the content in the shared content session and the participant status in the shared content session, simultaneously displaying the graphical representation of the ongoing shared content session; after displaying the messaging interface and after one or more parameters of the ongoing shared content session have changed, receiving a request to display a portion of the individual message conversation including the graphical representation of the ongoing shared content session, and in response to receiving the request to display a portion of the individual message conversation including the graphical representation of the ongoing shared content session, displaying a plurality of messages from different participants to other participants in the message conversation, together with an updated graphical representation of the ongoing shared content session, the updated graphical representation of the ongoing shared content session including second information regarding one or more parameters of the ongoing shared content session that is different from the first information, including different content in the shared content session and / or different participant status in the shared content session.

[0042] According to some embodiments, a method is described. The method is executed on a computer system that communicates with one or more output generation components and one or more input devices. The method includes receiving, via one or more input devices, a request to display information associated with a shared content session while the shared content session between the computer system and one or more external computer systems is active; in response to receiving the request to display information associated with the shared content session, displaying, via an output generation component of the one or more output generation components, an indication of one or more participants in the shared content session and one or more users who have been invited to the shared content session but have not participated in the shared content session; displaying, via an output generation component of the one or more output generation components, a representation of a first content according to a determination that the shared content session includes the first content; and displaying, via an output generation component of the one or more output generation components, a representation of a second content different from the representation of the first content according to a determination that the shared content session includes a second content different from the first content.

[0043] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs, while a shared content session between the computer system and one or more external computer systems is active, receive, via one or more input devices, a request to display information associated with the shared content session, and in response to receiving the request to display information associated with the shared content session, display, via an output generation component among the one or more output generation components, an indication of one or more participants in the shared content session and one or more users who have been invited to the shared content session but have not participated in the shared content session, display, via an output generation component among the one or more output generation components, a representation of a first content according to a determination that the shared content session includes the first content, and display, via an output generation component among the one or more output generation components, a representation of a second content different from the representation of the first content according to a determination that the shared content session includes a second content different from the first content, including instructions.

[0044] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs, while a shared content session between the computer system and one or more external computer systems is active, receive, via one or more input devices, a request to display information associated with the shared content session, and in response to receiving the request to display information associated with the shared content session, display, via an output generation component of the one or more output generation components, an indication of one or more participants in the shared content session and one or more users who have been invited to but have not participated in the shared content session, display, via an output generation component of the one or more output generation components, a representation of a first content according to a determination that the shared content session includes the first content, and display, via an output generation component of the one or more output generation components, a representation of a second content different from the representation of the first content according to a determination that the shared content session includes a second content different from the first content, including instructions.

[0045] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more output generating components and one or more input devices. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs, while a shared content session between the computer system and one or more external computer systems is active, receive, via one or more input devices, a request to display information associated with the shared content session, and in response to receiving the request to display information associated with the shared content session, display, via an output generating component of the one or more output generating components, an indication of one or more participants in the shared content session and one or more users who have been invited to the shared content session but have not participated in the shared content session, display, via an output generating component of the one or more output generating components, a representation of a first content according to a determination that the shared content session includes the first content, and display, via an output generating component of the one or more output generating components, a representation of a second content different from the representation of the first content according to a determination that the shared content session includes a second content different from the first content, including instructions.

[0046] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more output generation components and one or more input devices. The computer system receives, via one or more input devices, a request to display information associated with a shared content session while the shared content session between the computer system and one or more external computer systems is active, and in response to receiving the request to display information associated with the shared content session, via an output generation component of the one or more output generation components, displays an indication of one or more participants in the shared content session and one or more users who have been invited to the shared content session but have not participated in the shared content session, and according to a determination that the shared content session includes a first content, via an output generation component of the one or more output generation components, displays a representation of the first content, and according to a determination that the shared content session includes a second content different from the first content, via an output generation component of the one or more output generation components, displays a representation of the second content different from the representation of the first content, comprising means.

[0047] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicate with one or more output generation components and one or more input devices. The one or more programs receive, via the one or more input devices, a request to display information associated with a shared content session while the shared content session between the computer system and one or more external computer systems is active. In response to receiving the request to display information associated with the shared content session, the one or more programs display, via an output generation component of the one or more output generation components, an indication of one or more participants in the shared content session and one or more users who have been invited to the shared content session but have not participated in the shared content session. According to a determination that the shared content session includes a first content, the one or more programs display, via an output generation component of the one or more output generation components, a representation of the first content. According to a determination that the shared content session includes a second content different from the first content, the one or more programs display, via an output generation component of the one or more output generation components, a representation of the second content different from the representation of the first content, including instructions.

[0048] According to some embodiments, a method is described that is executed in a computer system communicating with one or more output generating components and one or more input devices. The method is a shared content session between the computer system and one or more external computer systems, and when the shared content session is active, the computer system is enabled to output individual content while the individual content is being output by the one or more external computer systems. The shared content session is active, and while a plurality of application interface regions including at least a portion of a first application interface region and at least a portion of a second application interface region are simultaneously displayed within the user interface, receiving, via one or more input devices, a set of one or more inputs corresponding to a request to add an application interface to the shared content session; and in response to receiving a first input within the set of one or more inputs, displaying, at a location visually associated with the first application interface region within the user interface, a first graphical interface object that is selectable to add the first application interface region to the shared content session without adding the second application interface region to the shared content session, wherein the first graphical interface object is not visually associated with the second application interface region.

[0049] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generating components and one or more input devices. The one or more programs enable a shared content session between the computer system and one or more external computer systems. When the shared content session is active, the computer system is enabled to output individual content while individual content is being output by the one or more external computer systems. While the shared content session is active and while a plurality of application interface regions including at least a portion of a first application interface region and at least a portion of a second application interface region are simultaneously displayed in a user interface, receive, via the one or more input devices, a set of one or more inputs corresponding to a request to add an application interface to the shared content session. In response to receiving a first input within the set of one or more inputs, display a first graphical interface object that is selectable to add the first application interface region to the shared content session without adding the second application interface region to the shared content session at a location visually associated with the first application interface region within the user interface, wherein the first graphical interface object is not visually associated with the second application interface region, the first graphical interface object including an instruction to display the first graphical interface object.

[0050] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs enable, during a shared content session between the computer system and one or more external computer systems, the computer system to output individual content while individual content is being output by the one or more external computer systems. While the shared content session is active and while a plurality of application interface regions including at least a portion of a first application interface region and at least a portion of a second application interface region are simultaneously displayed in a user interface, receive, via the one or more input devices, a set of one or more inputs corresponding to a request to add an application interface to the shared content session. In response to receiving a first input within the set of one or more inputs, display a first graphical interface object selectable to add the first application interface region to the shared content session without adding the second application interface region to the shared content session at a location visually associated with the first application interface region within the user interface, wherein the first graphical interface object is not visually associated with the second application interface region, the first graphical interface object including an instruction to display the first graphical interface object.

[0051] According to some embodiments, a computer system configured to communicate with one or more output generating components and one or more input devices is described. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include a shared content session between the computer system and one or more external computer systems. The shared content session enables the computer system to output individual content while individual content is being output by the one or more external computer systems when the shared content session is active. While the shared content session is active and while a plurality of application interface regions including at least a portion of a first application interface region and at least a portion of a second application interface region are simultaneously displayed in a user interface, receive a set of one or more inputs corresponding to a request to add an application interface to the shared content session via the one or more input devices. In response to receiving a first input within the set of one or more inputs, display a first graphical interface object selectable to add the first application interface region to the shared content session without adding the second application interface region to the shared content session at a location visually associated with the first application interface region within the user interface, where the first graphical interface object is not visually associated with the second application interface region, the first graphical interface object including an instruction to display the first graphical interface object.

[0052] According to some embodiments, a computer system is described that is configured to communicate with one or more output generating components and one or more input devices. The computer system is a shared content session between the computer system and one or more external computer systems, and when the shared content session is active, the computer system is enabled to output individual content while individual content is being output by the one or more external computer systems. The shared content session is active, and while a plurality of application interface regions including at least a portion of a first application interface region and at least a portion of a second application interface region are simultaneously displayed within a user interface, one or more input devices are used to receive a set of one or more inputs corresponding to a request to add an application interface to the shared content session. In response to receiving a first input within the set of one or more inputs, a first graphical interface object that is selectable to add the first application interface region to the shared content session without adding the second application interface region to the shared content session to a location within the user interface visually associated with the first application interface region is displayed. The first graphical interface object is not visually associated with the second application interface region, and the means for displaying the first graphical interface object is included.

[0053] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs include a shared content session between the computer system and one or more external computer systems. The shared content session, when active, enables the computer system to output individual content while individual content is being output by the one or more external computer systems. While the shared content session is active and while a plurality of application interface regions including at least a portion of a first application interface region and at least a portion of a second application interface region are simultaneously displayed in a user interface, receiving, via the one or more input devices, a set of one or more inputs corresponding to a request to add an application interface to the shared content session, and in response to receiving a first input within the set of one or more inputs, displaying a first graphical interface object that is selectable to add the first application interface region to the shared content session without adding the second application interface region to a location visually associated with the first application interface region within the user interface, where the first graphical interface object is not visually associated with the second application interface region, including instructions to display the first graphical interface object.

[0054] According to some embodiments, a method is described that is executed in a computer system communicating with one or more output generation components and one or more input devices. The method includes a shared content session between the computer system and one or more external computer systems, where the shared content session, when active, enables the computer system to output individual content while individual content is being output by one or more external computer systems. While the shared content session is active, receiving data representing first content selected for the shared content session in an external computer system; and in response to receiving the data representing the first content selected for the shared content session, displaying a display area including a representation of the first content via an output generation component among the one or more output generation components. Displaying the display area includes displaying a representation of the first content having a first set of one or more controls visually associated with the representation of the first content for controlling the visual appearance of the display area according to a determination that a first set of criteria is not met, and displaying the representation of the first content without the first set of one or more controls for controlling the visual appearance of the display area according to a determination that the first set of criteria is met.

[0055] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs are a shared content session between the computer system and one or more external computer systems. When the shared content session is active, the computer system is enabled to output individual content while individual content is being output by the one or more external computer systems. While the shared content session is active, the computer system receives data representing first content selected for the shared content session in an external computer system, and in response to receiving the data representing the first content selected for the shared content session, via an output generation component among the one or more output generation components, displays a display area including a representation of the first content. Displaying the display area includes displaying a representation of the first content having a first set of one or more controls visually associated with the representation of the first content for controlling the visual appearance of the display area according to a determination that a first set of criteria is not met, and displaying the representation of the first content without the first set of one or more controls for controlling the visual appearance of the display area according to a determination that the first set of criteria is met.

[0056] According to some embodiments, a non - transitory computer - readable storage medium is described. The non - transitory computer - readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output - generating components and one or more input devices. The one or more programs are for a shared content session between the computer system and one or more external computer systems. The shared content session, when active, enables the computer system to output individual content while individual content is being output by one or more external computer systems. While the shared content session is active, the computer system receives data representing first content selected for the shared content session in an external computer system, and in response to receiving the data representing the first content selected for the shared content session, via an output - generating component among the one or more output - generating components, displays a display area including a representation of the first content. Displaying the display area includes displaying a representation of the first content having a first set of one or more controls visually associated with the representation of the first content for controlling the visual appearance of the display area according to a determination that a first set of criteria is not met, and displaying the representation of the first content without the first set of one or more controls for controlling the visual appearance of the display area according to a determination that the first set of criteria is met.

[0057] According to some embodiments, a computer system configured to communicate with one or more output generation components and one or more input devices is described. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include a shared content session between the computer system and one or more external computer systems. When the shared content session is active, the computer system is enabled to output individual content while individual content is being output by the one or more external computer systems. While the shared content session is active, the computer system receives data representing first content selected for the shared content session in an external computer system, and in response to receiving the data representing the first content selected for the shared content session, via an output generation component of the one or more output generation components, displays a display area including a representation of the first content. Displaying the display area includes displaying a representation of the first content having a first set of one or more controls visually associated with the representation of the first content for controlling the visual appearance of the display area according to a determination that a first set of criteria is not met, and displaying the representation of the first content without the first set of one or more controls for controlling the visual appearance of the display area according to a determination that the first set of criteria is met.

[0058] According to some embodiments, a computer system configured to communicate with one or more output generation components and one or more input devices is described. The computer system is a shared content session between the computer system and one or more external computer systems, and when the shared content session is active, while individual content is being output by one or more external computer systems, the computer system is enabled to output the individual content. While the shared content session is active, it receives data representing a first content selected for the shared content session in an external computer system, and in response to receiving the data representing the first content selected for the shared content session, via an output generation component among the one or more output generation components, it includes means for displaying a display area including a representation of the first content. Displaying the display area includes displaying a representation of the first content having a first set of one or more controls visually associated with the representation of the first content for controlling the visual appearance of the display area according to a determination that a first set of criteria is not met, and displaying the representation of the first content without the first set of one or more controls for controlling the visual appearance of the display area according to a determination that the first set of criteria is met.

[0059] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs are for a shared content session between the computer system and one or more external computer systems. The shared content session, when active, enables the computer system to output individual content while individual content is being output by the one or more external computer systems. While the shared content session is active, the computer system receives data representing first content selected for the shared content session in an external computer system. In response to receiving the data representing the first content selected for the shared content session, the computer program product includes instructions to display a display area including a representation of the first content via an output generation component of the one or more output generation components. Displaying the display area includes displaying a representation of the first content having a first set of one or more controls visually associated with the representation of the first content for controlling a visual appearance of the display area according to a determination that a first set of criteria is not met, and displaying the representation of the first content without the first set of one or more controls for controlling a visual appearance of the display area according to a determination that the first set of criteria is met.

[0060] According to some embodiments, a method is described. The method is executed on a computer system that communicates with one or more output generation components and one or more input devices. The method includes, via one or more output generation components, displaying a first user interface that, in a first user interface, simultaneously displays a view of the content of a shared content session that is displayed over a background user interface and a first representation of a participant in a real-time communication session, the first representation of the participant in the real-time communication session being displayed at a first separate location relative to the view of the content of the shared content session; receiving a request to move the view of the content within the first user interface while the first user interface is being displayed; in response to receiving the request to move the view of the content, moving the view of the content according to the request and moving the first representation of the participant such that the first representation of the participant is displayed at the first separate location relative to the view of the content of the shared content session; after moving the view of the content and the first representation of the participant, detecting a request to stop displaying the view of the content of the shared content session on the background user interface; and in response to detecting the request to stop displaying the view of the content of the shared content session on the background user interface, displaying, via one or more output generation components, a view of the content that is not displayed on the background user interface without displaying the representation of the participant at the first separate location relative to the view of the content of the shared content session.

[0061] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicate with one or more output generating components and one or more input devices. The one or more programs include, at a first user interface, displaying, via one or more output generating components, a view of the content of a shared content session that is displayed over a background user interface, and a first representation of a participant in a real-time communication session, where the first representation of the participant in the real-time communication session is displayed at a first separate location relative to the view of the content of the shared content session, simultaneously; receiving a request to move the view of the content within the first user interface while the first user interface is being displayed; in response to receiving the request to move the view of the content, moving the view of the content according to the request and moving the first representation of the participant so that the first representation of the participant is displayed at the first separate location relative to the view of the content of the shared content session; after moving the view of the content and the first representation of the participant, detecting a request to stop displaying the view of the content of the shared content session on the background user interface; and in response to detecting the request to stop displaying the view of the content of the shared content session on the background user interface, displaying, via one or more output generating components, a view of the content that is not displayed on the background user interface without displaying the representation of the participant at the first separate location relative to the view of the content of the shared content session.

[0062] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicate with one or more output generation components and one or more input devices. The one or more programs include, in a first user interface, displaying, via one or more output generation components, a view of the content of a shared content session that is displayed over a background user interface, and a first representation of a participant in a real-time communication session, the first representation of the participant in the real-time communication session being displayed at a first distinct location relative to the view of the content of the shared content session, simultaneously; while displaying the first user interface, receiving a request to move the view of the content within the first user interface, and in response to receiving the request to move the view of the content, moving the view of the content according to the request and moving the first representation of the participant so that the first representation of the participant is displayed at the first distinct location relative to the view of the content of the shared content session; after moving the view of the content and the first representation of the participant, detecting a request to stop displaying the view of the content of the shared content session on the background user interface, and in response to detecting the request to stop displaying the view of the content of the shared content session on the background user interface, displaying, via one or more output generation components, a view of the content that is not displayed on the background user interface without displaying the representation of the participant at the first distinct location relative to the view of the content of the shared content session, instructions.

[0063] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more output generating components and one or more input devices. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include instructions to display, via one or more output generating components, a first user interface that simultaneously displays, in a first user interface, a view of the content of a shared content session that is displayed over a background user interface, and a first representation of a participant in a real-time communication session, where the first representation of the participant in the real-time communication session is displayed at a first separate location relative to the view of the content of the shared content session; while displaying the first user interface, receive a request to move the view of the content within the first user interface, and in response to receiving the request to move the view of the content, move the view of the content according to the request and move the first representation of the participant so that the first representation of the participant is displayed at the first separate location relative to the view of the content of the shared content session; after moving the view of the content and the first representation of the participant, detect a request to stop displaying the view of the content of the shared content session on the background user interface, and in response to detecting the request to stop displaying the view of the content of the shared content session on the background user interface, display, via one or more output generating components, a view of the content that is not displayed on the background user interface without displaying the representation of the participant at the first separate location relative to the view of the content of the shared content session.

[0064] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more output generation components and one or more input devices. The computer system, in a first user interface, displays, via one or more output generation components, a view of the content of a shared content session that is displayed over a background user interface, and a first representation of a participant in a real-time communication session, the first representation of the participant in the real-time communication session being displayed at a first separate location relative to the view of the content of the shared content session, including means for displaying the first user interface, means for receiving a request to move the view of the content within the first user interface while the first user interface is being displayed, means for moving the view of the content according to the request in response to receiving the request to move the view of the content, and means for moving the first representation of the participant so that the first representation of the participant is displayed at the first separate location relative to the view of the content of the shared content session, means for detecting a request to stop displaying the view of the content of the shared content session on the background user interface after moving the view of the content and the first representation of the participant, and means for displaying, via one or more output generation components, a view of the content that is not displayed on the background user interface without displaying the representation of the participant at the first separate location relative to the view of the content of the shared content session in response to detecting the request to stop displaying the view of the content of the shared content session on the background user interface.

[0065] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicate with one or more output generation components and one or more input devices. The one or more programs include, in a first user interface, displaying, via one or more output generation components, a view of the content of a shared content session that is displayed over a background user interface, and a first representation of a participant in a real-time communication session, the first representation of the participant in the real-time communication session being displayed at a first separate location relative to the view of the content of the shared content session, simultaneously; receiving a request to move a view of content within the first user interface while the first user interface is being displayed; in response to receiving the request to move the view of content, moving the view of content according to the request and moving the first representation of the participant so that the first representation of the participant is displayed at the first separate location relative to the view of the content of the shared content session; after moving the view of content and the first representation of the participant, detecting a request to stop displaying the view of the content of the shared content session on the background user interface; and in response to detecting the request to stop displaying the view of the content of the shared content session on the background user interface, displaying, via one or more output generation components, a view of content that is not displayed on the background user interface without displaying the representation of the participant at the first separate location relative to the view of the content of the shared content session, instructions.

[0066] According to some embodiments, a method is described that is executed in a computer system communicating with one or more output generation components and one or more input devices. The method includes displaying, via one or more output generation components, a user interface of a video communication application that simultaneously displays, in a user interface of the video communication application, dynamic visual content and one or more representations of one or more participants in a video communication session, wherein the one or more representations of the one or more participants in the video communication session are displayed in a first arrangement; detecting a change in size and / or position of the dynamic visual content that varies an amount of the user interface of the video communication application covered by the dynamic visual content; and in response to detecting the change in size and / or position of the dynamic visual content, displaying, via one or more output generation components, the one or more representations of the one or more participants in the video communication session in a second arrangement in the user interface of the video communication application, wherein the second arrangement is different from the first arrangement and is based on the change in size and / or position of the dynamic visual content.

[0067] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs include displaying, via the one or more output generation components, a user interface of a video communication application, the user interface of the video communication application including dynamic visual content and one or more representations of participants in a video communication session, the one or more representations of participants in the video communication session being displayed in a first arrangement; detecting a change in size and / or position of the dynamic visual content that varies an amount of the user interface of the video communication application covered by the dynamic visual content; and in response to detecting the change in size and / or position of the dynamic visual content, displaying, via the one or more output generation components, the one or more representations of participants in the video communication session in a second arrangement in the user interface of the video communication application, the second arrangement being different from the first arrangement and being based on the change in size and / or position of the dynamic visual content.

[0068] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices. The one or more programs cause, via the one or more output generation components, a user interface of a video communication application to be displayed in the user interface of the video communication application, the user interface including simultaneously displaying dynamic visual content and one or more representations of participants in a video communication session, the one or more representations of participants in the video communication session being displayed in a first arrangement. The one or more programs detect a change in size and / or position of the dynamic visual content that varies an amount of the user interface of the video communication application covered by the dynamic visual content, and in response to detecting the change in size and / or position of the dynamic visual content, cause, via the one or more output generation components, the one or more representations of participants in the video communication session to be displayed in a second arrangement in the user interface of the video communication application, the second arrangement being different from the first arrangement and being based on the change in size and / or position of the dynamic visual content.

[0069] According to some embodiments, a computer system configured to communicate with one or more output generating components and one or more input devices is described. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include displaying, via one or more output generating components, a user interface of a video communication application, and simultaneously displaying, in the user interface of the video communication application, dynamic visual content and one or more representations of participants in a video communication session, wherein the one or more representations of participants in the video communication session are displayed in a first arrangement; detecting a change in size and / or position of the dynamic visual content that varies an amount of the user interface of the video communication application covered by the dynamic visual content; and in response to detecting the change in size and / or position of the dynamic visual content, displaying, via one or more output generating components, the one or more representations of participants in the video communication session in a second arrangement in the user interface of the video communication application, wherein the second arrangement is different from the first arrangement and is based on the change in size and / or position of the dynamic visual content.

[0070] According to some embodiments, a computer system configured to communicate with one or more output generation components and one or more input devices is described. The computer system is a means for displaying a user interface of a video communication application via one or more output generation components, the means including simultaneously displaying, in the user interface of the video communication application, dynamic visual content and one or more representations of participants in the video communication session, the one or more representations of participants in the video communication session being displayed in a first arrangement; means for detecting a change in the size and / or position of the dynamic visual content that varies the amount of the user interface of the video communication application covered by the dynamic video content; and means for displaying, via one or more output generation components in response to detecting a change in the size and / or position of the dynamic visual content, one or more representations of participants in the video communication session in a second arrangement within the user interface of the video communication application, the second arrangement being different from the first arrangement and being based on the change in the size and / or position of the dynamic visual content.

[0071] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicate with one or more output generation components and one or more input devices. The one or more programs include, in a user interface of a video communication application, simultaneously displaying dynamic visual content and one or more representations of participants in a video communication session, where the one or more representations of participants in the video communication session are displayed in a first arrangement. Displaying, via the one or more output generation components, a user interface of the video communication application, detecting a change in size and / or position of the dynamic visual content that varies the amount of the user interface of the video communication application covered by the dynamic video content, and in response to detecting the change in size and / or position of the dynamic visual content, displaying, via the one or more output generation components, the one or more representations of participants in the video communication session in a second arrangement in the user interface of the video communication application, where the second arrangement is different from the first arrangement and is based on the change in size and / or position of the dynamic visual content.

[0072] According to some embodiments, a method is described that is executed in a computer system communicating with one or more display generation components and one or more input devices. The method includes receiving, via one or more input devices, one or more inputs corresponding to a request to display options associated with a first content while displaying a representation of the first content via one or more display generation components; and in response to receiving the one or more inputs corresponding to the request to display options associated with the first content, an individual user interface includes a first graphical user interface object for a first action associated with the first content, the first action including sharing the first content in a live communication session, and a second graphical user interface object for a second action associated with the first content, the second action being different from the first action, and the second graphical user interface object being selectable to initiate a process for executing the second action. The method further includes displaying, via one or more display generation components, an individual user interface associated with the first content; receiving a selection input directed to the individual user interface while the individual user interface is being displayed; and in response to receiving the selection input directed to the individual user interface, starting a process for sharing the first content in the live communication session without starting a process for executing the second action according to a determination that the selection input corresponds to a selection of the first graphical user interface object, and starting a process for executing the second action in the live communication session without starting a process for sharing the first content in the live communication session according to a determination that the selection input corresponds to a selection of the second graphical user interface object.

[0073] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more display generation components and one or more input devices. The one or more programs, while displaying a representation of first content via one or more display generation components, receive one or more inputs in response to a request to display options related to the first content via one or more input devices, and in response to receiving one or more inputs corresponding to a request to display options associated with the first content, an individual user interface includes a first graphical user interface object for a first action associated with the first content, the first action including sharing the first content in a live communication session, and a second graphical user interface object for a second action associated with the first content, the second action being different from the first action, and the second graphical user interface object being selectable to initiate a process for performing the second action. The one or more programs display, via the one or more display generation components, an individual user interface associated with the first content, and while the individual user interface is being displayed, receive a selection input directed to the individual user interface. In response to receiving the selection input directed to the individual user interface, according to a determination that the selection input corresponds to a selection of the first graphical user interface object, initiate a process for sharing the first content in a live communication session without initiating a process for performing the second action, and according to a determination that the selection input corresponds to a selection of the second graphical user interface object, initiate a process for sharing the first content in a live communication session without initiating a process for performing the second action, including instructions.

[0074] According to some embodiments, a non - transitory computer - readable storage medium is described. The non - transitory computer - readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more display - generating components and one or more input devices. The one or more programs, while displaying a representation of first content via the one or more display - generating components, receive one or more inputs in response to a request to display options related to the first content via the one or more input devices, and in response to receiving one or more inputs corresponding to a request to display options associated with the first content, display, via the one or more display - generating components, a personalized user interface associated with the first content, where the personalized user interface includes a first graphical user interface object for a first action associated with the first content, the first action including sharing the first content in a live communication session, and the first graphical user interface object is selectable to initiate a process for performing the first action, and a second graphical user interface object for a second action associated with the first content, the second action being different from the first action, and the second graphical user interface object is selectable to initiate a process for performing the second action. While displaying the personalized user interface, receive a selection input directed to the personalized user interface, and in response to receiving the selection input directed to the personalized user interface, according to a determination that the selection input corresponds to the selection of the first graphical user interface object, initiate a process for sharing the first content in the live communication session without initiating a process for performing the second action, and according to a determination that the selection input corresponds to the selection of the second graphical user interface object, initiate a process for sharing the first content in the live communication session without initiating a process for performing the second action.

[0075] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components and one or more input devices. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors, and the one or more programs, while displaying a representation of first content via the one or more display generation components, receive one or more inputs via the one or more input devices in response to a request to display options associated with the first content, and in response to receiving the one or more inputs corresponding to the request to display options associated with the first content, an individual user interface includes a first graphical user interface object selectable to initiate a process for performing a first action associated with the first content, the first action including sharing the first content in a live communication session, and a second graphical user interface object selectable to initiate a process for performing a second action associated with the first content, the second action being different from the first action. The computer system displays, via the one or more display generation components, an individual user interface associated with the first content, and while displaying the individual user interface, receives a selection input directed to the individual user interface, and in response to receiving the selection input directed to the individual user interface, according to a determination that the selection input corresponds to the selection of the first graphical user interface object, starts a process for sharing the first content in a live communication session without starting a process for performing the second action, and according to a determination that the selection input corresponds to the selection of the second graphical user interface object, starts a process for sharing the first content in a live communication session without starting a process for performing the second action, including instructions.

[0076] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components and one or more input devices. While displaying a representation of first content via one or more display generation components, the computer system includes means for receiving, via one or more input devices, one or more inputs corresponding to a request to display options associated with the first content; and in response to receiving one or more inputs corresponding to a request to display options associated with the first content, via one or more display generation components, a separate graphical user interface associated with the first content, the separate graphical user interface including a first graphical user interface object selectable to initiate a process for performing a first action associated with the first content, the first action including sharing the first content in a live communication session, and a second graphical user interface object selectable to initiate a process for performing a second action associated with the first content, the second action being different from the first action, means for displaying the separate graphical user interface; and while displaying the separate graphical user interface, receiving a selection input directed to the separate graphical user interface, and in response to receiving the selection input directed to the separate graphical user interface, starting a process for sharing the first content in the live communication session without starting a process for performing the second action, according to a determination that the selection input corresponds to a selection of the first graphical user interface object, and starting a process for sharing the first content in the live communication session without starting a process for performing the second action, according to a determination that the selection input corresponds to a selection of the second graphical user interface object.

[0077] In some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more display generation components and one or more input devices. The one or more programs, via the one or more display generation components, display a representation of first content while, via the one or more input devices, receiving one or more inputs corresponding to a request to display options related to the first content, and in response to receiving one or more inputs corresponding to a request to display options associated with the first content, an individual user interface includes a first graphical user interface object for the first content associated with a first action, the first action including sharing the first content in a live communication session, and a second graphical user interface object for the first content associated with a second action, the second action being different from the first action, and the second graphical user interface object being selectable to initiate a process for performing the second action. The one or more display generation components display an individual user interface associated with the first content, and while the individual user interface is being displayed, receive a selection input directed to the individual user interface. In response to receiving the selection input directed to the individual user interface, according to a determination that the selection input corresponds to a selection of the first graphical user interface object, initiate a process for sharing the first content in a live communication session without initiating a process for performing the second action, and according to a determination that the selection input corresponds to a selection of the second graphical user interface object, initiate a process for performing the second action in the live communication session without initiating a process for sharing the first content in the live communication session, including instructions.

[0078] The executable instructions for performing these functions are optionally included within a non-transitory computer-readable storage medium or other computer program product configured to be executed by one or more processors. The executable instructions for performing these functions are optionally included within a transitory computer-readable storage medium or other computer program product configured to be executed by one or more processors.

[0079] Accordingly, the device is provided with a faster and more efficient method and interface for managing a shared content session, thereby improving the effectiveness, efficiency, and user satisfaction of such a device. Such a method and interface may complement or replace other methods for managing a shared content session.

[0080] To better understand the various embodiments described, the following "Detailed Description of the Invention" should be referred to in conjunction with the following drawings, in which like reference numerals refer to corresponding parts throughout the following figures.

Brief Description of the Drawings

[0081]

Figure 1A

Figure 1B

Figure 2

Figure 3

Figure 4A

Figure 4B

Figure 5A

Figure 5B

Figure 5C

Figure 6A

Figure 6B

Figure 6C

Figure 6D

Figure 6E

Figure 6F

Figure 6G

Figure 6H

Figure 6I

Figure 6J

Figure 6K

Figure 6L

Figure 6M

Figure 6N

Figure 6O

Figure 6P

Figure 6Q

Figure 6R

Figure 6S

Figure 6T

Figure 6U

Figure 6V

Figure 6W

Figure 6X

Figure 6Y

Figure 6Z

Figure 6AA

Figure 6AB

Figure 6AC

Figure 6AD

Figure 6AE

Figure 6AF

Figure 6AG

Figure 6AH

Figure 6AI

Figure 6AJ

Figure 6AK

Figure 6AL

Figure 6AM

Figure 6AN

Figure 6AO

Figure 6AP

Figure 6AQ

Figure 6AR

Figure 6AS

Figure 6AT

Figure 6AU

Figure 6AV

Figure 6AW

Figure 6AX

Figure 6AY

Figure 6AZ

Figure 6BA

Figure 6BB

Figure 6BC

Figure 6BD

Figure 6BE

Figure 6BF

Figure 6BG

Figure 6BH

Figure 6BI

Figure 6BJ

Figure 6BK

Figure 6BL

Figure 6BM

Figure 6BN

Figure 6BO

Figure 6BP

Figure 6BQ

Figure 6BR

Figure 6BS

Figure 6BT

Figure 6BU

Figure 6BV

Figure 6BW

Figure 6BX

Figure 6BY

Figure 6BZ

Figure 6CA

Figure 6CB

Figure 6CC

Figure 6CD

Figure 6CE

Figure 6CF

Figure 6CG

Figure 6CH

Figure 6CI

Figure 6CJ

Figure 6CK

Figure 6CL

Figure 6CM

Figure 6CN

Figure 6CO

Figure 6CP

Figure 6CQ

Figure 6CR

Figure 6CS

Figure 6CT

Figure 6CU

Figure 6CV

Figure 6CW

Figure 6CX

Figure 6CY

Figure 6CZ

Figure 6DA

Figure 6DB

Figure 6DC

Figure 6DD

Figure 6DE

Figure 6DF

Figure 6DG

Figure 6DH

Figure 6DI

Figure 6DJ

Figure 6DK

Figure 6DL

Figure 6DM

Figure 6DN

Figure 6DO

Figure 6DP

Figure 6DQ

Figure 6DR

Figure 6DS

Figure 6DT

Figure 6DU

Figure 6DV

Figure 6DW

Figure 6DX

Figure 6DY

Figure 6DZ

Figure 6EA

Figure 6EB

Figure 6EC

Figure 6ED

Figure 6EE

Figure 6EF

Figure 6EG

Figure 6EH

Figure 6EI

Figure 6EJ

Figure 6EK

Figure 6EL

Figure 6EM

Figure 6EN

Figure 6EO

Figure 6EP

Figure 6EQ

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14A

Figure 14B

Figure 14C

Figure 14D

Figure 14E

Figure 14F

Figure 14G

Figure 14H

Figure 14I

Figure 14J

Figure 14K

Figure 14L

Figure 14M

Figure 14N

Figure 14O

Figure 14P

Figure 14Q

Figure 14R

Figure 14S

Figure 14T

Figure 14U

Figure 14V

Figure 14W

Figure 14X

Figure 14Y

Figure 14Z

Figure 14AA

Figure 14AB

Figure 14AC

Figure 14AD

Figure 14AE

Figure 14AF

Figure 14AG

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19A

Figure 19B

Figure 19C

Figure 19D

Figure 19E

Figure 19F

Figure 19G

Figure 19H

Figure 19I

Figure 19J

Figure 19K

Figure 19L

Figure 19M

Figure 19N

Figure 19O

Figure 19P

Figure 19Q

Figure 19R

Figure 19S

Figure 19T

Figure 19U

Figure 19V

Figure 19W

Figure 19X

Figure 19Y

Figure 19Z

Figure 19AA

Figure 19AB

Figure 20A

Figure 20B

[0082] The following description sets forth exemplary methods, parameters, and the like. However, it should be recognized that such description is not intended as a limitation on the scope of the present disclosure, but rather as an illustration of exemplary embodiments.

[0083] There is a need for an electronic device that provides an efficient method and interface for managing a shared content session. Such technology can reduce the cognitive burden on users accessing content in a shared content session, thereby increasing productivity. Further, such technology can reduce the power of the processor and battery that would otherwise be wasted on redundant user input.

[0084] The following, FIGS. 1A - 1B, FIG. 2, FIG. 3, FIGS. 4A - 4B, and FIGS. 5A - 5C provide an illustration of exemplary devices for performing techniques for managing a shared content session. FIGS. 6A - 6EQ illustrate exemplary user interfaces for managing a shared content session. FIGS. 7 - 13 and FIGS. 17 - 18 are flow diagrams showing methods for managing a shared content session according to some embodiments. The user interfaces of FIGS. 6A - 6EQ are used to illustrate the processes described below, including the processes of FIGS. 7 - 13 and FIGS. 17 - 18. FIGS. 14A - 14AG illustrate exemplary user interfaces for managing a shared content session. FIGS. 15 - 16 are flow diagrams showing methods for managing a shared content session according to some embodiments. The user interfaces of FIGS. 14A - 14AG are used to illustrate the processes described below, including the processes of FIGS. 15 - 16. FIGS. 19A - 19AB illustrate exemplary user interfaces for managing a shared content session. FIGS. 20A - 20B are flow diagrams showing methods for managing a shared content session according to some embodiments. The user interfaces of FIGS. 19A - 19AB are used to illustrate the processes described below, including the processes of FIGS. 20A - 20B.

[0085] The processes described below enhance the operability of the device and streamline the user - device interface by various techniques, including providing improved visual feedback to the user, reducing the number of inputs required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, performing an operation without requiring further user input when a set of conditions is met, and / or other techniques (e.g., helping the user make appropriate inputs when operating / interacting with the device and reducing user errors). These techniques also reduce power consumption and improve the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0086] Furthermore, in the method described herein, where one or more steps are conditional upon one or more conditions being satisfied, it should be understood that the method can be repeated in multiple iterations such that, over the course of the repetition, all of the conditions upon which the steps of the method are conditional are satisfied in different iterations of the method. For example, if a method requires performing a first step when a condition is satisfied and a second step when the condition is not satisfied, one of ordinary skill in the art would understand that the steps recited in the claims would be repeated in a particular order until the condition is satisfied and then becomes not satisfied. Thus, a method described in terms of one or more steps that are conditional upon one or more satisfied conditions can be rewritten as a method that is repeated until each condition described in the method is satisfied. However, this is not required in claims for a system or computer-readable medium that includes instructions for performing conditional operations based on the fulfillment of the corresponding one or more conditions, and thus can determine whether an event is satisfied without explicitly repeating the steps of the method until all of the conditions upon which the steps of the method are conditional are satisfied. One of ordinary skill in the art would also understand that, similar to a method with conditional steps, a system or computer-readable storage medium can repeat the steps of the method as many times as necessary to ensure that all of the conditional steps are executed.

[0087] In the following description, various elements are described using terms such as "first," "second," etc., but these elements should not be limited by these terms. In some embodiments, these terms are used to distinguish one element from another. For example, without departing from the scope of the various embodiments described, a first touch can be referred to as a second touch and, similarly, a second touch can be referred to as a first touch. In some embodiments, the first touch and the second touch are two separate references to the same touch. In some embodiments, both the first touch and the second touch are touches, but they are not the same touch.

[0088] The terms used in the description of the various embodiments described in this specification are for the purpose of describing only specific embodiments and are not intended to be limiting. In the description of the various embodiments described and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural as well, unless the context clearly dictates otherwise. Also, as used herein, the term "and / or" refers to and includes any and all combinations of one or more of the associated listed items. It should be understood that the terms "includes", "including", "comprises", and / or "comprising", when used herein, specify the presence of the stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0089] The term "if" is optionally interpreted to mean "when" or "upon", or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if [a stated condition or event] is detected" are optionally interpreted to mean "upon determining" or "in response to determining", or "upon detecting [the stated condition or event]" or "in response to detecting [the stated condition or event]", depending on the context.

[0090] Embodiments of electronic devices, user interfaces for such devices, and related processes for using such devices are described. In some embodiments, the device is a portable communication device such as a cellular phone that also includes other functions such as PDA functionality and / or music player functionality. Exemplary embodiments of portable multifunction devices include, but are not limited to, the iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, California. Optionally, other portable electronic devices such as laptop computers or tablet computers having a touch-sensitive surface (e.g., a touch screen display and / or a touch pad) are also used. Also, in some embodiments, it should be understood that the device is not a portable communication device but a desktop computer having a touch-sensitive surface (e.g., a touch screen display and / or a touch pad). In some embodiments, the electronic device is a computer system that communicates (e.g., via wired communication, via wireless communication) with a display generation component. The display generation component is configured to provide a visual output such as a display via a CRT display, a display via an LED display, or a display via image projection. In some embodiments, the display generation component is integrated with the computer system. In some embodiments, the display generation component is separate from the computer system. As used herein, "displaying" content includes sending data (e.g., image data or video data) via a wired or wireless connection to an integrated or external display generation component to visually generate the content (e.g., video data rendered or decoded by a display controller 156) in order to display the content.

[0091] In the following discussion, an electronic device including a display and a touch sensing surface will be described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices such as a physical keyboard, a mouse, and / or a joystick.

[0092] The device typically supports various applications such as one or more of a drawing application, a presentation application, a word processing application, a website creation application, a disk authoring application, a spreadsheet application, a game application, a phone application, a video conferencing application, an email application, an instant messaging application, a training support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.

[0093] The various applications executed on the device optionally use at least one common physical user interface device such as a touch sensing surface. One or more functions of the touch sensing surface, as well as the corresponding information displayed on the device, are optionally adjusted and / or changed for each application and / or within an individual application. Thus, the common physical architecture of the device (such as a touch sensing surface) optionally supports various applications with a user interface that is intuitive and transparent to the user.

[0094] Attention is now directed to an embodiment of a portable device having a touch-sensing display. FIG. 1A is a block diagram showing a portable multifunctional device 100 having a touch-sensing display system 112, according to some embodiments. The touch-sensing display 112 may be referred to herein as a "touch screen" for convenience and may be known or referred to as a "touch-sensing display system." Device 100 includes a memory 102 (optionally including one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact intensity sensors 165 (e.g., a touch-sensing surface such as the touch-sensing display system 112 of device 100) for detecting the intensity of contact on device 100. Device 100 optionally includes one or more haptic output generators 167 for generating haptic output on device 100 (e.g., on a touch-sensing surface such as the touch-sensing display system 112 of device 100 or the touch pad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0095] As used herein and in the claims, the term "intensity" of a contact on a touch sensing surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch sensing surface, or a proxy for the force or pressure of the contact on the touch sensing surface. The intensity of the contact has a range of values that includes at least four distinct values and more typically includes hundreds (e.g., at least 256) of distinct values. The intensity of the contact is optionally determined (or measured) using a variety of techniques and a variety of sensors or combinations of sensors. For example, one or more force sensors under or adjacent to the touch sensing surface are optionally used to measure the force at various points on the touch sensing surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted averaged) to determine the estimated force of the contact. Similarly, a pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch sensing surface. Alternatively, the size and / or change thereof of the contact area detected on the touch sensing surface, the capacitance and / or change thereof of the touch sensing surface in proximity to the contact, and / or the resistance and / or change thereof of the touch sensing surface in proximity to the contact are optionally used as an alternative to the force or pressure of the contact on the touch sensing surface. In some implementations, an alternative measurement of the force or pressure of the contact is used directly to determine whether it exceeds an intensity threshold (e.g., the intensity threshold is described in units corresponding to the alternative measurement). In some implementations, a proxy measurement of the contact force or pressure is converted to an estimated value of the force or pressure, and the estimated value of the force or pressure is used to determine whether it exceeds an intensity threshold (e.g., the intensity threshold is a pressure threshold measured in units of pressure). By using the intensity of the contact as an attribute of user input, a user can access additional device functions that may otherwise be inaccessible to the user on a reduced-size device with a limited implementation area for displaying affordances (e.g., on a touch sensing display), and / or receive user input (e.g., via a touch sensing display, a touch sensing surface, or a physical / mechanical control such as a knob or button).

[0096] As used in this specification and the claims, the term "haptic output" refers to the physical displacement of a device relative to its previous position, the physical displacement of a component of the device (e.g., a touch-sensing surface) relative to another component of the device (e.g., the housing), or the displacement of a component relative to the center of mass of the device that will be detected by a user's sense of touch. For example, in a situation where a device or a component of the device is in contact with a surface of a user that is sensitive to touch (e.g., a finger, palm, or other part of the user's hand), the haptic output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical characteristics of the device or the component of the device. For example, the movement of a touch-sensing surface (e.g., a touch-sensing display or a trackpad) may optionally be interpreted by the user as a "down click" or "up click" of a physical actuator button. In some cases, the user may feel a tactile sensation such as a "down click" or "up click" even when there is no movement of a physical actuator button associated with a touch-sensing surface that has been physically pressed (e.g., displaced) by the user's action. As another example, the movement of a touch-sensing surface may optionally be interpreted or sensed by the user as the "roughness" of the touch-sensing surface even if there is no change in the smoothness of the touch-sensing surface. Such interpretation of touch by the user depends on the user's individual sensory perception, but there are many sensory perceptions of touch that are common to the majority of users. Thus, when a haptic output is described as corresponding to a particular sensory perception of the user (e.g., "up click", "down click", "roughness"), unless otherwise stated, the generated haptic output corresponds to the physical displacement of a device or a component of the device that generates the described sensory perception of a typical (or average) user.

[0097] Device 100 is merely an example of a portable multifunctional device. It should be understood that Device 100 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of those components. The various components shown in FIG. 1A are implemented in a combination of hardware, software, or both hardware and software, including one or more signal processing circuits and / or application-specific integrated circuits.

[0098] Memory 102 optionally includes high-speed random access memory and also optionally includes non-volatile memory such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.

[0099] Peripheral interface 118 can be used to couple input and output peripheral devices of the device to CPU 120 and memory 102. One or more processors 120 operate or execute various software programs (such as computer programs including instructions) and / or instruction sets stored in memory 102 to perform various functions for device 100 and process data. In some embodiments, peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0100] The RF (radio frequency) circuit 108 transmits and receives RF signals, also called electromagnetic signals. The RF circuit 108 converts electrical signals into electromagnetic signals or vice versa and communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 108 optionally includes well-known circuits for performing these functions, such as, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, etc. The RF circuit 108 optionally communicates wirelessly with networks such as the Internet, also called the World Wide Web (WWW), an intranet, and / or wireless networks such as a cellular telephone network, a wireless local area network (LAN), and / or a metropolitan area network (MAN), as well as with other devices. The RF circuit 108 optionally includes well-known circuits for detecting a near field communication (NFC) field, such as by a short-range communication radio. Wireless communication optionally includes, but is not limited to only, Global System for Mobile Communications (GSM) for mobile communication, Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), Long Termevolution, LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE802.11a, IEEE802.11b, IEEE802.11g, IEEE802.11n, and / or IEEE802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, Protocols for email (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), Instant Messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol including communication protocols not yet developed as of the filing date of this specification. Any one of a plurality of communication standards, protocols, and technologies is used.

[0101] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts this audio data into an electrical signal, and transmits this electrical signal to the speaker 111. The speaker 111 converts the electrical signal into human audible sound waves. Also, the audio circuit 110 receives the electrical signal converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signal into audio data and transmits this audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., 212 of FIG. 2). The headset jack provides an interface between the audio circuit 110 and a detachable audio input / output peripheral device such as an output-only headset or a headset having both an output (e.g., mono or stereo headphones) and an input (e.g., a microphone).

[0102] The I / O subsystem 106 couples input / output peripheral devices on the device 100, such as the touch screen 112 and other input control devices 116, to the peripheral device interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, a depth camera controller 169, an intensity sensor controller 159, a haptic feedback controller 161, and one or more input controllers 160 for other input devices or control devices. The one or more input controllers 160 receive electrical signals from other input control devices 116 and transmit electrical signals to other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, etc. In some embodiments, the input controller(s) 160 are optionally coupled to (or not coupled to any of) a pointer device such as a keyboard, an infrared port, a USB port, and a mouse. One or more buttons (e.g., 208 in FIG. 2) optionally include up / down buttons for volume control of the speaker 111 and / or the microphone 113. One or more buttons optionally include push buttons (e.g., 206 in FIG. 2). In some embodiments, the electronic device is a computer system that communicates with one or more input devices (e.g., via wired communication or wireless communication). In some embodiments, the one or more input devices include a touch sensing surface (e.g., a trackpad as part of a touch sensing display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175) for tracking a user's gesture (e.g., a hand gesture and / or an air gesture) as an input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system.In some embodiments, an air gesture is a gesture that is detected without the user touching (or independently of) an input element that is part of the device, and includes movements of the user's body relative to an absolute reference (e.g., the angle of the user's arm relative to the ground, or the distance of the user's hand from the ground), movements of the user's body relative to another part of the user's body (e.g., the movement of the user's hand relative to the user's shoulder, the movement of the user's other hand relative to one of the user's hands, and / or the movement of the user's finger relative to another finger or part of the user's hand), and / or absolute movements of a part of the user's body (e.g., a tap gesture including movement of the hand in a predetermined pose with a predetermined amount and / or speed, or a shake gesture including rotation of a part of the user's body at a predetermined speed or amount), based on detected movements of a part of the user's body.

[0103] As described in U.S. Patent Application No. 11 / 322,549, filed December 23, 2005, "Unlocking a Device by Performing Gestures on an Unlock Image," and U.S. Patent No. 7,657,849, which are hereby incorporated by reference in their entirety, a quick press of a push button optionally unlocks the touch screen 112 or optionally initiates a process of unlocking the device using gestures on the touch screen. A longer press of the push button (e.g., 206) optionally turns the power to the device 100 on or off. The functionality of one or more of the buttons can optionally be customized by the user. The touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.

[0104] The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch screen 112 and / or transmits electrical signals to the touch screen 112. The touch screen 112 displays visual output to the user. This visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0105] The touch screen 112 has a touch-sensitive surface, sensor, or set of sensors that receives input from the user based on tactile and / or haptic contact. The touch screen 112 and the display controller 156 (along with any associated modules and / or instruction sets in the memory 102) detect contact (and any movement or interruption of the contact) on the touch screen 112 and convert the detected contact into an interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch screen 112. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to the user's finger.

[0106] The touch screen 112 optionally uses LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, although in other embodiments other display technologies may also be used. The touch screen 112 and the display controller 156 optionally use, but are not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies, as well as any other proximity sensor array or other element for determining one or more contact points with the touch screen 112, of a plurality of touch sensing technologies currently known or later developed, to detect contact and any movement or interruption thereof. In an exemplary embodiment, a projected mutual capacitance sensing technology such as that found in the iPhone (registered trademark) and iPod Touch (registered trademark) from Apple Inc. of Cupertino, California is used.

[0107] The touch sensing display in some embodiments of the touch screen 112 is optionally similar to a multi-touch sensing touch pad described in U.S. Patent Nos. 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman), and / or U.S. Patent Application Publication No. 2002 / 0015024 (A1), each of which is hereby incorporated by reference in its entirety. However, the touch screen 112 displays the visual output from the device 100, whereas the touch sensing touch pad does not provide a visual output.

[0108] Touch sensing displays in some embodiments of the touch screen 112 are described in the following applications: (1) U.S. Patent Application No. 11 / 381,313, filed May 2, 2006, "Multipoint Touch Surface Controller"; (2) U.S. Patent Application No. 10 / 840,862, filed May 6, 2004, "Multipoint Touchscreen"; (3) U.S. Patent Application No. 10 / 903,964, filed Jul. 30, 2004, "Gestures For Touch Sensitive Input Devices"; (4) U.S. Patent Application No. 11 / 048,264, filed Jan. 31, 2005, "Gestures For Touch Sensitive Input Devices"; (5) U.S. Patent Application No. 11 / 038,590, filed Jan. 18, 2005, "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices"; (6) U.S. Patent Application No. 11 / 228,758, filed Sep. 16, 2005, "Virtual Input Device Placement On A Touch Screen User Interface"; (7) U.S. Patent Application No. 11 / 228,700, filed Sep. 16, 2005, "Operation Of A Computer With A Touch Screen Interface"; (8) U.S. Patent Application No. 11 / 228,737, filed Sep. 16, 2005, "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard"; and (9) U.S. Patent Application No. 11 / 367,749, filed Mar. 3, 2006, "Multi-Functional Hand-Held Device". All of these applications are hereby incorporated by reference in their entirety.

[0109] The touch screen 112 optionally has a video resolution exceeding 100 dpi. In some embodiments, the touch screen has a video resolution of about 160 dpi. The user optionally touches the touch screen 112 using any suitable object or appendage such as a stylus, finger, etc. In some embodiments, the user interface is designed to operate mainly using finger-based contact and gestures, although this may not be as accurate as stylus-based input due to the larger contact area of the finger on the touch screen. In some embodiments, the device converts rough input by the finger into an accurate pointer / cursor position or command for performing the action desired by the user.

[0110] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touch pad for activating or deactivating certain functions. In some embodiments, the touch pad, unlike the touch screen, is a touch-sensitive area of the device that does not display visual output. The touch pad is optionally a separate touch-sensitive surface from the touch screen 112 or an extension of the touch-sensitive surface formed by the touch screen.

[0111] The device 100 also includes a power system 162 that powers various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharge system, a power outage detection circuit, a power converter or inverter, a power status indicator (e.g., light-emitting diode (LED)), and any other components associated with the generation, management, and distribution of power within a portable device.

[0112] Device 100 also optionally includes one or more optical sensors 164. FIG. 1A shows an optical sensor coupled to an optical sensor controller 158 within I / O subsystem 106. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) phototransistor. The optical sensor 164 receives light from the environment projected through one or more lenses and converts the light into data representing an image. The optical sensor 164 cooperates with an imaging module 143 (also referred to as a camera module) to optionally capture a still image or video. In some embodiments, the optical sensor is located on the back surface of device 100 opposite a touch screen display 112 on the front of the device, and thus the touch screen display can be used as a viewfinder for acquiring still images and / or video. In some embodiments, the optical sensor is disposed on the front of the device such that an image of the user is optionally acquired for a video conference while the user is viewing other video conference participants on the touch screen display. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and sensor within the device housing), and thus a single optical sensor 164 is used for both video conferencing and for acquiring still images and / or video with the touch screen display.

[0113] Device 100 optionally also includes one or more depth camera sensors 175. FIG. 1A shows a depth camera sensor coupled to a depth camera controller 169 within the I / O subsystem 106. The depth camera sensor 175 receives data from the environment and creates a three-dimensional model of objects (e.g., a face) within the scene from the viewpoint (e.g., the depth camera sensor). In some embodiments, in conjunction with the imaging module 143 (also referred to as the camera module), the depth camera sensor 175 is optionally used to determine depth maps of different portions of an image captured by the imaging module 143. In some embodiments, while a user is viewing other video conference participants on the touch screen display, optionally, an image of the user with depth information is acquired for the video conference, and a depth camera sensor is disposed on the front face of the device 100 to capture a self-portrait image with depth map data. In some embodiments, the depth camera sensor 175 is disposed on the back of the device, or on both the back and the front of the device 100. In some embodiments, the position of the depth camera sensor 175 can be changed by the user (e.g., by rotating the lens and sensor within the device housing), and thus the depth camera sensor 175 is used for video conferencing as well as for acquiring still images and / or videos with the touch screen display.

[0114] Device 100 also optionally includes one or more contact intensity sensors 165. FIG. 1A shows a contact intensity sensor coupled to an intensity sensor controller 159 within I / O subsystem 106. The contact intensity sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electro-force sensors, piezoelectric force sensors, optical force sensors, capacitive touch sensing surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of contact on a touch sensing surface). The contact intensity sensor 165 receives contact intensity information (e.g., pressure information, or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is juxtaposed with, or proximate to, a touch sensing surface (e.g., touch sensing display system 112). In some embodiments, at least one contact intensity sensor is disposed on the back of device 100, on the opposite side of touch screen display 112 disposed on the front of device 100.

[0115] Device 100 also optionally includes one or more proximity sensors 166. FIG. 1A shows proximity sensor 166 coupled to peripheral device interface 118. Alternatively, proximity sensor 166 is optionally coupled to input controller 160 within I / O subsystem 106. Proximity sensor 166 functions, optionally, as described in U.S. patent application Ser. No. 11 / 241,839, "Proximity Detector In Handheld Device", Ser. No. 11 / 240,788, "Proximity Detector In Handheld Device", Ser. No. 11 / 620,702, "Using Ambient Light Sensor To Augment Proximity Sensor Output", Ser. No. 11 / 586,862, "Automated Response To And Sensing Of User Activity In Portable Devices", and Ser. No. 11 / 638,251, "Methods And Systems For Automatic Configuration Of Peripherals", which are hereby incorporated by reference in their entirety. In some embodiments, when a multifunctional device is placed near the user's ear (e.g., when the user is making a phone call), the proximity sensor turns off and disables touch screen 112.

[0116] Device 100 also optionally includes one or more haptic output generators 167. FIG. 1A shows a haptic output generator coupled to a haptic feedback controller 161 within I / O subsystem 106. The haptic output generator 167 optionally includes one or more electroacoustic devices, such as speakers or other audio components, and / or electromechanical devices that convert energy, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components that convert an electrical signal into a haptic output on the device), into linear movement. The contact intensity sensor 165 receives haptic feedback generation instructions from the haptic feedback module 133 and generates a haptic output on device 100 that can be sensed by a user of device 100. In some embodiments, at least one haptic output generator is juxtaposed with or proximate to a touch sensing surface (e.g., touch sensing display system 112) and optionally generates a haptic output by moving the touch sensing surface in a vertical direction (e.g., in / out of the surface of device 100) or a horizontal direction (e.g., back and forth within the same plane as the surface of device 100). In some embodiments, at least one haptic output generator sensor is disposed on the back of device 100, which is opposite the touch screen display 112 disposed on the front of device 100.

[0117] Device 100 also optionally includes one or more accelerometers 168. FIG. 1A shows an accelerometer 168 coupled to the peripheral device interface 118. Alternatively, the accelerometer 168 is optionally coupled to the input controller 160 within the I / O subsystem 106. The accelerometer 168 functions optionally as described in both U.S. Patent Application Publication No. 20050190059, "Acceleration-based Theft Detection System for Portable Electronic Devices", and U.S. Patent Application Publication No. 20060017692, "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer", both of which are hereby incorporated by reference in their entirety. In some embodiments, information is displayed on the touch screen display in a portrait or landscape orientation based on an analysis of data received from one or more accelerometers. In addition to the accelerometer(s) 168, device 100 optionally includes a magnetometer and a GPS (or GLONASS or other global navigation system) receiver for obtaining information regarding the location and orientation (e.g., portrait or landscape orientation) of device 100.

[0118] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a touch / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application (or instruction set) 136. Further, in some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3) stores a device / global internal state 157 as shown in FIGS. 1A and 3. The device / global internal state 157 includes an active application state indicating which application is active if there is a currently active application, a display state indicating which application, view, or other information occupies various regions of the touch screen display 112, a sensor state including information obtained from various sensors and input control devices 116 of the device, and one or more of location information regarding the location and / or orientation of the device.

[0119] The operating system 126 (e.g., an embedded operating system such as Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or VxWorks) includes various software components and / or drivers that control and manage general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitate communication between various hardware components and software components.

[0120] The communication module 128 facilitates communication with other devices via one or more external ports 124 and also includes various software components for processing data received by the RF circuit 108 and / or the external port 124. The external ports 124 (e.g., Universal Serial Bus (USB), FIREWIRE, etc.) are adapted to couple to other devices either directly or indirectly via a network (e.g., the Internet, a wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as or similar to and / or is adapted to the 30-pin connector used on iPod (registered trademark) devices (a trademark of Apple Inc.).

[0121] The contact / motion module 130 optionally detects contact with the touch screen 112 and other touch sensing devices (e.g., a touch pad or a physical click wheel) (in cooperation with the display controller 156). The contact / motion module 130 includes various software components for performing various operations related to the detection of contact, such as determining whether contact has occurred (e.g., detecting a finger down event), determining the intensity of the contact (e.g., the force or pressure of the contact, or an alternative to the force or pressure of the contact), determining whether there is movement of the contact, tracking movement across the touch sensing surface (e.g., detecting one or more events of dragging a finger), and determining whether the contact has ceased (e.g., detecting a finger up event or an interruption of the contact). The contact / motion module 130 receives contact data from the touch sensing surface. Determining the movement of the contact point, represented by a series of contact data, optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. These operations are optionally applied to a single contact (e.g., contact with one finger) or multiple simultaneous contacts (e.g., "multi-touch" / contact with multiple fingers). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact on the touch pad.

[0122] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by the user (e.g., to determine whether the user has "clicked" on an icon). In some embodiments, at least a subset of the intensity thresholds are determined according to software parameters (e.g., the intensity thresholds can be adjusted without changing the physical hardware of the device 100, rather than being determined by the activation threshold of a particular physical actuator). For example, the mouse "click" threshold of a trackpad or touch screen display can be set to any of a wide range of default thresholds without changing the trackpad or touch screen display hardware. Additionally, in some implementations, the user of the device is provided with software settings to adjust one or more of the set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or adjusting multiple intensity thresholds at once by system-level click "intensity" parameters).

[0123] The contact / motion module 130 optionally detects gesture inputs by the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., the detected movement, timing, and / or intensity of the contact is different). Thus, gestures are optionally detected by detecting a particular contact pattern. For example, detecting a finger tap gesture includes detecting a finger down event followed by a finger up (lift-off) event at the same position (or substantially the same position) as the finger down event (e.g., the position of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger down event followed by one or more finger drag events followed by a finger up (lift-off) event.

[0124] The graphic module 132 includes various known software components for rendering and displaying graphics on the touch screen 112 or other display, including components for changing the visual impact of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual properties). As used herein, the term "graphic" includes, but is not limited to, any object that can be displayed to a user, including text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, and the like.

[0125] In some embodiments, the graphic module 132 stores data representing the graphics that will be used. Each graphic is optionally assigned a corresponding code. The graphic module 132 receives from an application, as needed, one or more codes specifying the graphics to be displayed, along with coordinate data and other graphic property data, and then generates screen image data for output to the display controller 156.

[0126] The haptic feedback module 133 includes various software components for generating the instructions used by the haptic output generator(s) 167 to generate haptic output at one or more locations on the device 100 in response to the user's interaction with the device 100.

[0127] The text input module 134 is optionally a component of the graphic module 132 and provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application that requires text input).

[0128] The GPS module 135 determines the location of the device and provides this information for use within various applications (e.g., to the phone 138 for location-based dialing, to the camera 143 as picture / video metadata, and to applications that provide location-based services such as a weather widget, a local yellow pages widget, and a map / navigation widget).

[0129] The application 136 optionally includes one or more of the following modules (or sets of instructions) or subsets or supersets thereof. ● A contacts module 137 (which may also be referred to as an address book or contacts list), ● A phone module 138, ● A video conferencing module 139, ● An email client module 140, ● An instant messaging (IM) module 141, ● A training support module 142, ● A camera module 143 for still images and / or video, ● An image management module 144, ● A video player module, ● A music player module, ● A browser module 147, ● A calendar module 148, ● Optionally, a widget module 149 that includes one or more of a weather widget 149-1, a stock price widget 149-2, a calculator widget 149-3, an alarm clock widget 149-4, a dictionary widget 149-5, and other widgets obtained by the user, as well as a user-created widget 149-6, ● A widget creator module 150 for creating the user-created widget 149-6, ● A search module 151, ● A video and music player module 152 that integrates a video player module and a music player module. ● A memo module 153. ● A map module 154, and / or ● An online video module 155.

[0130] Examples of other applications 136 that are optionally stored in the memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, Java-compatible applications, encryption, digital rights management, audio recognition, and audio duplication.

[0131] Together with the touch screen 112, the display controller 156, the contact / motion module 130, the graphic module 132, and the text input module 134, the contact module 137 is optionally used to manage an address book or contact list (e.g., stored in the application internal state 192 of the contact module 137 in the memory 102 or the memory 370), which includes adding a name (singular or plural) to the address book, deleting a name (singular or plural) from the address book, associating a phone number (singular or plural), an email address (singular or plural), an address (singular or plural), or other information with a name, associating an image with a name, classifying and sorting names, providing a phone number or email address to initiate and / or facilitate communication by the phone 138, the video conferencing module 139, the email 140, or the IM 141, etc. It is used to manage the address book or contact list.

[0132] The telephone module 138 cooperates with the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch screen 112, the display controller 156, the contact / motion module 130, the graphic module 132, and the text input module 134, and is optionally used for inputting a series of characters corresponding to a telephone number, accessing one or more telephone numbers in the contact module 137, modifying the input telephone number, dialing an individual telephone number, executing a call, and disconnecting and stopping the call at the end of the call. As described above, the wireless communication optionally uses any of a plurality of communication standards, protocols, and technologies.

[0133] The video conferencing module 139 cooperates with the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch screen 112, the display controller 156, the optical sensor 164, the optical sensor controller 158, the contact / motion module 130, the graphic module 132, the text input module 134, the contact module 137, and the telephone module 138, and includes executable instructions for starting, executing, and ending a video conference between the user and one or more other participants according to the user's instructions.

[0134] The email client module 140 cooperates with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphic module 132, and the text input module 134, and includes executable instructions for creating, sending, receiving, and managing emails according to the user's instructions. In cooperation with the image management module 144, the email client module 140 makes it very easy to create and send emails with still images or video images taken by the camera module 143.

[0135] The instant messaging module 141, in cooperation with the RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphic module 132, and text input module 134, includes executable instructions for inputting a series of characters corresponding to an instant message, modifying previously input characters, (e.g., using the Short Message Service (SMS) or Multimedia Message Service (MMS) protocol for instant messages based on telephone communication, or XMPP, SIMPLE, or IMPS for instant messages based on the Internet) sending individual instant messages, receiving instant messages, and viewing received instant messages. In some embodiments, the instant messages sent and / or received optionally include graphics, photos, audio files, video files, and / or other attached files as supported by MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both telephone communication-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0136] In cooperation with the RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphic module 132, text input module 134, GPS module 135, map module 154, and music player module, the training support module 142 includes executable instructions that create a training (e.g., having goals of time, distance, and / or calorie burn), communicate with a training sensor (sports device), receive training sensor data, calibrate sensors used to monitor the training, select and play music for the training, and display, store, and transmit training data.

[0137] The camera module 143 includes executable instructions for capturing still images or videos (including video streams) and storing them in the memory 102, modifying the characteristics of still images or videos, or deleting still images or videos from the memory 102, in cooperation with the touch screen 112, display controller 156, optical sensor(s) 164, optical sensor controller 158, contact / motion module 130, graphic module 132, and image management module 144.

[0138] The image management module 144 includes executable instructions for arranging, modifying (e.g., editing), or otherwise operating on, labeling, deleting, presenting (e.g., in a digital slide show or album), and storing still images and / or videos, in cooperation with the touch screen 112, display controller 156, contact / motion module 130, graphic module 132, text input module 134, and camera module 143.

[0139] The browser module 147 includes executable instructions for browsing the Internet according to user instructions, including searching for, linking to, receiving, and displaying a web page or a part thereof, as well as attached files and other files linked to the web page, in cooperation with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphic module 132, and the text input module 134.

[0140] The calendar module 148 includes executable instructions for creating, displaying, modifying, and storing a calendar and data associated with the calendar (e.g., calendar items, to-do lists, etc.) according to user instructions, in cooperation with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphic module 132, the text input module 134, the email client module 140, and the browser module 147.

[0141] The widget module 149 cooperates with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphic module 132, the text input module 134, and the browser module 147, and optionally, mini-applications (e.g., weather widget 149-1, stock price widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) that are downloaded and used by the user, or mini-applications created by the user (e.g., user-created widget 149-6). In some embodiments, the widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., Yahoo! widget).

[0142] The widget creator module 150 cooperates with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphic module 132, the text input module 134, and the browser module 147, and is used by the user to optionally create a widget (e.g., make a user-specified portion of a web page into a widget).

[0143] The search module 151 cooperates with the touch screen 112, the display controller 156, the contact / motion module 130, the graphic module 132, and the text input module 134, and includes executable instructions for searching for characters, music, sound, images, videos, and / or other files in the memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) according to the user's instructions.

[0144] The video and music player module 152, in cooperation with the touch screen 112, the display controller 156, the touch / motion module 130, the graphic module 132, the audio circuit 110, the speaker 111, the RF circuit 108, and the browser module 147, includes executable instructions that enable a user to download and play recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, and executable instructions for displaying, presenting, or otherwise playing videos (e.g., on the touch screen 112 or on an external display connected via the external port 124). In some embodiments, the device 100 optionally includes the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.).

[0145] The memo module 153, in cooperation with the touch screen 112, the display controller 156, the touch / motion module 130, the graphic module 132, and the text input module 134, includes executable instructions for creating and managing memos, to-do lists, etc. according to user instructions.

[0146] The map module 154, in cooperation with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphic module 132, the text input module 134, the GPS module 135, and the browser module 147, is optionally used to receive, display, modify, and store maps and map-related data (e.g., driving routes, data on stores and other attractions near a particular location or its vicinity, and other location-based data) according to user instructions.

[0147] The online video module 155, in cooperation with the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the audio circuit 110, the speaker 111, the RF circuit 108, the text input module 134, the email client module 140, and the browser module 147, includes instructions that enable a user to access a particular online video, browse a particular online video, receive (e.g., by streaming and / or downloading), play (e.g., on the touch screen or on an external display connected via the external port 124), send an email having a link to a particular online video, and perform other management of online videos in one or more file formats such as H.264. In some embodiments, instead of the email client module 140, the instant messaging module 141 is used to send a link to a particular online video. For additional explanation of the online video application, see U.S. Provisional Patent Application No. 60 / 936,562, filed Jun. 20, 2007, "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," and U.S. Patent Application No. 11 / 968,067, filed Dec. 31, 2007, "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," the entire contents of which are hereby incorporated by reference.

[0148] The modules and applications identified above each correspond to a set of executable instructions that perform one or more of the functions described above and the methods described in this application (e.g., the computer-executed methods and other information processing methods described herein). These modules (e.g., sets of instructions) need not be implemented as respective software programs (e.g., computer programs including instructions), procedures, or modules, and thus in various embodiments, various subsets of these modules are optionally combined or otherwise reconfigured. For example, a video player module may optionally be combined with a music player module to form a single module (e.g., the video and music player module 152 of FIG. 1A). In some embodiments, the memory 102 optionally stores a subset of the modules and data structures identified above. Further, the memory 102 optionally stores additional modules and data structures not described above.

[0149] In some embodiments, the device 100 is a device in which the operation of a set of default functions in the device is performed only via a touch screen and / or a touch pad. By using the touch screen and / or the touch pad as the main input control device for the device 100 to operate, the number of physical input control devices (push buttons, dials, etc.) on the device 100 is optionally reduced.

[0150] The set of default functions that are executed only through a touch screen and / or a touch pad optionally includes navigation between user interfaces. In some embodiments, the touch pad navigates the device 100 from any user interface displayed on the device 100 to the main menu, home menu, or root menu when touched by the user. In such embodiments, the "menu button" is implemented using the touch pad. In some other embodiments, the menu button is a physical push button or other physical input control device rather than a touch pad.

[0151] FIG. 1B is a block diagram showing exemplary components for event processing according to some embodiments. In some embodiments, the memory 102 (FIG. 1A) or 370 (FIG. 3) includes an event sorting unit 170 (e.g., within the operating system 126) and an individual application 136-1 (e.g., any of the aforementioned applications 137 to 151, 155, 380 to 390).

[0152] The event sorting unit 170 receives event information and determines the application 136-1 that distributes the event information and the application view 191 of the application 136-1. The event sorting unit 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, the application 136-1 includes an application internal state 192 that indicates the current application view(s) displayed on the touch-sensitive display 112 when the application is active or running. In some embodiments, the device / global internal state 157 is used by the event sorting unit 170 to determine which application(s) is / are currently active, and the application internal state 192 is used by the event sorting unit 170 to determine the application view 191 to which the event information is distributed.

[0153] In some embodiments, the application internal state 192 includes additional information such as resume information to be used when application 136-1 resumes execution, user interface state information indicating or ready to display the information being displayed by application 136-1, a state queue that enables the user to return to the previous state or view of application 136-1, and a redo / undo queue of previous actions performed by the user, among one or more of them.

[0154] The event monitor 171 receives event information from the peripheral device interface 118. The event information includes information regarding sub-events (e.g., a user touch as part of a multi-touch gesture on the touch-sensitive display 112). The peripheral device interface 118 transmits information received from the I / O subsystem 106, or sensors such as the proximity sensor 166, the accelerometer(s) 168, and / or the microphone 113 (via the audio circuit 110). The information that the peripheral device interface 118 receives from the I / O subsystem 106 includes information from the touch-sensitive display 112 or a touch-sensitive surface.

[0155] In some embodiments, the event monitor 171 transmits requests to the peripheral device interface 118 at predetermined intervals. In response, the peripheral device interface 118 transmits event information. In other embodiments, the peripheral device interface 118 transmits event information only when there is an important event (e.g., receipt of an input that exceeds a predetermined noise threshold and / or exceeds a predetermined duration).

[0156] In some embodiments, the event sorter 170 also includes a hit view determination module 172 and / or an active event recognition unit determination module 173.

[0157] The hit view determination module 172 provides a software procedure for determining where in one or more views a sub - event occurs when the touch - sensing display 112 is displaying two or more views. A view is composed of control devices and other elements that a user can view on the display.

[0158] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, within which information is displayed and touch - based gestures occur. The application view (of an individual application) in which a touch is detected optionally corresponds to a program level within the program hierarchy or view hierarchy of the application. For example, the lowest - level view in which a touch is detected is optionally referred to as the hit view, and the set of events recognized as appropriate input is optionally determined based at least in part on the hit view of the initial touch that initiates the touch - based gesture.

[0159] The hit view determination module 172 receives information related to sub - events of touch - based gestures. When an application has a plurality of hierarchically - structured views, the hit view determination module 172 identifies the hit view as the lowest - level view within the hierarchy in which the sub - event should be processed. In most situations, the hit view is the lowest - level view in which the start sub - event (e.g., the first sub - event in a series of sub - events that form an event or potential event) occurs. Once the hit view is identified by the hit view determination module 172, the hit view typically receives all sub - events related to the same touch or input source as the touch or input source identified as the hit view.

[0160] The active event recognition unit determination module 173 determines which view(s) within the view hierarchy should receive a particular series of sub-events. In some embodiments, the active event recognition unit determination module 173 determines that only the hit view should receive a particular series of sub-events. In other embodiments, the active event recognition unit determination module 173 determines that all views including the physical location of the sub-events are views that are actively involved, and thus determines that all views that are actively involved should receive a particular series of sub-events. In other embodiments, even if a touch sub-event is completely limited to an area associated with one particular view, the upper-level views within the hierarchy will still remain views that are actively involved.

[0161] The event dispatcher module 174 dispatches event information to an event recognition unit (e.g., event recognition unit 180). In embodiments that include the active event recognition unit determination module 173, the event dispatcher module 174 distributes event information to the event recognition unit determined by the active event recognition unit determination module 173. In some embodiments, the event dispatcher module 174 stores the event information retrieved by the individual event receiver 182 in an event queue.

[0162] In some embodiments, the operating system 126 includes an event sorter 170. Alternatively, the application 136-1 includes the event sorter 170. In still other embodiments, the event sorter 170 is a stand-alone module or part of another module stored in the memory 102 such as the touch / motion module 130.

[0163] In some embodiments, application 136-1 includes a plurality of event processing units 190 and one or more application views 191, each including instructions for processing touch events that occur within an individual view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognition units 180. Typically, an individual application view 191 includes a plurality of event recognition units 180. In other embodiments, one or more of the event recognition units 180 are part of a separate module, such as a user interface kit or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, an individual event processing unit 190 includes one or more of event data 179 received from data update unit 176, object update unit 177, GUI update unit 178, and / or event sorting unit 170. The event processing unit 190 optionally utilizes or invokes the data update unit 176, object update unit 177, or GUI update unit 178 to update the internal state of the application 192. Alternatively, one or more of the application views 191 include one or more respective event processing units 190. Also, in some embodiments, one or more of the data update unit 176, object update unit 177, and GUI update unit 178 are included in an individual application view 191.

[0164] An individual event recognition unit 180 receives event information (e.g., event data 179) from the event sorting unit 170 and identifies an event from the event information. The event recognition unit 180 includes an event receiving unit 182 and an event comparing unit 184. In some embodiments, the event recognition unit 180 also includes at least a subset of metadata 183 and event distribution instructions 188 (optionally including sub-event distribution instructions).

[0165] The event receiving unit 182 receives event information from the event sorting unit 170. The event information includes sub-events, for example, information about a touch or a movement of a touch. Depending on the sub-event, the event information also includes additional information such as the location of the sub-event. When the sub-event is related to the movement of a touch, the event information also optionally includes the speed and direction of the sub-event. In some embodiments, the event includes a rotation of the device from one orientation to another (for example, from portrait to landscape or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the posture of the device).

[0166] The event comparison unit 184 compares the event information with the definition of a predefined event or sub-event, and based on the comparison, determines an event or sub-event, or determines or updates the state of an event or sub-event. In some embodiments, the event comparison unit 184 includes an event definition 186. The event definition 186 includes definitions of events (for example, a predefined series of sub-events) such as event 1 (187-1) and event 2 (187-2). In some embodiments, the sub-events within an event (187-1 and / or 187-2) include, for example, a touch start, a touch end, a touch movement, a touch cancellation, and multiple touches. In one example, the definition of event 1 (187-1) is a double-tap on a displayed object. The double-tap includes, for example, a first touch (touch start) on the displayed object for a predetermined stage, a first lift-off (touch end) for the predetermined stage, a second touch (touch start) on the displayed object for the predetermined stage, and a second lift-off (touch end) for the predetermined stage. In another example, the definition of event 2 (187-2) is a drag on a displayed object. The drag includes, for example, a touch (or contact) on the displayed object for a predetermined stage, a movement of the touch across the touch-sensitive display 112, and a lift-off of the touch (touch end). In some embodiments, the event also includes information about one or more associated event processing units 190.

[0167] In some embodiments, event definition 186 includes the definition of events for individual user interface objects. In some embodiments, event comparison unit 184 performs a hit test to determine which user interface object is associated with the sub-event. For example, within an application view in which three user interface objects are displayed on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparison unit 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with an individual event processing unit 190, the event comparison unit determines which event processing unit 190 should be activated using the results of the hit test. For example, event comparison unit 184 selects the event processing unit associated with the sub-event and object that triggered the hit test.

[0168] In some embodiments, the definition of an individual event 187 also includes a delay action that delays the delivery of event information until it is determined whether a series of sub-events corresponds to the event type of the event recognition unit.

[0169] If individual event recognition unit 180 determines that a series of sub-events does not match any of the events in event definition 186, individual event recognition unit 180 enters a state of event impossible, event failure, or event end, and then ignores the next sub-event of the touch-based gesture. In this situation, if there are other event recognition units that remain active for the hit view, that event recognition unit continues to track and process the sub-events of the ongoing touch-based gesture.

[0170] In some embodiments, an individual event recognition unit 180 includes metadata 183 having configurable properties, flags, and / or lists indicating how the event distribution system should actively participate in event recognition units that perform sub-event distribution. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists indicating how event recognition units interact with each other or how they can interact with each other. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists indicating at what various levels in the view hierarchy or program hierarchy sub-events are distributed.

[0171] In some embodiments, an individual event recognition unit 180 activates an event processing unit 190 associated with an event when one or more specific sub-events of the event are recognized. In some embodiments, an individual event recognition unit 180 distributes event information associated with an event to the event processing unit 190. Activating the event processing unit 190 is separate from sending (and deferring sending) sub-events to individual hit views. In some embodiments, the event recognition unit 180 sets a flag associated with the recognized event, and the event processing unit 190 associated with that flag catches the flag and executes a predefined process.

[0172] In some embodiments, the event distribution command 188 includes a sub-event distribution command that distributes event information about sub-events without activating the event processing unit. Instead, the sub-event distribution command distributes event information to an event processing unit associated with a series of sub-events or to a view that is actively involved. The event processing unit associated with a series of sub-events or an actively involved view receives the event information and executes a predetermined process.

[0173] In some embodiments, the data update unit 176 creates and updates data used in application 136-1. For example, the data update unit 176 updates the phone numbers used in the contact module 137 or stores video files used in the video player module. In some embodiments, the object update unit 177 creates and updates objects used in application 136-1. For example, the object update unit 177 creates a new user interface object or updates the position of a user interface object. The GUI update unit 178 updates the GUI. For example, the GUI update unit 178 prepares display information and sends the display information to the graphic module 132 for display on the touch-sensitive display.

[0174] In some embodiments, the event processing unit(s) 190 includes or has access to the data update unit 176, the object update unit 177, and the GUI update unit 178. In some embodiments, the data update unit 176, the object update unit 177, and the GUI update unit 178 are included in a single module of the individual application 136-1 or the application view 191. In other embodiments, they are included in two or more software modules.

[0175] The foregoing description regarding event processing of a user's touch on the touch-sensitive display also applies to other forms of user input for operating the multifunctional device 100 using an input device, but it should be understood that not all of them are initiated on the touch screen. For example, the movement of a mouse and the pressing of a mouse button, optionally in conjunction with a single or multiple presses or holds of a keyboard, the movement of a contact such as a tap, drag, scroll on a touch pad, pen stylus input, the movement of the device, voice commands, detected eye movement, biometric input, and / or any combination thereof are optionally utilized as input corresponding to sub-events that define events to be recognized.

[0176] Figure 2 shows a portable multifunctional device 100 having a touch screen 112, according to some embodiments. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment, as well as in other embodiments described below, the user can select one or more of those graphics, for example, by performing gestures on the graphics using one or more fingers 202 (not drawn to scale in the figure) or one or more styli 203 (not drawn to scale in the figure). In some embodiments, the selection of one or more graphics is performed when the user interrupts contact with that one or more graphics. In some embodiments, the gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, upward and / or downward) of a finger in contact with the device 100, and / or rolling (from right to left, from left to right, upward and / or downward). In some implementations or situations, an unexpected contact with a graphic does not select that graphic. For example, if the gesture corresponding to the selection is a tap, a swipe gesture across an application icon does not optionally select the corresponding application.

[0177] The device 100 also optionally includes one or more physical buttons, such as a "home" button or a menu button 204. As described above, the menu button 204 is optionally used to navigate to any application 136 within a set of applications running on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key within the GUI displayed on the touch screen 112.

[0178] In some embodiments, device 100 includes a touch screen 112, a menu button 204, a push button 206 for turning the device on / off and locking the device, volume adjustment button(s) 208, a subscriber identity module (SIM) card slot 210, a headset jack 212, and a docking / charging external port 124. The push button 206 is optionally used to turn the device on / off by pressing the button and holding it pressed for a predefined period, lock the device by pressing the button and releasing it before a predefined time has elapsed, and / or unlock the device or initiate an unlock process. In an alternative embodiment, device 100 also accepts voice inputs via a microphone 113 to activate or deactivate some functions. Device 100 optionally also includes one or more contact intensity sensors 165 for detecting the intensity of contacts on the touch screen 112 and / or one or more haptic output generators 167 for generating haptic outputs to the user of device 100.

[0179] Figure 3 is a block diagram of an exemplary multifunctional device having a display and a touch sensing surface, according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device, navigation device, educational device (such as a child's learning toy), gaming system, or a control device (e.g., a home or business controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more networks or other communication interfaces 360, memory 370, and one or more communication buses 320 that interconnect these components. Communication bus 320 optionally includes circuitry (sometimes called a chipset) that interconnects and controls communications between system components. Device 300 includes an input / output (I / O) interface 330 that includes a display 340, which is typically a touch screen display. I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350, a touch pad 355, a haptic output generator 357 that generates haptic output on device 300 (e.g., similar to haptic output generator(s) 167 described above with reference to FIG. 1A), and a sensor 359 (e.g., light, acceleration, proximity, touch sensing, and / or a contact intensity sensor similar to contact intensity sensor(s) 165 described above with reference to FIG. 1A). Memory 370 includes high-speed random access memory such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices, and optionally includes non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. Memory 370 optionally includes one or more storage devices located remotely from the CPU(s) 310.In some embodiments, memory 370 stores programs, modules, and data structures similar to, or a subset of, the programs, modules, and data structures stored in memory 102 of portable multifunction device 100 (FIG. 1A). Further, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, a word processing module 384, a website creation module 386, a disk authoring module 388, and / or a spreadsheet module 390, whereas memory 102 of portable multifunction device 100 (FIG. 1A) optionally does not store these modules.

[0180] Each of the elements identified above in FIG. 3 is optionally stored in one or more of the memory devices described above. Each of the modules identified above corresponds to a set of instructions for performing the functions described above. The modules or computer programs identified above (e.g., a set of instructions or instructions) need not be implemented as separate software programs (e.g., computer programs including instructions), procedures, or modules, and thus in various embodiments, various subsets of these modules are optionally combined or otherwise reconfigured. In some embodiments, memory 370 optionally stores a subset of the modules and data structures identified above. Further, memory 370 optionally stores additional modules and data structures not described above.

[0181] Next, optionally direct attention to embodiments of a user interface, for example, implemented on portable multifunction device 100.

[0182] FIG. 4A shows an exemplary user interface of a menu of an application on a portable multifunctional device 100 according to some embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, the user interface 400 includes the following elements, or a subset or superset thereof. ● One or more signal strength indicators (s) 402 for wireless communication (s) such as cellular and Wi-Fi signals, ● Time 404, ● Bluetooth indicator 405, ● Battery status indicator 406, ● A tray 408 having icons of frequently used applications such as the following ○ An icon 416 of the phone module 138 labeled "Phone", optionally including an indicator 414 of the number of missed calls or voicemail messages, ○ An icon 418 of the email client module 140 labeled "Mail", optionally including an indicator 410 of the number of unread emails, ○ An icon 420 of the browser module 147 labeled "Browser", and ○ An icon 422 for the video and music player module 152, also referred to as the iPod (trademark of Apple Inc.) module 152, labeled "iPod", and ● Icons of other applications such as the following, ○ An icon 424 of the IM module 141 labeled "Message", ○ An icon 426 of the calendar module 148 labeled "Calendar", ○ An icon 428 of the image management module 144 labeled "Photos", ○ An icon 430 of the camera module 143 labeled "Camera", ○ An icon 432 of the online video module 155 labeled "Online Video", ○ The icon 434 of the stock price widget 149-2 labeled with "Stock Price", ○ The icon 436 of the map module 154 labeled with "Map", ○ The icon 438 of the weather widget 149-1 labeled with "Weather", ○ The icon 440 of the alarm clock widget 149-4 labeled with "Clock", ○ The icon 442 of the training support module 142 labeled with "Training Support", ○ The icon 444 of the memo module 153 labeled with "Memo", and ○ The icon 446 of the settings application or module labeled with "Settings" that provides access to the settings of the device 100 and its various applications 136.

[0183] Note that the icon labels shown in FIG. 4A are merely illustrative. For example, the icon 422 of the video and music player module 152 is labeled with "Music" or "Music Player". Other labels may optionally be used for the various application icons. In some embodiments, the label for an individual application icon includes the name of the application corresponding to the individual application icon. In some embodiments, the label for a particular application icon is different from the name of the application corresponding to that particular application icon.

[0184] FIG. 4B shows an exemplary user interface on a device (e.g., device 300 of FIG. 3) having a touch sensing surface 451 (e.g., tablet or touch pad 355 of FIG. 3) separate from the display 450 (e.g., touch screen display 112). The device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) that detect the intensity of contact on the touch sensing surface 451, and / or one or more haptic output generators 357 that generate haptic output to the user of the device 300.

[0185] Some of the following examples are given with reference to inputs on the touch screen display 112 (where the touch sensing surface and the display are combined), but in some embodiments, the device detects inputs on a touch sensing surface separate from the display, as shown in FIG. 4B. In some embodiments, the touch sensing surface (e.g., 451 of FIG. 4B) has a primary axis (e.g., 452 of FIG. 4B) corresponding to a primary axis (e.g., 453 of FIG. 4B) on the display (e.g., 450). According to these embodiments, the device detects contact (e.g., 460 and 462 of FIG. 4B) with the touch sensing surface 451 at locations (e.g., in FIG. 4B, 460 corresponds to 468 and 462 corresponds to 470) corresponding to each location on the display. In this way, user inputs (e.g., contacts 460 and 462 and their movements) detected by the device on the touch sensing surface (e.g., 451 of FIG. 4B) are used by the device to operate the user interface on the display (e.g., 450 of FIG. 4B) of the multifunctional device when the touch sensing surface is separate from the display. It should be understood that a similar method is optionally used for other user interfaces described herein.

[0186] In addition, while the following examples are given mainly with reference to finger inputs (e.g., finger contact, finger tap gesture, finger swipe gesture), it should be understood that in some embodiments, one or more of the finger inputs may be replaced by inputs from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture may optionally be a mouse click (e.g., instead of a contact), followed by a mouse click that involves movement of the cursor along the path of the swipe (e.g., instead of movement of a contact). As another example, a tap gesture may optionally be replaced by a mouse click while the cursor is located on the location of the tap gesture (e.g., instead of detecting a contact and subsequently ceasing to detect the contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice may optionally be used simultaneously, or mouse and finger contacts may optionally be used simultaneously.

[0187] FIG. 5A shows an exemplary personal electronic device 500. The device 500 includes a body 502. In some embodiments, the device 500 can include some or all of the functions described with respect to devices 100 and 300 (e.g., FIGS. 1A - 4B). In some embodiments, the device 500 has a touch-sensitive display screen 504, hereinafter referred to as touch screen 504. Alternatively, or in addition to the touch screen 504, the device 500 has a display and a touch-sensitive surface. Similar to devices 100 and 300, in some embodiments, the touch screen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors that detect the intensity of an applied contact (e.g., a touch). One or more intensity sensors of the touch screen 504 (or touch-sensitive surface) can provide output data representing the intensity of the touch. The user interface of the device 500 can respond to the touch(es) based on its intensity, which means that touches of different intensities can call different user interface operations on the device 500.

[0188] Exemplary techniques for detecting and processing touch intensity are described, for example, in International Patent Application No. PCT / US2013 / 040061, filed May 8, 2013, "Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application," published as International Publication No. WO / 2013 / 169849, and International Patent Application No. PCT / US2013 / 069483, filed Nov. 11, 2013, "Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships," each of which is hereby incorporated by reference in its entirety.

[0189] In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508, if included, can be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms, if included, can enable device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watch bands, chains, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms enable a user to wear device 500.

[0190] FIG. 5B shows an exemplary personal electronic device 500. In some embodiments, device 500 can include some or all of the components described with respect to FIGS. 1A, 1B, and 3. Device 500 has a bus 512 that operably couples an I / O section 514 to one or more computer processors 516 and a memory 518. The I / O section 514 can be connected to a display 504, which can have a touch sensing component 522 and optionally an intensity sensor 524 (e.g., a contact intensity sensor). Additionally, the I / O section 514 can be connected to a communication unit 530 that receives application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular, and / or other wireless communication technologies. The device 500 can include an input mechanism 506 and / or 508. The input mechanism 506 can optionally be, for example, a rotatable input device or a depressible and rotatable input device. In some examples, the input mechanism 508 can optionally be a button.

[0191] In some examples, the input mechanism 508 can optionally be a microphone. The personal electronic device 500 can optionally include various sensors such as a GPS sensor 532, an accelerometer 534, a direction sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which can be operably connected to the I / O section 514.

[0192] The memory 518 of the personal electronic device 500 can include one or more non-transitory computer-readable storage media for storing computer-executable instructions, which, when executed by, for example, one or more computer processors 516, can cause the computer processor to execute the techniques described below, including processes 700-1300, 1500-1800, and 2000 (FIGS. 7-13, FIGS. 15-18, and FIGS. 20A-20B). A computer-readable storage media can be any media that can tangibly contain or store computer-executable instructions used by or associated with an instruction execution system, apparatus, or device. In some embodiments, the storage media is a transitory computer-readable storage media. In some embodiments, the storage media is a non-transitory computer-readable storage media. Non-transitory computer-readable storage media can include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and persistent solid-state memories such as flash, solid-state drives, and the like. The personal electronic device 500 is not limited to the components and configuration of FIG. 5B and can include other or additional components in a plurality of configurations.

[0193] As used herein, the term "affordance" refers to user interaction graphical user interface objects that are optionally displayed on the display screen of devices 100, 300, and / or 500 (FIGS. 1A, 3, and 5A-5B). For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) each optionally constitute an affordance.

[0194] As used herein, the term "focus selector" refers to an input element that indicates the current part of the user interface with which the user is interacting. In some implementations that include a cursor or other location marker, the cursor acts as the "focus selector," and thus while the cursor is positioned over a particular user interface element (e.g., a button, window, slider, or other user interface element), when an input (e.g., a press input) is detected on a touch-sensitive surface (e.g., the touchpad 355 of FIG. 3 or the touch-sensitive surface 451 of FIG. 4B), the particular user interface element is adjusted according to the detected input. In some implementations that include a touch screen display (e.g., the touch-sensitive display system 112 of FIG. 1A or the touch screen 112 of FIG. 4A) that enables direct interaction with user interface elements on the touch screen display, the detected contact on the touch screen acts as the "focus selector," and thus when an input (e.g., a press input by contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touch screen display, the particular user interface element is adjusted according to the detected input. In some implementations, the focus is moved from one region of the user interface to another region of the user interface without moving the corresponding cursor or contact on the touch screen display (e.g., by using the tab key or arrow keys to move the focus from one button to another button), and in these implementations, the focus selector moves in accordance with the movement of the focus between various regions of the user interface. Regardless of the specific form the focus selector takes, the focus selector is generally a user interface element (or a contact on the touch screen display) that is controlled by the user to communicate the user's intended interaction with the user interface (e.g., by indicating to the device the element of the user interface through which the user intends to interact).For example, the location of a focus selector (e.g., a cursor, a contact, or a selection box) over an individual button while a press input is detected on a touch sensing surface (e.g., a touch pad or a touch screen) indicates that the user intends to activate that individual button (as opposed to other user interface elements shown on the device's display).

[0195] As used in this specification and the claims, the term "characteristic strength" of a contact refers to the characteristics of that contact based on one or more strengths of the contact. In some embodiments, the characteristic strength is based on a plurality of strength samples. The characteristic strength is optionally based on a set of strength samples collected during a predetermined time (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) associated with a predetermined number of strength samples, i.e., a predetermined event (e.g., after detecting a contact, before detecting lift-off of the contact, before or after detecting the start of movement of the contact, before detecting the end of the contact, before or after detecting an increase in the strength of the contact, and / or before or after detecting a decrease in the strength of the contact). The characteristic strength of a contact is optionally based on one or more of the maximum value of the strength of the contact, the mean value of the strength of the contact, the average value of the strength of the contact, the top 10 percentile value of the strength of the contact, the median value of the strength of the contact, the top 90 percent value of the strength of the contact, etc. In some embodiments, the duration of the contact is used when determining the characteristic strength (e.g., when the characteristic strength is the average of the strength of the contact over time). In some embodiments, the characteristic strength is compared to a set of one or more strength thresholds to determine whether an action has been performed by a user. For example, the set of one or more strength thresholds optionally includes a first strength threshold and a second strength threshold. In this example, a contact having a characteristic strength that does not exceed the first threshold results in a first action, a contact having a characteristic strength that exceeds the first strength threshold but does not exceed the second strength threshold results in a second action, and a contact having a characteristic strength that exceeds the second threshold results in a third action. In some embodiments, the comparison between the characteristic strength and one or more thresholds is not used to determine whether to perform a first action or a second action, but is used to determine whether to perform one or more actions (e.g., whether to perform an individual action or to refrain from performing an individual action).

[0196] As used herein, an "installed application" refers to a software application that has been downloaded onto an electronic device (e.g., device 100, 300, and / or 500) and is ready to be launched (e.g., opened) on the device. In some embodiments, the downloaded application becomes an installed application by an installation program that extracts a program portion from the downloaded package and integrates the extracted portion with the operating system of the computer system.

[0197] As used herein, the terms "open application" or "running application" refer to a software application that has held state information (e.g., as part of device / global internal state 157 and / or application internal state 192). An open or running application is optionally any one of the following types of applications. ● An active application currently displayed on the display screen of the device being used by the application, ● A background application (or background process) for which one or more processes are being processed by one or more processors although not currently displayed, and ● An interrupted or paused application that is not running but is stored in memory (volatile and non-volatile, respectively) and has state information that can be used to resume execution of the application.

[0198] As used herein, the term "closed application" refers to a software application that does not have retained state information (e.g., state information for a closed application is not stored in the memory of the device). Thus, closing an application includes stopping and / or removing the application process for the application and removing the state information for the application from the memory of the device. Generally, opening a second application within a first application does not close the first application. When the second application is being displayed and the display of the first application is stopped, the first application becomes a background application.

[0199] FIG. 5C shows an exemplary diagram of a communication session between electronic devices 500A, 500B, and 500C. Devices 500A, 500B, and 500C are similar to electronic device 500 and each share one or more data connections 510 such as an Internet connection, a Wi-Fi connection, a cellular connection, a short-range communication connection, and / or any other such data connection or network with each other to facilitate real-time communication of audio and / or video data between their respective devices over a period of time. In some embodiments, an exemplary communication session can include a shared data session in which data is communicated from one or more of the electronic devices to other electronic devices to enable simultaneous output of individual content on the electronic devices. In some embodiments, an exemplary communication session can include a video conferencing session in which audio and / or video data is communicated between devices 500A, 500B, and 500C such that the users of each device can participate in real-time communication using the electronic devices.

[0200] In FIG. 5C, device 500A represents an electronic device associated with user A. Device 500A is communicating (via data connection 510) with devices 500B and 500C respectively associated with users B and C. Device 500A includes a camera 501A used to capture video data of the communication session and a display 504A (e.g., a touch screen) used to display content associated with the communication session. Device 500A also includes other components such as a microphone (e.g., 113) for recording audio for the communication session and a speaker (e.g., 111) for outputting audio for the communication session.

[0201] Device 500A displays a communication UI 520A, which is a user interface that facilitates a communication session (e.g., a video conferencing session) between device 500B and device 500C via display 504A. Communication UI 520A includes video feed 525-1A and video feed 525-2A. Video feed 525-1A is a representation of video data captured at device 500B (e.g., using camera 501B) and communicated from device 500B to devices 500A and 500C during the communication session. Video feed 525-2A is a representation of video data captured at device 500C (e.g., using camera 501C) and communicated from device 500C to devices 500A and 500B during the communication session.

[0202] Communication UI 520A includes a camera preview 550A, which is a representation of video data captured at device 500A via camera 501A. Camera preview 550A represents the expected video feed of user A as displayed on respective devices 500B and 500C to user A.

[0203] The communication UI 520A includes one or more controls 555A that control one or more aspects of a communication session. For example, the control 555A can include controls for muting the audio of a communication session, changing the camera view of a communication session (e.g., changing which camera is used to capture the video of a communication session, adjusting the zoom value), ending a communication session, applying a visual effect to the camera view of a communication session, and activating one or more modes associated with a communication session. In some embodiments, the one or more controls 555A are optionally displayed on the communication UI 520A. In some embodiments, the one or more controls 555A are displayed separately from the camera preview 550A. In some embodiments, the one or more controls 555A are displayed over at least a portion of the camera preview 550A.

[0204] In FIG. 5C, device 500B represents an electronic device associated with user B that is communicating (via data connection 510) with devices 500A and 500C. Device 500B includes a camera 501B that is used to capture video data for a communication session and a display 504B (e.g., a touch screen) that is used to display content associated with the communication session. Device 500B also includes other components such as a microphone (e.g., 113) for recording audio for a communication session and a speaker (e.g., 111) for outputting audio for a communication session.

[0205] Device 500B displays a communication UI 520B similar to the communication UI 520A of device 500A via a touch screen 504B. The communication UI 520B includes video feeds 525-1B and 525-2B. The video feed 525-1B is a representation of video data captured in device 500A (e.g., using camera 501A) and communicated from device 500A to devices 500B and 500C during a communication session. The video feed 525-2B is a representation of video data captured in device 500C (e.g., using camera 501C) and communicated from device 500C to devices 500A and 500B during a communication session. The communication UI 520B also includes a camera preview 550B which is a representation of video data captured in device 500B via camera 501B, and one or more controls 555B similar to control 555A for controlling one or more aspects of the communication session. The camera preview 550B represents the expected video feeds of user B as displayed on respective devices 500A and 500C to user B.

[0206] In FIG. 5C, device 500C represents an electronic device associated with user C that is communicating (via data connection 510) with devices 500A and 500B. Device 500C includes a camera 501C used to capture video data for the communication session, and a display 504C (e.g., a touch screen) used to display content associated with the communication session. Device 500C also includes other components such as a microphone (e.g., 113) for recording audio for the communication session and a speaker (e.g., 111) for outputting audio for the communication session.

[0207] Device 500C displays a communication UI 520C similar to the communication UI 520A of device 500A and the communication UI 520B of device 500B via a touch screen 504C. The communication UI 520C includes video feeds 525-1C and 525-2C. The video feed 525-1C is a representation of video data captured at device 500B (e.g., using camera 501B) and communicated from device 500B to devices 500A and 500C during a communication session. The video feed 525-2C is a representation of video data captured at device 500A (e.g., using camera 501A) and communicated from device 500A to devices 500B and 500C during a communication session. The communication UI 520C also includes a camera preview 550C, which is a representation of video data captured at device 500C via camera 501C, and one or more controls 555C for controlling one or more aspects of the communication session, similar to controls 555A and 555B. The camera preview 550C represents the expected video feeds of user C as displayed on respective devices 500A and 500B to user C.

[0208] The figure shown in FIG. 5C represents a communication session among three electronic devices, but the communication session can be established between two or more electronic devices, and the number of devices participating in the communication session can change as an electronic device joins or leaves the communication session. For example, when one of the electronic devices leaves the communication session, the audio and video data from the device that has stopped participating in the communication session are no longer represented on the participating devices. For example, when device 500B stops participating in the communication session, the data connection 510 between devices 500A and 500C and the data connection 510 between devices 500C and 500B do not exist. In addition, device 500A does not include video feed 525-1A, and device 500C does not include video feed 525-1C. Similarly, when a device joins the communication session, a connection is established between the participating device and the existing devices, and video data and audio data are shared among all devices so that each device can output the data communicated from other devices.

[0209] The embodiment shown in FIG. 5C represents a diagram of a communication session among a plurality of electronic devices, including the exemplary communication sessions shown in FIGS. 6A-6EQ and FIGS. 14A-14AG. In some embodiments, the communication sessions shown in FIGS. 6A-6EQ and FIGS. 14A-14AG include two or more electronic devices even if other electronic devices involved in the communication session are not shown in the figure.

[0210] Next, attention is directed to embodiments of a user interface ("UI") and related processes implemented on an electronic device such as the portable multifunctional device 100, device 300, or device 500.

[0211] Figures 6A - 6EQ illustrate exemplary user interfaces for managing a shared content session according to some embodiments. The user interfaces of these figures are used to illustrate the processes described below, including the processes of FIGS. 7 - 13 and FIGS. 17 - 18. In some embodiments, the user interfaces of FIGS. 6A - 6EQ can be used to illustrate the processes described below with respect to FIGS. 15 - 16.

[0212] This disclosure describes embodiments for managing a shared content session (also referred to as a shared session) that can be simultaneously output on multiple devices where individual content participates in the shared content session. In some embodiments, the individual content is screen sharing content. For example, the content of the displayed screen of the host device is shared with the participants of the shared content session, and the participants can, on their respective devices, view in real time the screen content of the host device (the shared device, or the device where the screen content is shared) including any changes to the displayed screen content. In some embodiments, the individual content is synchronized content that is simultaneously output on each of the devices of the participants of the shared content session. For example, each of the devices of the participants separately accesses individual content (e.g., video, movie, TV program, and / or song) from a remote server and / or local memory, and is synchronized at each output of the content, such that when each device separately accesses the individual content from the remote server and / or local memory, the content is output simultaneously on each device (e.g., via an application local to each device). In some embodiments, each device exchanges information (e.g., via a server) to facilitate synchronization. For example, each device shares indications of the playback state and / or playback location information of the content, as well as local commands (e.g., play, pause, stop, fast forward, and / or rewind) to implement commands for the output of the content on other devices. Sharing the playback state and / or playback location information is more efficient and effective for synchronizing the content on each device because the host device does not send the content to each device, but rather sends smaller data packets including the playback state and / or playback location information.In addition, each respective device outputs content in a size and quality appropriate for each respective device and the device's connectivity (e.g., data connection conditions such as data transmission and / or processing speed), thereby providing a more customized and synchronized playback experience on each of the respective devices. In some embodiments, an application (or "app") is available (e.g., downloadable and / or installable) on each respective device to enable the device to participate in a shared content session.

[0213] Unless otherwise specified, as discussed herein, the terms "share," "sharing," or "shared" generally refer to a situation where content (e.g., screen share content and / or synchronized content) is output (e.g., viewed and / or played) simultaneously on multiple devices participating in a shared content session or can be output. Unless otherwise noted, these terms do not require that the "shared" content be transmitted from any particular device participating in the shared content session to any of the other devices with which the content is being shared. In some embodiments, the content being shared in a shared content session is content that is separately accessed by each respective device from, for example, a remote server or another source other than one of the devices participating in the shared content session. For example, in some embodiments, when media content such as a movie is being played on devices participating in a shared content session, the movie is said to be shared with the participants even if each participant accesses (e.g., from a movie application) and plays the movie separately (but simultaneously) from the other participants in the shared content session. In some embodiments, screen share content is shared with the participants in a shared content session by the host device transmitting image data representing the content displayed on the host device's display screen to the other devices participating in the shared content session.

[0214] In some embodiments, one or more audio channels are active (e.g., open) during a shared content session, such that participants in the shared content session can optionally talk to each other in real time while the content is being shared via the shared content session (e.g., screen share content and / or synchronized content) while the shared content session is in progress. In some embodiments, one or more video channels are open (e.g., via a video conferencing application that is local to each device), such that participants in the shared content session can participate in live video communication (e.g., video chat) while the shared content session is in progress and optionally while the content is being shared via the shared content session. Various aspects of these embodiments, and further details of the shared content session, are described below with reference to the figures.

[0215] FIG. 6A illustrates exemplary devices for participating in a shared content session according to some embodiments. Specifically, these devices include John's device 6000A (e.g., a smartphone) and Jane's device 6000B (e.g., a smartphone), which are shown side by side to illustrate the simultaneous states of the respective devices, including the user interfaces and inputs on the respective devices. John's device 6000A includes a display 6001A, one or more cameras 6002A, one or more microphones 6003A (also referred to as mic 6003A), and one or more speakers 6007A (similar to, e.g., speaker 111). Jane's device 6000B includes a display 6001B, one or more cameras 6002B, one or more microphones 6003B (also referred to as mic 6003B), and one or more speakers 6007B (similar to, e.g., speaker 111). John's device 6000A is similar to Jane's device 6000B. In the following description, reference numbers can include the letter "A" to refer to elements of John's device, can include the letter "B" to refer to elements of Jane's device, or can be without letters to refer to elements of one or both devices. For example, devices 6000A and 6000B can be referred to using reference number 6000, i.e., reference number 6000 can be used herein to refer to John's device 6000A or Jane's device 6000B, or both. Similarly, other elements sharing a common reference number can be referred to in the same way. For example, displays 6001A and 6001B, cameras 6002A and 6002B, microphones 6003A and 6003B, and speakers 6007A and 6007B can be referred to using reference numbers 6001, 6002, 6003, and 6007, respectively. In some embodiments, device 6000 includes one or more features of devices 100, 300, and / or 500.

[0216] In the embodiments provided herein, John's device 6000A can be described as performing a set of functions associated with a shared content session, and Jane's device 6000B can be described as performing a different set of functions associated with the shared content session. These descriptions are not intended to limit the functions performed by each device, but rather are provided to illustrate various aspects and embodiments of the shared content session. Thus, unless otherwise specified, the functions described as being performed by John's device 6000A can similarly be performed by Jane's device 6000B and the devices of other participants in the shared content session. Similarly, the functions described as being performed by Jane's device 6000B can, unless otherwise specified, similarly be performed by John's device 6000A and the devices of other participants in the shared content session.

[0217] Figures 6A - 6L illustrate an exemplary embodiment in which John initiates a shared content session with members of a group called "Mountaineers". In Figure 6A, devices 6000A and 6000B are not within a shared content session (the shared content session is not active and the devices are not currently participating in any shared content session). John's device 6000A displays a message interface 6004A via display 6001A. Jane's device 6000B is not displaying any content (e.g., device 6000B is in a locked and / or inactive state). In Figure 6A, message interface 6004A shows a group message conversation including message 6004A-1 among participants of the group called "Mountaineers". Message 6004A-1 is displayed in message display area 6004A-3. Message interface 6004A includes a Mountaineers group logo displayed in header area 6004A-2. John's device 6000A detects an input 6005 (e.g., a tap input, a tap gesture) within header area 6004A-2 via display 6001A and, in response, displays options 6006 as shown in Figure 6B.

[0218] In FIG. 6B, John's device 6000A expands the header region 6004A-2 and displays option 6006 in response to detecting input 6005. The options include a phone option 6006-1, a video conferencing option 6006-2, a sharing option 6006-3, and a status option 6006-4. The phone option 6006-1 is selectable to call a member of the climber group. The video conferencing option 6006-2 is selectable to initiate a video conferencing session with a member of the climber group. The sharing option 6006-3 is selectable to initiate a shared content session with a member of the climber group. The status option 6006-4 is selectable to view the status card of the climber group. In FIG. 6B, John's device 6000A detects input 6008 on the sharing option 6006-3 and, in response, initiates a shared content session with a member of the climber group.

[0219] In FIG. 6C, John's device 6000A has initiated a shared content session with members of a group of climbers. John's device 6000A provides information associated with an active shared content session between John's device 6000A and other participants in the climber group, and displays a control region 6015A that includes selectable options for controlling the operation, parameters, and / or settings of the active shared content session. Additionally, John's device 6000A displays a dynamic graphic 6010A within a message interface 6004A. The dynamic graphic 6010A is displayed in a message display area along with a message 6004A-1, indicating that the shared content session has been initiated and including the status of the shared content session (e.g., four people have been invited to participate). The dynamic graphic 6010A is dynamically updated based on detected changes to various parameters of the shared content session and, in some embodiments, is selectable to perform various functions associated with the shared content session. In some embodiments, the dynamic graphic 6010A is displayed in the message interface 6004A even if the shared content session is initiated from an application other than the message application (e.g., from a video conferencing application). In some embodiments, the dynamic graphic 6010A can include different information such as the name and / or logo of the group participating in the shared content session, the names of the participants, the activities occurring in the shared content session, or other relevant information. In some embodiments, the dynamic graphic 6010A can include selectable options for joining or leaving the shared content session. The content displayed within the dynamic graphic 6010A is specific to John's device 6000A. For example, in the embodiment shown in FIG. 6C, since John's device 6000A has already participated in the shared content session in response to a request to initiate the shared content session, the dynamic graphic 6010A does not include a selectable "Join" option.

[0220] The control area 6015A provides information associated with the shared content session. As shown in FIG. 6C, at least some of this information is displayed in the status area 6015A-1, which includes an identifier 6015A-2 representing the name of the group participating in the shared content session and the logo of the group. The status area 6015A-1 also includes a status 6015A-3 indicating that currently four participants are being invited to participate in the shared content session. The control area 6015A also includes various selectable options for controlling the operation, parameters, and / or settings of the shared content session. For example, the message option 6015A-4 is selectable in some embodiments to view a message conversation (e.g., the message interface 6004A) among the participants of the shared content session. The speaker option 6015A-5 is selectable in some embodiments to enable or disable the audio output (or to enable or disable the speaker mode) on John's device 6000A (e.g., at the speaker 6007A) via the shared content session. The microphone option 6015A-6 is selectable in some embodiments to enable or disable the audio channel for the shared content session related to John's device 6000A. The microphone option 6015A-6 is shown in an enabled state (e.g., bold) to indicate that the microphone 6003A is currently enabled and that the audio channel for John's device 6000A is enabled for the shared content session. The video option 6015A-7 is selectable in some embodiments to start a video conferencing session with the participants of the shared content session, view an ongoing video conferencing session, enable / disable the camera, and / or select a different camera used for the shared content session. The share option 6015A-8 is selectable in some embodiments to start a screen sharing option where the content of John's screen is shared with the participants of the shared content session.In some embodiments, the leave option 6015A-9 is optionally selectable to cause John (or John's device 6000A) to leave the shared content session without ending the shared content session for the other participants of the shared content session. In some embodiments, the share option 6015A-8 is selectable to display and / or change various media playback settings.

[0221] In some embodiments, the appearance of the share option 6015A-8 is used to indicate the playback status of the content and / or playback settings for media output during the shared content session. For example, in some embodiments, the share option 6015A-8 is shown in bold (or otherwise visually emphasized) when content is being output via the shared content session (e.g., when screen share content or synchronized content is being output), and not in bold (or otherwise not visually emphasized) when screen share or synchronized content is not being output during the shared content session. In some embodiments, the share option 6015A-8 is bold or not bold to indicate various playback settings, such as settings for determining whether to prompt the user to share the selected media with the participants of the shared content session, as described in more detail below. In some embodiments, the share option 6015A-8 can be selected to change the playback settings, as described in more detail below.

[0222] In response to John starting a shared content session, the members of the climber group receive an invitation to participate in the shared content session. Since Jane is a member of the climber group, Jane's device 6000B includes information about the shared content session and displays an invitation 6012 inviting Jane to participate in the shared content session.

[0223] As shown in FIG. 6C, John's device 6000A detects a home gesture 6014, and Jane's device 6000B detects an input 6016 on an invitation 6012. In response to detecting the home gesture 6014, John's device 6000A displays a home screen 6018 and erases a control region 6015A. In some embodiments, the control region 6015A is automatically erased when no input is detected in the control region for a predetermined amount of time (e.g., 1 second, 3 seconds, or 5 seconds). In some embodiments, when the device is participating in a shared content session and the control region is not displayed, the device displays a visual indication of the ongoing shared content session as a reminder to the user that the shared content session is in progress. As shown in FIG. 6D, John's device 6000A displays a share pill 6020A in a status area of the home screen 6018. The share pill 6020A is selectable with respect to the display control region 6015A.

[0224] In response to detecting the input 6016, Jane's device 6000B displays a message interface 6004B that includes a message 6004B-1 of an ongoing group conversation and a dynamic graphic 6010B displayed in a message display region 6004B-3. The dynamic graphic 6010B is similar to the dynamic graphic 6010A, but the information presented in the dynamic graphic 6010B is specific to Jane's device 6000B, just as the information presented in the dynamic graphic 6010A is specific to John's device 6000A. For example, since Jane's device has not yet participated in the shared content session, the dynamic graphic 6010B includes a participation option 6010B-1 that is selectable to participate in the shared content session. Further, the dynamic graphic 6010B indicates that one person has joined the shared content session.

[0225] In FIG. 6D, Jane's device 6000B detects a scroll input 6022 and, in response, scrolls the message presented in message display area 6004B-3 as shown in FIG. 6E. In FIG. 6E, message display area 6004B-3 is updated to show the message display area 6004B-3 scrolled in response to input 6022, including indicating that dynamic graphic 6010B has scrolled out of view. Since dynamic graphic 6010B has scrolled out of sight, Jane's device 6000B expands header area 6004B-2 to include dynamic content 6024 representing the content of dynamic graphic 6010B, including participation option 6024-1 similar to participation option 6010B-1. In some embodiments, header area 6004B-2 is expanded to include dynamic content 6024 in response to a scroll gesture in the opposite direction from input 6022. In some embodiments, even if the header area is not expanded (as shown, for example, in FIG. 6D), participation option 6024-1 (or an "exit" option as needed) is continuously displayed within header area 6004B-2. Jane's device 6000B detects an input 6026 on participation option 6024-1 and, in response, participates in the shared content session.

[0226] In FIG. 6F, John's device 6000A displays a notification 6028 indicating that Jane has joined the shared content session. In some embodiments, the notification (such as notification 6028) is displayed temporarily and then automatically erased after a predetermined amount of time. In some embodiments, notifications associated with a shared content session (e.g., notifications generated by a system-level application for hosting the shared content session) are displayed for a shorter period of time than standard notifications (e.g., text message notifications and / or email notifications) displayed on device 6000. For example, a shared content session notification can be displayed for 2 seconds, while a standard notification is displayed for 6 seconds. In some embodiments, notifications associated with a shared content session are displayed with an animation effect, such that the notification is displayed to animate from the share pill 6020 or the screen share pill 6021.

[0227] After joining the shared content session, Jane's device 6000B displays a control region 6015B and a message interface 6004B having a dynamic graphic 6010B updated based on Jane's joining the shared content session. For example, the dynamic graphic 6010B indicates that two people are currently active in the shared content session (John and Jane are participating). The control region 6015B is similar to the control region 6015A and is updated in FIG. 6F to indicate that two people have joined the shared content session.

[0228] In FIG. 6G, Ryan is here participating in a shared content session. In response, Jane's device 6000B updates the dynamic graphic 6010B and the control region 6015B to indicate that three people are active in the shared content session. Since the control region 6015B is displayed, Jane's device 6000B suppresses the display of a notification announcing that Ryan has joined the shared content session. In some embodiments, Jane's device 6000B displays a notification that Ryan has joined the shared content session.

[0229] Referring to John's device 6000A in FIG. 6G, since the display of the notification 6028 has not expired, John's device 6000A updates the notification 6028 to indicate that Ryan has also joined. In some embodiments, notifications can be combined where appropriate. For example, instead of displaying separately the notification that Jane has joined and the notification that Ryan has joined, the two notifications are combined (by updating the notification 6028) into a single notification so that John's device 6000A does not display multiple notifications. Multiple notifications can distract John and be unhelpful, and can cause unnecessary work for the device 6000A. In some embodiments, notifications that have become irrelevant (e.g., old) before being displayed are not displayed. For example, if Ken joined after Ryan but before the notification 6028 was updated, instead of displaying the updated notification shown in FIG. 6G, John's device 6000A will have the updated notification 6028 to indicate that Jane and the other two people have joined the shared content session.

[0230] In some embodiments, John's device 6000A displays group status information (e.g., a group card) in response to an input 6030 on the notification 6028. In response to detecting an input 6032 on the shared pill 6020A, John's device 6000A displays the control region 6015A as shown in FIG. 6H.

[0231] In FIG. 6H, John's device 6000A displays a control region 6015A, which is updated after being last displayed (in response to two people participating) to indicate that three people are active in a shared content session. The microphone 6003A is enabled (in some embodiments, by default) as indicated by the microphone option 6015A-6. Thus, when John speaks to the climber group (as indicated by the audio input 6035A), John's device 6000A receives John's voice as an audio input and shares (e.g., transmits) the audio input with other participants in the shared content session. Thus, Jane's device 6000B (as well as other devices participating in the shared content session) generates an audio output 6037B of John's audio (e.g., using the speaker 6007B). The speaker (e.g., speaker 6007B) in Jane's device 6000B is enabled (in some embodiments, by default) as indicated by the speaker option 6015B-5 and outputs the audio of John's voice. In this way, the participants in the shared content session can talk to each other during the shared content session.

[0232] In response to detecting the input 6034 on the message option 6015A-4, John's device 6000A displays a message interface 6004A as shown in FIG. 6I. In FIG. 6I, Jane addresses the climber group as indicated by the audio input 6035B, and the audio is output in the participant device (e.g., using the speaker 6007A) as indicated by the audio output 6037A. John's device 6000A detects the input 6036 on the control region status region 6015A-1 and, in response, displays a group card interface 6038A as shown in FIG. 6J.

[0233] In Figure 6J, Ryan speaks to the group of climbers, as indicated by the audio outputs 6037A and 6037B in the devices 6000 of John and Jane (using, for example, speaker 6007). John's device 6000A displays the group card interface 6038A in response to the input 6036, and in Figure 6K, the group card interface is scrolled to display additional content in response to the scroll input 6039. In some embodiments, John's device 6000A displays the group card interface 6038A in response to an input for a notification (e.g., input 6030 for notification 6028).

[0234] The group card interface 6038A provides information about the current and past shared content sessions of the group and the content related to the climber group output during those sessions, including identification information 6038A-1 such as a logo, name, picture, etc. The group card interface 6038A includes status information 6040A (including a leave option 6040-1 selectable to leave the shared content session), a list of members 6042A of the climber group, and a contact addition option 6044A selectable to add contacts to the climber group. The list of members 6042A includes the names of other group members along with the status information 6046 of each member. For example, in FIG. 6J, Ryan and Jane are shown as active participants in the shared content session. Ken is shown as invited as he has not yet accepted the invitation to participate in the shared content session. The group card interface also includes a reminder option 6048, which is displayed to group members who are not participating in the shared content session and can be selected to generate a reminder (e.g., a ring, alert, and / or notification) on the member's device to remind the member to participate in the shared content session. The group card interface 6038A also includes a copy option 6050A, which is selectable to copy a link that can be sent to contacts to invite them to join the climber group. The group card interface 6038A also includes a content history 6052A showing the content previously output (or in some embodiments, currently being output) in the shared content session with the group. The group card interface 6038A also includes preferred (e.g., favorite) content 6054A output during the shared content session. The group card interface content history 6052A and preferred content 6054A include an indication 6056 of the member who initiated the sharing of the individual content or, in some embodiments, the member who registered the individual content as a favorite.

[0235] In FIG. 6K, Ken is participating in a shared content session. Accordingly, Ken's member list 6042-1 and status 6046-1 are updated to indicate that Ken is active in the shared content session. Further, control region 6015B and dynamic graphic 6010B are updated on Jane's device 6000B to indicate a change in the parameters of the shared content session in response to Ken's joining. In some embodiments, John and Jane's devices 6000 display a notification that Ken has joined the shared content session.

[0236] In FIG. 6L, John's device 6000A displays control region 6015A and message interface 6004A with dynamic graphic 6010A in response to detecting input 6058 in FIG. 6K. Control region 6015A and dynamic graphic 6010A are updated to indicate that Ken has joined the shared content session, similar to the control region and dynamic graphic on Jane's device 6000B.

[0237] FIGS. 6M - 6X show exemplary user interfaces of embodiments in which Jane starts screen sharing with a climber group during a shared content session. In FIG. 6M, Jane's device 6000B displays browser interface 6060 and detects input 6062 on share pill 6020B. In FIG. 6N, Jane's device 6000B displays control region 6015B in response to input 6062, detects input 6064 on share option 6015B-8, and starts screen sharing with the climber group.

[0238] In Figure 6O, Jane's device 6000B has replaced the share option 6015B-8 with a countdown 6066, which counts down the amount of time until Jane's device 6000B shares the content of its screen with the climber group. In some embodiments, in response to detecting an input 6068 on the countdown 6066, Jane's device 6000B cancels the request to start screen sharing and returns to the interface shown in Figure 6N. In some embodiments, in response to detecting an input on the countdown 6066, Jane's device 6000B displays a notification having an option to confirm canceling the screen sharing request. If the input 6068 is not detected, Jane's device 6000B begins to share the content of its screen at the end of the countdown, as shown in Figure 6P.

[0239] At the end of the countdown, Jane's device 6000B begins to share the content of its screen with the members of the climber group and updates the control region 6015B to indicate the screen sharing status of Jane's device 6000B, as shown in Figure 6P. For example, the status region 6015B-1 is updated to indicate that the climber group is viewing Jane's screen, and the share option 6015B-8 changes appearance to indicate that the screen content of Jane's device 6000B is being shared (e.g., output) to the participants of the shared content session (e.g., members of the climber group). In some embodiments, the share option 6015B-8 is shown in bold when content other than the screen sharing content is being output for the members participating in the shared content session (e.g., when media such as a program and / or music is being output as part of the shared content session).

[0240] John's device 6000A displays a screen sharing window 6070 and a notification 6072 indicating that Jane has started sharing the content of the screen of her device. In some embodiments, the notification 6072 is automatically erased after a predetermined amount of time. The screen sharing window 6070 is a real-time representation of the content currently displayed on Jane's device 6000B. Therefore, since Jane's device 6000B is currently displaying a browser interface 6060, the screen sharing window 6070 includes a representation 6060' of the browser interface 6060. The screen sharing window 6070 is displayed on top of the home screen 6018 such that John's device 6000A displays the screen sharing window 6070 with the home screen 6018 in the background. In some embodiments, the screen sharing window 6070 is automatically displayed on the user interface currently displayed on John's device 6000A when the screen sharing starts. For example, if John's device 6000A was displaying a message interface 6004A when Jane's device 6000B started sharing its screen, the screen sharing window 6070 is displayed on the message interface.

[0241] The screen sharing window 6070 is displayed as an optionally overlayed window on another user interface (e.g., John's home screen 6018) and can be moved separately from the user interface on which it is displayed. In some embodiments, such a window is referred to herein as a picture-in-picture window or "PiP". In some embodiments, the PiP can include shared content such as screen sharing content and / or synchronized content. In some embodiments, the PiP can include content independent of a shared content session (such as a video feed from a video conference), although in some embodiments, such a PiP can be displayed in relation to a shared content session.

[0242] Figure 6P shows an input 6074 for a notification 6072 of John's device 6000A. Figure 6P also shows a scroll input 6076 on a browser interface 6060 and a home input 6078 on a home affordance 6077 of Jane's device 6000B. Ryan speaks to a group of climbers, as indicated by audio outputs 6037A and 6037B in John's and Jane's devices 6000.

[0243] As shown in Figure 6Q, in response to detecting the scroll input 6078, Jane's device 6000B scrolls the browser interface 6060, and in response to detecting the home input 6078, Jane's device 6000B erases the control region 6015B. In some embodiments, Jane's device 6000B automatically erases the control region 6015B after a predetermined amount of time. In some embodiments, the control region 6015 is displayed for a longer period than standard notifications (e.g., email notifications and / or text message notifications). For example, the control region 6015 is displayed until intentionally erased by the user. When the device is sharing the content of its screen and the control region is erased (e.g., hidden), the device displays a screen sharing pill 6021B, as shown for Jane's device 6000B in Figure 6Q. In some embodiments, the screen sharing pill 2021B has a different appearance than the sharing pill 6020B but similar functionality. For example, the screen sharing pill 6021B functions as a reminder to the user that a shared content session is in progress, and the different appearance indicates to the user that the user's device is sharing the content of its screen via a shared content session. In some embodiments, the screen sharing pill 6021B can be selected to display the control region 6015B.

[0244] In FIG. 6Q, John's device 6000A displays a control region 6015A in response to an input 6074. To provide an unobstructed view of the control region 6015A and the screen content 6070, John's device 6000A automatically moves the position of the screen sharing window 6070 on the display 6001A. Since the screen sharing window 6070 is a real-time representation of the content of Jane's screen, when Jane scrolls the browser interface (via input 6076), the screen sharing window 6070 is automatically scrolled to match the scroll position of the browser interface 6060 on Jane's device 6000B. This is shown by the scrolled appearance of the representation 6060' within the screen sharing window 6070 of FIG. 6Q.

[0245] In FIG. 6Q, John's device detects an input 6080 on the mike option 6015A-6 to mute the microphone 6003A and detects a drag input 6082 to move the position of the screen sharing window 6070 on the display 6001A. Jane's device 6000B detects a home input 6084 on the home affordance 6077B and, as shown in FIG. 6R, erases the browser interface 6060 and displays the home screen 6088. In some embodiments, a home gesture (such as, for example, similar to the home input 6078 or the home input 6084) causes John's device 6000A to erase the control region 6015A. In some embodiments, a home gesture (optionally detected after the control region has been erased) causes John's device 6000A to erase the screen sharing window 6070 (e.g., hide its display).

[0246] In some embodiments, some notifications are suppressed while the control region 6015 is being displayed. For example, in FIG. 6Q, Jane's device 6000B displays a notification 6086 indicating that Ryan has left the shared content session, but since the control region 6015A is being displayed, a similar notification is not displayed on John's device 6000A.

[0247] In FIG. 6R, John's device 6000A displays a screen sharing window 6070 having a position moved on the display in response to a drug input 6082. The screen sharing window 6070 is also updated to indicate that Jane has navigated to the home screen 6088 by displaying a representation 6088' of Jane's home screen 6088. In some embodiments, a notification from Jane's device 6000B is displayed in the screen sharing window 6070 on John's device 6000A. For example, in FIG. 6R, the screen sharing window 6070 includes a representation 6086' of the notification 6086. In some embodiments, the notification is not shared in the screen sharing window 6070. In some embodiments, the screen sharing window 6070 can be resized in response to various inputs such as, for example, pinch and / or pinch-out gestures. In some embodiments, John's device 6000A stores the moved and / or resized position of the screen sharing window 6070 such that when content (e.g., screen sharing content and / or media content output during a shared content session) is to be shared with John's device 6000A in the future, John's device 6000A displays the shared content at the moved and / or resized position.

[0248] John's device 6000A continues to display the control region 6015A, and John speaks while the microphone (e.g., microphone 6003A) for the shared content session is muted as indicated by the mute glyph 6090. Thus, John's audio is not communicated in the shared content session as indicated by the absence of output audio at Jane's device 6000B. John's device 6000A detects an input 6092 on the screen sharing window 6070.

[0249] In FIG. 6R, Jane's device 6000B continues to display notification 6086 while an input 6094 is detected at the health application icon 6096. In FIG. 6S, Jane's device 6000B launches the health application in response to input 6094 and displays a health interface 6102. Accordingly, John's device 6000A updates the display of the screen sharing window 6070 to show a representation 6102' of the health interface 6102. John's device 6000A also displays Chrome 6100 including an identifier 6100-1 and an extension icon 6100-2. The identifier 6100-1 indicates Jane's name and avatar and indicates that the screen sharing window 6070 represents the content of Jane's device 6000B. The extension icon 6100-2 is selectable (e.g., in response to an input 6104) and expands the screen sharing window 6070 to, for example, an extended display state (e.g., a full-screen display state, or a state that uses all of the screen outside of a portion of the screen designated for system status information and / or system control). In some embodiments, the screen sharing window 6070 is expanded in response to a tap on the screen sharing window 6070 when Chrome 6100 is not displayed, without requiring a subsequent tap on the extension icon 6100-2.

[0250] In FIG. 6S, John's device 6000A erases the control region 6015A and displays a share pill 6020A. John's device 6000A displays the share pill 6020A, and Jane's device 6000B displays a screen sharing pill 6021B, which indicates that John's device is participating in a shared content session without sharing its screen, and that Jane's device 6000B is participating in the shared content session while sharing its screen with the participants of the shared content session.

[0251] John's device 6000A displays notification 6098 in response to detecting that John is speaking while the microphone is muted. Notifications similar to notification 6098 and notification 6086 are suppressed (e.g., queued) on John's device 6000A while the control region 6015A is being displayed. However, since the control region 6015A is no longer being displayed in Figure 6S, John's device 6000A displays previously suppressed and non-expired (e.g., not expired or irrelevant) notifications. Notifications 6098 and 6086 (displayed on Jane's device) are not stale because the conditions that trigger their display remain true and, optionally, the time allotted to display the notifications has not expired. In some embodiments, rather than displaying all non-expired notifications, John's device 6000A displays notifications based on the priority assigned to each notification such that the notification with the highest priority is displayed for a predetermined amount of time first and then erased. Thereafter, the next highest priority notification is displayed and then erased. In Figure 6S, notification 6098 has a higher priority than the notification announcing that a participant has left the shared content session. Thus, when John's device 6000A hides the control region 6015A, it displays notification 6098 but does not display the notification announcing that Ryan has left the shared content session. In some embodiments, the priority of notifications queued can change over time (e.g., a notification can become stale). For example, if the time allotted to display a notification expires before the notification is displayed, the notification is not displayed.

[0252] In some embodiments, notifications are prioritized at different levels based on the type of notification. For example, notifications triggered by user actions belong to the highest level of priority (e.g., level 1). Examples of user actions that trigger level 1 notifications include interactions with elements in the control region 6015 (e.g., audio routing, microphone on / off, camera on / off, local screen sharing on / off). In some embodiments, a notification indicating that the microphone is muted belongs to an intermediate level of priority (e.g., level 2). Notification 6098 is an example of a level 2 notification. In some embodiments, notifications automatically triggered based on activities within a shared content session belong to a lower level of priority (e.g., level 3). Examples of level 2 notifications can include account updates (e.g., announcing that the user has joined a shared content session), notification that content is being played only for the user of the device, notifications for applications that support the shared content session application, play actions, queue actions, remote screen sharing actions, and reminder notifications related to the shared content session (e.g., reminder that members of the shared content session are still playing content after the user has stopped playing private content).

[0253] In some embodiments, some types of notifications swap with each other when they are displayed. For example, the notification that the content is "playing only for me", notifications associated with applications that support the shared content session, play actions, queue actions, remote screen sharing actions, and reminder notifications related to the shared content session swap with each other and, in some embodiments, expire after 3 seconds. In some embodiments, some notifications can be combined and, optionally, do not have an expiration. For example, if five users join a shared content session, a single notification indicating that one user and the other four users have joined can be displayed.

[0254] In some embodiments, notifications related to playback actions, queue actions, and remote sharing actions have a higher priority than reminder notifications related to a shared content session. In some embodiments, notifications for an app that supports a shared content session have a higher priority than notifications related to playback actions, queue actions, and remote sharing actions. In some embodiments, a notification that content is "playing only for me" has a higher priority than notifications for an app that supports a shared content session. In some embodiments, notifications related to account updates have a higher priority than a notification that content is "playing only for me".

[0255] In response to detecting input 6104, John's device 6000A displays the screen sharing window 6070 in an expanded, enlarged, and / or full screen state (or using all of the screen outside of a portion of the screen designated for system status information and / or system control), thereby presenting a full screen view of Jane's screen. The control region 6015A is redisplayed when the screen sharing window 6070 is enlarged, and in the control region status area 6015A-1, it indicates that Jane is sharing her screen with members of the climber group. However, it should be understood that while Jane is sharing the content of her screen, the shared content can be manipulated on the individual devices viewing the content of her screen in the shared content session. For example, while John is viewing Jane's screen sharing content in an expanded or full screen state, other participants in the shared content session can view Jane's screen sharing content in a smaller window or PiP (similar to the screen sharing window 6070 in FIG. 6S) and can have different display locations on each participant's device.

[0256] Since the content of Jane's screen is displayed in full-screen view, a portion of the content from Jane's device 6000B overlaps with a portion of the content displayed on John's device 6000A. For example, the representation 6021B' of the screen sharing pill 6021B is hierarchically displayed under the clock 6106 in the status bar area of John's device 6000A. In some embodiments, other information within the status bar area of John's device (an area including the clock and other relevant information such as battery charge indication and signal strength indicator) overlaps with the corresponding area from Jane's device. In some embodiments, the home affordance 6077B from Jane's device overlaps with the home affordance 6077A on John's device. In some embodiments, the content from Jane's screen is shown blurred and is below the content within John's status area. For example, the representation 6021B' is shown blurred (indicated by hatching) and is under John's clock 6106. In some embodiments, Jane's content is shown displayed on top of John's content, either blurred or unblurred.

[0257] In FIG. 6T, Jane's device 6000B continues to display the health interface 6102 and erases the notification 6086 (e.g., after a predetermined amount of time has elapsed). On John's device 6000A, the control region 6015A is erased to display Chrome 6100 in response to the input 6108, as shown in FIG. 6U. In FIG. 6U, John's device 6000A erases the control region 6015A and displays the shared pill 6020A and Chrome 6100 including the identifier 6100-1 and the minimized icon 6100-3. Selecting the minimized icon 6100-3 can shrink the screen sharing window 6070 from the full screen view in FIG. 6U to the PiP shown in FIG. 6S. In some embodiments, a home gesture (e.g., an upward swipe on the home affordance 6077A) causes the device 6000A to shrink the screen sharing window 6070 from the full screen view to the PiP view. The shared pill 6020A is displayed on the screen sharing content from Jane's device (e.g., the representation 6021B' of the screen sharing pill 6021B) in a manner similar to that described above with respect to the clock 6106. John's device 6000A erases Chrome 6100 in response to the input 6110. In some embodiments, John's device 6000A automatically erases Chrome 6100 after displaying it for a predetermined amount of time.

[0258] In FIG. 6U, Jane's device 6000B detects the input 6112 on the screen sharing pill 6021B and, in response, displays the control region 6015B as shown in FIG. 6V. The control region status region 6015B-1 indicates that a climber is viewing Jane's screen. Jane can select the share option 6015B-8 (which has a bold appearance indicating that screen sharing is active) to stop sharing her screen with the climber group. Jane can s...

Claims

**Claim 1** A method comprising: In a computer system communicating with one or more output generation components and one or more input devices, Detecting, via the one or more input devices, a first set of one or more inputs corresponding to a request to output content; In response to detecting the first set of one or more inputs corresponding to the request to output content, According to a determination that there is an active shared content session between the computer system and an external computer system, the shared content session enabling the computer system to output the individual content while the individual content is being output by the external computer system when the shared content session is active, Outputting, via an output generation component among the one or more output generation components, a first notification including an indication that the content is being output by the external computer system when the content is being output by the computer system; Outputting the content via an output generation component among the one or more output generation components. **Claim 2** In response to detecting the first set of one or more inputs corresponding to the request to output content, According to the determination that there is an active shared content session between the computer system and the external computer system, The method of claim 1, further comprising providing content information to the external computer system that enables the external computer system to output the content. **Claim 3** In response to detecting the first set of one or more inputs corresponding to the request to output content, According to a determination that there is no active shared content session between the computer system and an external computer system, The method of claim 1 or 2, further comprising outputting the content via the output generation component among the one or more output generation components without outputting the first notification. **Claim 4** While outputting the content via the output generation component among the one or more output generation components, Further comprising synchronizing the output of the content via the output generation component among the one or more output generation components with the output of the content in the external computer system according to a determination that an active shared content session exists between the computer system and the external computer system, the method according to any one of claims 1 to 3.

5. Outputting the content via an output generation component among the one or more output generation components includes outputting a user interface of an application of the computer system that outputs the content, and the method Further comprising outputting the content via an output generation component among the one or more output generation components without providing to the external computer system information that enables the external computer system to output the user interface of the application of the computer system that outputs the content while an active shared content session exists between the computer system and the external computer system, the method according to any one of claims 1 to 4.

6. Before detecting the first set of one or more inputs corresponding to a request to output content Further comprising displaying a user interface of a media player application including a selectable playback element via an output generation component among the one or more output generation components, the selectable playback element, when selected, starts the output of the content, and the displaying Including displaying the selectable playback element in a first appearance according to a determination that an active shared content session exists between the computer system and an external computer system; and Displaying the selectable playback element in a second appearance different from the first appearance according to a determination that an active shared content session does not exist between the computer system and the external computer system, the method according to any one of claims 1 to 5.

7. Before detecting the first set of one or more inputs corresponding to a request to output content further comprising displaying a user interface of a media player application including a representation of the content via an output generation component among the one or more output generation components, and the displaying is when the content is output by the computer system, simultaneously displaying an identifier together with the representation of the content according to a determination that the content can be output by the external computer system; when the content is output by the computer system, displaying the representation of the content without outputting the identifier according to a determination that the content cannot be output by the external computer system, the method according to any one of claims 1 to 6. **Claim 8** when the content is output by the computer system, detecting an input for selecting the first notification while outputting the first notification including the indication that the content can be output by the external computer system; in response to detecting the input for selecting the first notification, displaying a shared content session object including information associated with the active shared content session between the computer system and the external computer system, the method according to any one of claims 1 to 7. **Claim 9** the shared content session object is a selectable option for controlling an audio setting of the active shared content session, a selectable option for controlling a video setting of the active shared content session, or a selectable option for controlling a content sharing setting of the active shared content session, the method according to claim 8, including one or more of the above. **Claim 10** displaying the shared content session object includes displaying a sharing indicator, and the displaying is displaying the sharing indicator in a first visual state according to a determination that the computer system is in a first sharing state regarding the active shared content session; The method according to claim 8 or 9, comprising: displaying the sharing indicator in a second visual state different from the first visual state according to a determination that the computer system is in a second sharing state regarding the active shared content session, which is different from the first sharing state regarding the active shared content session.

11. The method according to claim 10, wherein the first sharing state and the second sharing state are each a screen sharing state.

12. After detecting the input for selecting the first notification and displaying the shared content session object accordingly, The method according to any one of claims 8 to 11, further comprising: aborting the display of the shared content session object in response to detecting that the display of the shared content session object satisfies one or more shared content session object display criteria sets.

13. While outputting the content via an output generation component among the one or more output generation components, displaying selectable content control for controlling the output of the content simultaneously with the shared content session object; The method according to any one of claims 8 to 12, further comprising: aborting the display of the shared content session object without aborting the display of the selectable content control.

14. Displaying selectable content control for controlling the output of the content, then aborting the display of the selectable content control; Aborting the display of the shared content session object; After aborting the display of the shared content session object and the selectable content control, detecting an input corresponding to a request to output the selectable content control; In response to detecting the input corresponding to the request to output the selectable content control, Displaying the selectable content control; The method according to any one of claims 8 to 13, further comprising: displaying the shared content session object.

15. In accordance with the determination that an active shared content session exists between the computer system and an external computer system and that the active shared content session includes video content, further comprising displaying an indication that the video content is within the shared content session without displaying one or more selectable video control objects for controlling the video content, the method according to any one of claims 1 to 14.

16. The method according to any one of claims 1 to 15, wherein the first set of one or more inputs corresponding to a request to output content includes selection of a playback object within a media application.

17. detecting an indication that a request to abort the output of the content; in response to detecting the indication that a request to abort the output of the content has occurred, displaying, via an output generation component of the one or more output generation components, a second notification including an indication that the output of the content has been aborted, the method according to any one of claims 1 to 16.

18. detecting an input corresponding to a request to open an application; in response to detecting the input corresponding to the request to open the application, in accordance with the determination that the application cannot share content in the shared content session between the computer system and the external computer system, outputting, via an output generation component of the one or more output generation components, a third notification including an indication that the user interface of the application output by the computer system is output by the external computer system, the method according to any one of claims 1 to 17.

19. while the shared content session between the computer system and the external computer system, wherein the shared content session is initiated via the external computer system, is active The method according to any one of claims 1 to 18, further comprising continuing output of the content by the computer system after the external computer system disconnects from the shared content session.

20. While the shared content session between the computer system and the external computer system is active, while a second content is being output by the external computer system, outputting, via an output generation component among the one or more output generation components, the second content that has been added to the shared content session by the external computer system; after the external computer system disconnects from the shared content session, continuing output of the second content by the computer system according to a determination that the second content includes a first type of content; The method according to any one of claims 1 to 19, further comprising aborting output of the second content by the computer system according to a determination that the second content includes a second type of content.

21. detecting a first event while the computer system is outputting a third content; in response to detecting the first event, continuing output of the third content by the computer system according to a determination that there is an active shared content session between the computer system including the third content and an external computer system; The method according to any one of claims 1 to 20, further comprising aborting output of the third content by the computer system according to a determination that there is no active shared content session between the computer system including the third content and an external computer system.

22. after detecting the first event and aborting output of the third content, detecting an input corresponding to a request to output the third content; in response to detecting the input corresponding to the request to output the third content, Outputting the third content based on the elapsed time since the first event was detected, according to a determination that the shared content session between the computer system and the external computer system has remained active since the first event was detected; Outputting the third content by the computer system, starting from the position of the content corresponding to when the event was detected, according to a determination that the shared content session between the computer system and the external computer system has not remained active since the first event was detected; The method according to claim 21, further comprising: **Claim 23** Detecting a second event while the computer system is outputting fourth content; In response to detecting the second event; Aborting the output of the fourth content according to a determination that the second event is a first type of event; According to a determination that the second event is a second type of event different from the first type of event; Continuing the output of the fourth content according to a determination that there is an active shared content session between the computer system and the external computer system; Aborting the output of the fourth content according to a determination that there is no active shared content session between the computer system and the external computer system; The method according to any one of claims 1 to 22, further comprising: **Claim 24** Displaying a shared content session indicator indicating that the computer system is connected to the shared content session; Detecting, via the one or more input devices, an input corresponding to a selection of the shared content session indicator; In response to detecting the input corresponding to the selection of the shared content session indicator; A second shared content session object including information associated with the shared content session and / or one or more selectable options that, when selected, cause the computer system to perform individual functions associated with the shared content session; simultaneously displaying a notification including an indication of a participant and / or content in the shared content session, the method according to any one of claims 1 to 23, further comprising.

25. receiving an indication of a third event; displaying a notification of the third event in response to receiving the indication of the third event, further comprising, according to a determination that the notification of the third event is associated with the shared content session, the notification of the third event includes a first color, according to a determination that the notification of the third event is not associated with the shared content session, the notification of the third event includes a second color, and the second color is different from the first color, the method according to any one of claims 1 to 24.

26. receiving an indication of a fourth event; displaying a notification of the fourth event in response to receiving the indication of the fourth event, further comprising, according to a determination that the notification of the fourth event is associated with the shared content session and the computer system is in a first display mode, the notification includes a third color, according to a determination that the notification of the fourth event is not associated with the shared content session and the computer system is in the first display mode, the notification of the fourth event includes a fourth color, and the fourth color is different from the third color, the method according to any one of claims 1 to 25.

27. displaying the notification of the fourth event, according to a determination that the notification of the fourth event is not associated with the shared content session and the computer system is in a second display mode different from the first display mode, the notification of the fourth event includes the third color, the method according to claim 26.

28. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 1 to 27, a non-transitory computer-readable storage medium storing the one or more programs.

29. A computer system configured to communicate with one or more output generation components and one or more input devices, one or more processors; a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 1 to 27, a computer system.

30. A computer system configured to communicate with one or more output generation components and one or more input devices, a computer system comprising means for performing the method according to any one of claims 1 to 27.

31. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 1 to 27, a computer program product comprising the one or more programs.

32. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs detect a first set of one or more inputs corresponding to a request to output content via the one or more input devices, in response to detecting the first set of one or more inputs corresponding to the request to output the content, An active shared content session exists between the computer system and an external computer system, and when the shared content session is active, according to a determination that the shared content session enables the computer system to output individual content while the individual content is being output by the external computer system, Output a first notification including an indication that the content is being output by the external computer system when the content is output by the computer system, via an output generation component among the one or more output generation components; A non-transitory computer-readable storage medium including instructions to output the content via an output generation component among the one or more output generation components. **Claim 33** A computer system configured to communicate with one or more output generation components and one or more input devices, One or more processors; A memory storing one or more programs configured to be executed by the one or more processors, A computer system comprising: wherein the one or more programs Detect a first set of one or more inputs corresponding to a request to output content via the one or more input devices; In response to detecting the first set of one or more inputs corresponding to the request to output the content, An active shared content session exists between the computer system and an external computer system, and when the shared content session is active, according to a determination that the shared content session enables the computer system to output individual content while the individual content is being output by the external computer system, Output a first notification including an indication that the content is being output by the external computer system when the content is output by the computer system, via an output generation component among the one or more output generation components; A computer system including instructions to output the content via an output generation component among the one or more output generation components. **Claim 34** A computer system configured to communicate with one or more output generation components and one or more input devices, means for detecting, via the one or more input devices, a first set of one or more inputs corresponding to a request to output content; in response to detecting the first set of one or more inputs corresponding to the request to output the content, in accordance with a determination that there is an active shared content session between the computer system and an external computer system, the shared content session enabling the computer system to output individual content while the individual content is being output by the external computer system when the shared content session is active, outputting, via an output generation component of the one or more output generation components, a first notification including an indication that the content is being output by the external computer system when the content is output by the computer system; means for outputting the content via an output generation component of the one or more output generation components. A computer system.

35. A computer program product including one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices, the one or more programs including: detecting, via the one or more input devices, a first set of one or more inputs corresponding to a request to output content; in response to detecting the first set of one or more inputs corresponding to the request to output the content, in accordance with a determination that there is an active shared content session between the computer system and an external computer system, the shared content session enabling the computer system to output individual content while the individual content is being output by the external computer system when the shared content session is active, Output a first notification including an indication that when the content is output by the external computer system when the content is output by the computer system via an output generation component among the one or more output generation components. A computer program product including instructions to output the content via an output generation component among the one or more output generation components. **Claim 36** A method comprising: In a computer system communicating with one or more output generation components and one or more input devices, While displaying a first user interface via an output generation component among the one or more output generation components while a shared content session between the computer system and an external computer system is active, Receiving an indication that a first content, which is related to a first application on the computer system, is selected for the shared content session in the external computer system, In response to receiving the indication that the first content is selected for the shared content session, outputting a first notification generated by a second application different from the first application associated with the first content via an output generation component among the one or more output generation components, After outputting the first notification and while the shared content session between the computer system and the external computer system is active, outputting the first content using the first application associated with the first content via an output generation component among the one or more output generation components. **Claim 37** The method according to claim 36, wherein the first user interface is a system user interface. **Claim 38** The method according to any one of claims 36 to 37, wherein the first user interface is a user interface of a third application different from the first application associated with the first content. **Claim 39** Outputting the first content using the first application associated with the first content includes displaying the first content on a second user interface, The method according to any one of claims 36 to 38, wherein the first notification generated by the second application includes a representation of the first content displayed on the second user interface.

40. The method according to claim 39, further comprising displaying the third user interface, which is different from the first user interface and at least partially behind the second user interface behind which the second user interface is located, while the first content is being displayed within the second user interface.

41. The method according to claim 39 or 40, further comprising displaying, on the second user interface, a first indication of a participant in the shared content session who selected the first content for the shared content session.

42. The method further includes detecting a first input directed to the second user interface, The method according to claim 41, wherein displaying the first indication of the participant in the shared content session who selected the first content for the shared content session on the second user interface is performed in response to detecting the first input directed to the second user interface.

43. Detecting a second input directed to the second user interface while the first content is being displayed within the second user interface and while the second user interface occupies a first amount of available display area; Starting a process for displaying the first content in an extended display mode, including increasing the size of the first content within the available display area in response to detecting the second input directed to the second user interface. The method according to any one of claims 39 to 42.

44. The process of displaying the first content in an extended display mode, Displaying selectable expansion options without displaying the first content in the expanded display mode; Detecting an input corresponding to the selection of the expansion option; Displaying the first content in the expanded display mode in response to detecting the input corresponding to the selection of the expansion option, the method according to claim 43.

45. The method according to claim 43 or 44, further comprising displaying a second indication of a participant of the shared content session who selected the first content for the shared content session while the first content is being displayed in the expanded display mode.

46. The method according to any one of claims 43 to 45, further comprising displaying a first shared content session indicator indicating that the computer system is connected to the shared content session while the first content is being displayed in the expanded display mode.

47. The method according to any one of claims 43 to 46, further comprising displaying a selectable size reduction option that, when selected, aborts the display of the first content in the expanded display mode while the first content is being displayed in the expanded display mode.

48. The method according to any one of claims 43 to 47, further comprising displaying an indication of a location where the computer system responds to an individual input gesture to display a system user interface.

49. The method according to any one of claims 43 to 48, further comprising displaying one or more graphical user interface objects of the first user interface, the one or more graphical user interface objects of the first user interface including displaying a portion of the first content that overlaps the one or more graphical user interface objects of the first user interface while the first content is being displayed.

50. While the first content is being displayed in the expanded display mode, displaying one or more shared content session indicators including information about the shared content session; According to the determination that the timeout criterion is satisfied, further comprising stopping the display of the one or more shared content session indicators, the method according to any one of claims 43 to 49.

51. While the first content is being displayed in the extended display mode, The method according to any one of claims 43 to 50, further comprising displaying a privacy indicator that is displayed when the computer system is recording media added to the shared content session.

52. While the first content is being displayed in the extended display mode, detecting an input corresponding to a request to display the system user interface of the computer system, In response to detecting the input corresponding to the request to display the system user interface of the computer system, Stopping the display of the first content in the extended display mode, The method according to any one of claims 43 to 51, further comprising displaying the first content on the second user interface in a state that occupies less than full screen.

53. While the first content is being output on the second user interface, detecting an input corresponding to a request to hide the second user interface, In response to detecting the input corresponding to the request to hide the second user interface, further comprising stopping the display of at least a part of the second user interface, the method according to any one of claims 39 to 52.

54. While the first content is being output on the second user interface, detecting an input corresponding to a request to move the second user interface, In response to detecting the input corresponding to the request to move the second user interface, further comprising moving the second user interface, the method according to any one of claims 39 to 53.

55. The first notification includes a third indication of a participant of the shared content session who selected the first content for the shared content session, the method according to any one of claims 36 to 54.

56. Outputting the first content is Navigating to the first application in accordance with a determination that outputting the first content does not include displaying a visual representation of the first content; Displaying a first shared content session object that includes one or more selectable shared content session function options that cause the computer system to perform individual functions associated with the shared content session without navigating to the first application, when a determination that outputting the first content includes displaying the visual representation of the first content, and / or when selected, information associated with the shared content session; the method of claim 55, comprising: **Claim 57** Receiving an indication that the first content has been deleted from the shared content session; Outputting a content removal notice that includes an indication that the first content has been removed from the shared content session, in response to receiving the indication that the first content has been removed from the shared content session; the method according to any one of claims 36 to 56, further comprising: **Claim 58** Detecting an input corresponding to a selection of the content removal notice; Displaying one or more representations of a user's status associated with the shared content session, with respect to the shared content session, in response to detecting the input corresponding to the selection of the content removal notice; the method of claim 57, further comprising: **Claim 59** Receiving an indication that the first content has ended; Displaying a content end notice that includes an indication of a participant in the shared content session that ended the first content, in response to receiving the indication that the first content has ended; the method according to any one of claims 36 to 58, further comprising: **Claim 60** Receiving an indication that the first content has ended; In response to receiving the indication that the first content has ended Displaying a content end notice that includes an indication that the first content has ended; The method according to any one of claims 36 to 59, further comprising aborting the output of the first content.

61. Receiving a request to display an individual portion of a user interface of a messaging application that includes a plurality of messages between users associated with the shared content session; In response to receiving the request to display the individual portion of the user interface of the messaging application, displaying, in a user interface of the messaging application, the user interface of the messaging application, the user interface of the messaging application including the plurality of messages between users associated with the shared content session; The method according to any one of claims 36 to 60, further comprising displaying, in the user interface of the messaging application, a shared content session notification including information associated with the shared content session, according to a determination that the shared content session is available.

62. The method according to any one of claims 36 to 61, wherein displaying the first content includes simultaneously displaying the first content with video representations of one or more other participants in the shared content session according to a determination that a video chat is in progress with one or more participants in the shared content session.

63. Outputting the first notification includes displaying the first notification, and the method The method according to any one of claims 36 to 62, further comprising aborting the display of the first notification according to a determination that a notification rejection criterion is met.

64. Detecting a first input corresponding to a selection of the first notification; In response to detecting the first input corresponding to the selection of the first notification, upon selection, displaying, in the computer system, a second shared content session object including one or more selectable options for causing the computer system to execute an individual function associated with the shared content session. The method according to any one of claims 36 to 63, further comprising.

65. The method according to claim 64, further comprising moving the display of the first content in conjunction with displaying the second shared content session object.

66. The method according to any one of claims 36 to 65, wherein the output of the first content on the computer system is synchronized with the output of the first content on the external computer system.

67. detecting, via the one or more input devices, an input corresponding to a request to change the output of the first content while the first content is being output; outputting the first content according to the request to change the output of the first content in response to detecting the input corresponding to the request to change the output of the first content, the method according to any one of claims 36 to 66.

68. detecting an input corresponding to a request to output the first content; in response to detecting the input corresponding to the request to output the first content, displaying a user interface of a second application that provides an ability to download the first application according to a determination that the first application is not available on the computer system, the method according to any one of claims 36 to 67.

69. The method according to claim 68, further comprising displaying a selectable download option within the user interface of the second application that, when selected, causes the computer system to initiate a download of the first application.

70. The method according to any one of claims 36 to 69, wherein the first notification includes a selectable session move option that, when selected, causes a portion of the content corresponding to the shared content session to be output via an output device that communicates with a second computer system.

71. A real-time communication interface for a real-time communication session among a plurality of users, the real-time communication interface including one or more representations of the set of users of the real-time communication session, the one or more representations occupying a first display location, further comprising displaying the real-time communication interface. Outputting the first content includes displaying the first content at a second display location that does not include the first display location, the method according to any one of claims 36 to 70.

72. Outputting the first notification includes displaying the first notification such that the first notification is overlaid on one or more graphical objects of the first user interface, the method according to any one of claims 36 to 71.

73. Detecting a second input corresponding to a selection of the first notification, In response to detecting the second input corresponding to a selection of the first notification, further including displaying the first content in the foreground with respect to the first user interface, the method according to claim 72.

74. In response to receiving the indication that the first content has been selected for the shared content session, further including visually emphasizing a graphical element corresponding to the first application, the method according to any one of claims 36 to 73.

75. The first content includes one or more window controls of a user interface displayed by the external computer system, and the one or more window controls correspond to display options for the user interface displayed by the external computer system. Outputting the first content using the first application associated with the first content via an output generation component among the one or more output generation components includes displaying an expression of the one or more window controls in an invalid state, the method according to any one of claims 36 to 74.

76. Outputting the first content using the first application associated with the first content via an output generation component among the one or more output generation components is executed according to a determination that the computer system has been granted eligibility for the first content, and the method includes: In response to receiving the indication that the first content has been selected for the shared content session, The method according to any one of claims 36 to 75, further comprising outputting an eligibility requirement notice according to a determination that the computer system is not eligible for the first content.

77. detecting an input corresponding to a selection of the eligibility requirement notice via the one or more input devices; displaying a selectable eligibility acquisition option to initiate a process for acquiring eligibility to access the first content when selected, in response to detecting the input corresponding to the selection of the eligibility requirement notice; The method according to claim 76, further comprising:

78. According to a determination that the first content is selected for the shared content session using a first eligibility, the eligibility acquisition option, when selected, initiates a process for acquiring the first eligibility; According to a determination that the first content is selected for the shared content session using a second eligibility different from the first eligibility, the eligibility acquisition option, when selected, initiates a process for acquiring the second eligibility. The method according to claim 77.

79. detecting a set of one or more inputs that result in the acquisition of the eligibility, including an input corresponding to a selection of the eligibility acquisition option; outputting the first content according to the status of the first content regarding the shared content session in response to detecting the set of one or more inputs that result in the acquisition of the eligibility; The method according to claim 77 or 78, further comprising:

80. in response to receiving the indication that the first content is selected for the shared content session; The method according to any one of claims 36 to 79, further comprising canceling the output of the first content according to a determination that the computer system does not have the eligibility used to select the first content for the shared content session in the external computer system.

81. outputting the first content includes outputting the first content within the fifth user interface while the fifth user interface is in a first display state, and the method includes: Detecting a request to change the display state of the fifth user interface while the fifth user interface is in the first display state; In response to detecting the request to change the display state of the fifth user interface, changing the display state of the fifth user interface to a second display state different from the first display state according to the request to change the display state of the fifth user interface; Receiving an indication that second content different from the first content has been selected in a second external computer system for the shared content session while the fifth user interface is in the second display state; Further comprising outputting the second content in the second display state in response to receiving the indication that the second content has been selected for the shared content session, the method according to any one of claims 36 to 80.

82. Receiving an indication that a first event satisfying a first notification criterion has occurred in the shared content session; After receiving the indication that the first event satisfying the first notification criterion has occurred in the shared content session, receiving an indication that a second event satisfying the first notification criterion has occurred in the shared content session; After receiving the indication that the second event satisfying the first notification criterion has occurred in the shared content session, Outputting a notification of the second event without outputting a notification of the first event according to a determination that a notification suppression criterion including a criterion satisfied when an indication that the second event has occurred before the notification of the first event is received is satisfied; Further comprising outputting the notification of the first event and outputting the notification of the second event according to a determination that the notification suppression criterion is not satisfied, the method according to any one of claims 36 to 81.

83. Receiving an indication that a third event satisfying a second notification criterion has occurred in the shared content session; Receiving an indication that a fourth event satisfying the second notification criterion has occurred in the shared content session; After receiving the indication that the fourth event satisfying the second notification criterion has occurred in the shared content session; Outputting a first notification according to a determination that a notification aggregation criterion is satisfied, the notification aggregation criterion including a criterion that is satisfied when it is determined that the third event and the fourth event are events of the same type; According to a determination that the notification aggregation criterion is not satisfied; Outputting a second notification different from the first notification; Outputting a third notification different from the first notification and the second notification, the method according to any one of claims 36 to 82 further comprising.

84. Aborting the output of the first content via an output generation component among the one or more output generation components; After aborting the output of the first content via an output generation component among the one or more output generation components and while the first content is in the shared content session; Outputting a shared content reminder notification indicating that the first content is within the shared content session according to a determination that a shared content reminder criterion is satisfied, the method according to any one of claims 36 to 83 further comprising.

85. Detecting a third input corresponding to the selection of the first notification; In response to detecting the third input corresponding to the selection of the first notification, displaying a third shared content session object including information associated with the shared content session and / or one or more selectable shared content session function options that cause the computer system to execute an individual function associated with the shared content session when selected; While displaying the third shared content session object; Receiving an indication that a fifth event satisfying a third notification criterion has occurred in the shared content session; In response to receiving the indication that the fifth event has occurred; Outputting a fourth notification including information about the fifth event according to a determination that the fifth event meets an event notification criterion; Canceling the output of the fourth notification including information about the fifth event according to a determination that the fifth event does not meet the action notification criterion; Stopping the display of the third shared content session object; After stopping the display of the third shared content session object, outputting a fifth notification, the fifth notification including information about an event that occurred while the third shared content session object was being displayed, the method according to any one of claims 36 to 84 further comprising.

86. The first notification includes a link associated with an application on the computer system, the link being provided by the external computer system, and the method includes: Receiving an input corresponding to the selection of the link; In response to receiving the input corresponding to the selection of the link, Displaying the first part of the application according to a determination that the link corresponds to a first part of the application; Displaying a second part of the application according to a determination that the link corresponds to a second part of the application different from the first part of the application, the method according to any one of claims 36 to 85 further comprising.

87. Further comprising, while the shared content session includes screen sharing content, displaying a visual indication to participants in the shared content session that the screen sharing content has been added to the shared content session via the one or more output generation components, the method according to any one of claims 36 to 86.

88. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 36 to 87, a non-transitory computer-readable storage medium storing the one or more programs.

89. A computer system configured to communicate with one or more output generation components and one or more input devices, one or more processors, a memory storing one or more programs configured to be executed by the one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 36 to 87, a computer system.

90. A computer system configured to communicate with one or more output generation components and one or more input devices, comprising means for performing the method according to any one of claims 36 to 87, a computer system.

91. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 36 to 87, a computer program product comprising one or more programs.

92. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs displaying a first user interface via an output generation component among the one or more output generation components while a shared content session between the computer system and an external computer system is active, receiving an indication that a first content, which is the first content for the shared content session in the external computer system and is associated with a first application on the computer system, has been selected, in response to receiving the indication that the first content has been selected for the shared content session, outputting a first notification generated by a second application different from the first application associated with the first content via an output generation component among the one or more output generation components A non-transitory computer-readable storage medium including instructions to output the first content using the first application associated with the first content via an output generation component of the one or more output generation components after outputting the first notification and while the shared content session between the computer system and the external computer system is active.

93. A computer system configured to communicate with one or more output generation components and one or more input devices, one or more processors, a memory storing one or more programs configured to be executed by the one or more processors, A computer system comprising: wherein the one or more programs while displaying a first user interface via an output generation component of the one or more output generation components while a shared content session between the computer system and an external computer system is active, receiving an indication that a first content, which is associated with a first application on the computer system, has been selected for the shared content session in the external computer system, in response to receiving the indication that the first content has been selected for the shared content session, outputting a first notification generated by a second application different from the first application associated with the first content via an output generation component of the one or more output generation components, A computer system including instructions to output the first content using the first application associated with the first content via an output generation component of the one or more output generation components after outputting the first notification and while the shared content session between the computer system and the external computer system is active.

94. A computer system configured to communicate with one or more output generation components and one or more input devices, While displaying a first user interface via an output generation component among the one or more output generation components while a shared content session between the computer system and an external computer system is active, Receiving an indication that, for the shared content session in the external computer system, first content that is associated with a first application on the computer system has been selected, In response to receiving the indication that the first content has been selected for the shared content session, means for outputting a first notification generated by a second application different from the first application associated with the first content via an output generation component among the one or more output generation components, After outputting the first notification and while the shared content session between the computer system and the external computer system is active, means for outputting the first content using the first application associated with the first content via an output generation component among the one or more output generation components, A computer system comprising:

95. A computer program product including one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices, wherein the one or more programs are While displaying a first user interface via an output generation component among the one or more output generation components while a shared content session between the computer system and an external computer system is active, Receiving an indication that, for the shared content session in the external computer system, first content that is associated with a first application on the computer system has been selected, In response to receiving the indication that the first content has been selected for the shared content session, via an output generation component among the one or more output generation components, output a first notification generated by a second application different from the first application associated with the first content. A computer program product including instructions to output the first content using the first application associated with the first content via an output generation component among the one or more output generation components after outputting the first notification and while the shared content session between the computer system and the external computer system is active. Claim 96 A method comprising: In a computer system communicating with one or more output generation components and one or more input devices, Receiving, via the one or more input devices, an input corresponding to a request to add first content to a shared content session between the computer system and an external computer system; In response to receiving the input, According to a determination that the first content is of a first type, before adding the first content to the shared content session, output an alert that the first content will be added to the shared content session, the alert including an option to cancel adding the first content to the shared content session before the first content is added to the shared content session; According to a determination that the first content is of a second type different from the first type, adding the first content to the shared content session without outputting the alert that the first content will be added to the shared content session before the first content is added to the shared content session. Claim 97 The method according to claim 96, wherein the first type of content includes personal information and the second type of content does not include personal information. Claim 98 The first type of content includes content shared from the computer system, The second type of content includes synchronized content between the computer system and the external computer system, The method according to claim 96 or 97, wherein the second type of content is not shared from the computer system. **Claim 99** The method according to any one of claims 96 to 98, wherein the first type of content includes a graphical representation of the content displayed on the screen of the computer system, and the second type of content includes media content. **Claim 100** The alert that the first content is about to be added to the shared content session includes a countdown indicator that progresses through a plurality of states to indicate the amount of time until the content is shared in the shared content session, according to any one of claims 96 to 99. **Claim 101** The input corresponding to the request to add the first content to the shared content session between the computer system and the external computer system includes a selection of a sharing start option, and outputting the alert that the first content will be added to the shared content session includes aborting the output of the sharing start option and displaying the countdown indicator, according to claim 100. **Claim 102** Adding the first content to the shared content session without outputting the alert that the first content will be added to the shared content session before the first content is added to the shared content session includes adding the first content to the shared content session without outputting the countdown indicator, according to any one of claims 100 to 101. **Claim 103** The method according to any one of claims 96 to 102, further including displaying selectable navigation options for navigating to the first content. **Claim 104** The method according to any one of claims 96 to 103, further comprising displaying a selectable detachment option for detaching from the shared content session.

105. The method of starting a connection to the shared content session according to any one of claims 96 to 104, further comprising opening an audio channel for adding the audio detected by the one or more input devices to the shared content session between the computer system and the external computer system.

106. The method according to any one of claims 96 to 105, further comprising displaying a selectable sharing option for adding content to the shared content session while the computer system is connected to a real-time communication session.

107. The method according to any one of claims 96 to 106, further comprising displaying a first shared content session indicator indicating that the computer system is sharing the first type of content with the shared content session according to a determination that the computer system is sharing the first type of content with the shared content session.

108. The first shared content session indicator is output at a first location, and the method is The method according to claim 107, further comprising displaying, at the first location, a second shared content session indicator different from the first shared content session indicator indicating that the computer system is connected to the shared content session according to a determination that the computer system is connected to the shared content session and is not sharing the first type of content with the shared content session.

109. The method according to claim 108, wherein the first shared content session indicator has a first appearance and the second shared content session indicator has a second appearance different from the first appearance.

110. The method according to claim 109, wherein the first appearance of the first shared content session indicator includes a first color, and the second appearance of the second shared content session indicator includes a second color different from the first color.

111. detecting an input corresponding to the selection of the first shared content session indicator; displaying a shared content session object including information associated with the shared content session and / or one or more selectable shared content session function options that cause the computer system to perform an individual function associated with the shared content session when selected, in response to detecting the input corresponding to the selection of the first shared content session indicator; The method according to any one of claims 107 to 110, further comprising:

112. displaying a shared content session object including one or more selectable shared content session function options that cause the computer system to perform an individual function associated with the shared content session when selected; detecting an input corresponding to a request to output a user interface provided by an operating system of the computer system while outputting the shared content session object; aborting the output of the shared content session object in response to detecting the input corresponding to the request to output the user interface provided by the operating system of the computer system; The method according to any one of claims 107 to 110, further comprising:

113. displaying a shared content session object including information associated with the shared content session, wherein the information associated with the shared content session includes a content indicator based on content within the shared content session; The method according to any one of claims 96 to 112, further comprising:

114. A shared content session object including information associated with the shared content session, wherein the information associated with the shared content session includes a participant indicator based on a participant who added content to the shared content session, and further including displaying the shared content session object, the method according to any one of claims 96 to 113.

115. A shared content session object including information associated with the shared content session, wherein the information associated with the shared content session includes an application indicator based on an application associated with the content within the shared content session, and further including displaying the shared content session object, the method according to any one of claims 96 to 114.

116. One or more selectable shared content session function options that, when selected, cause the computer system to execute an individual function associated with the shared content session, the one or more shared content session function options including a first shared content session function option, including displaying a shared content session object including the one or more selectable shared content session function options, detecting an input corresponding to a selection of the first shared content session function option, and in response to detecting the input corresponding to the selection of the first shared content session function option, displaying a user status interface including the status of one or more users regarding the shared content session associated with the shared content session, the method according to any one of claims 96 to 115.

117. A user interface of a messaging application, the user interface of the messaging application including displaying a user interface of the messaging application including a plurality of messages between users associated with the shared content session, In accordance with the determination that the shared content session is available, further including displaying a visual indication including information associated with the shared content session on the user interface of the messaging application. The method according to any one of claims 96 to 116.

118. Displaying selectable camera options; Detecting an input corresponding to the selection of the selectable camera options; In response to detecting the input corresponding to the selection of the selectable camera options, when selected, further including displaying, on the computer system, one or more selectable camera setting options for operating the camera according to the selected camera setting options. The method according to any one of claims 96 to 117.

119. Displaying selectable microphone options; Detecting an input corresponding to the selection of the selectable microphone options; In response to detecting the input corresponding to the selection of the selectable microphone options, when selected, further including displaying, on the computer system, one or more selectable microphone setting options for operating the microphone according to the selected microphone setting options. The method according to any one of claims 96 to 118.

120. Displaying a user interface of a communication application that provides a protocol for communicating with an external computer system; While the user interface of the communication application is being displayed, detecting an input corresponding to a request to start a new shared content session, where the input corresponding to the request to start a new shared content session includes a selection of a shared content session option provided by the communication application; In response to detecting the input corresponding to the request to start a new shared content session, further including starting the new shared content session. The method according to any one of claims 96 to 119.

121. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, wherein the one or more programs include instructions for performing the method according to any one of claims 96 to 120, a non-transitory computer-readable storage medium storing the one or more programs.

122. A computer system configured to communicate with one or more output generation components and one or more input devices, one or more processors; a memory storing one or more programs configured to be executed by the one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 96 to 120, a computer system.

123. A computer system configured to communicate with one or more output generation components and one or more input devices, comprising means for performing the method according to any one of claims 96 to 120, a computer system.

124. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, wherein the one or more programs include instructions for performing the method according to any one of claims 96 to 120, a computer program product comprising the one or more programs.

125. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, wherein the one or more programs receive, via the one or more input devices, an input corresponding to a request to add first content to a shared content session between the computer system and an external computer system, in response to receiving the input, According to the determination that the first content is of the first type, before adding the first content to the shared content session, an alert that the first content will be added to the shared content session, the alert including an option to cancel adding the first content to the shared content session before the first content is added to the shared content session, output the alert, According to the determination that the first content is of a second type different from the first type, before adding the first content to the shared content session, without outputting the alert that the first content will be added to the shared content session, add the first content to the shared content session, an instruction including a non-transitory computer-readable storage medium.

126. A computer system configured to communicate with one or more output generation components and one or more input devices, One or more processors, A memory storing one or more programs configured to be executed by the one or more processors, A computer system comprising, the one or more programs being, Receiving, via the one or more input devices, an input corresponding to a request to add first content to a shared content session between the computer system and an external computer system, In response to receiving the input, According to the determination that the first content is of the first type, before adding the first content to the shared content session, an alert that the first content will be added to the shared content session, the alert including an option to cancel adding the first content to the shared content session before the first content is added to the shared content session, output the alert, A computer system comprising an instruction to add the first content to the shared content session without outputting the alert that the first content is to be added to the shared content session, according to a determination that the first content is content of a second type different from the first type, before the first content is added to the shared content session.

127. A computer system configured to communicate with one or more output generation components and one or more input devices, means for receiving, via the one or more input devices, an input corresponding to a request to add first content to a shared content session between the computer system and an external computer system; in response to receiving the input, outputting an alert that the first content is to be added to the shared content session, according to a determination that the first content is content of a first type, before adding the first content to the shared content session, the alert including an option to cancel adding the first content to the shared content session before the first content is added to the shared content session; means for adding the first content to the shared content session without outputting the alert that the first content is to be added to the shared content session, according to a determination that the first content is content of a second type different from the first type, before the first content is added to the shared content session; a computer system.

128. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs comprising: receiving, via the one or more input devices, an input corresponding to a request to add first content to a shared content session between the computer system and an external computer system; in response to receiving the input, According to the determination that the first content is of the first type, before adding the first content to the shared content session, an alert that the first content will be added to the shared content session, the alert including an option to cancel adding the first content to the shared content session before the first content is added to the shared content session, output the alert, According to the determination that the first content is of a second type different from the first type, before the first content is added to the shared content session, without outputting the alert that the first content will be added to the shared content session, add the first content to the shared content session, a computer program product including an instruction.

129. A method, In a computer system communicating with one or more output generation components and one or more input devices, Receiving, via the one or more input devices, an input corresponding to a request to display a first user interface of a first application; In response to receiving the input, When the shared content session between the computer system and an external computer system is active and the first application is the shared content session, and the shared content session enables the computer system to output individual content while the individual content is output by the external computer system, if it is determined that a first set of criteria is met, output, via an output generation component among the one or more output generation components, an indication that the first application can reproduce content that can be added to the shared content session, and output the first user interface for the first application; Outputting the first user interface for the first application without outputting the indication that the first application can play content that can be added to the shared content session according to the determination that the first reference set is not satisfied. A method, including.

130. The indication that the first application can play content that can be added to the shared content session includes a graphical object overlaid on the user interface for the first application. The method according to claim 129.

131. The indication that the first application can play content that can be added to the shared content session includes the appearance of selectable playback options. The selectable playback options, when selected, start the playback of the media associated with the playback option. The method according to claim 129 or 130.

132. The indication that the first application can play content that can be added to the shared content session is included in the user interface for the first application. The method according to any one of claims 129 to 131.

133. Further including displaying a description of the first media that can be played by the first application that can be added to the shared content session simultaneously with the indication that the first application can play content that can be added to the shared content session. The method according to any one of claims 129 to 132.

134. Receiving an indication that a request to change the output of the second media has occurred while the computer system is outputting the second media in the shared content session. Further including outputting a notification of the output change of the request to change the output of the second media in response to detecting that a request to change the output of the second media has occurred. The method according to any one of claims 129 to 133.

135. The method according to claim 134, wherein the request to change the output of the second media is made by a participant in the shared content session who has selected the second media to be output during the shared content session.

136. The method according to claim 134, wherein the request to change the output of the second media is made by a participant in the shared content session other than the participant who has selected the second media to be output during the shared content session.

137. Receiving an indication that media has been added to the queue of media to be added to the shared content session; Outputting a media addition notification indicating that media has been added to the queue of media to be added to the shared content session in response to receiving the indication that media has been added to the queue of media to be added to the shared content session. The method according to any one of claims 129 to 136 further includes this.

138. Receiving an indication that an action has been taken with respect to media within the shared content session; Displaying a media action notification in response to receiving the indication that an action has been taken with respect to media within the shared content session; Detecting an input corresponding to the selection of the media action notification; In response to detecting the input corresponding to the selection of the media action notification, Starting a first action according to a determination that the media action notification is a notification of a first type; Starting a second action different from the first action according to a determination that the media action notification is a notification of a second type different from the first type. The method according to any one of claims 129 to 137 further includes this.

139. The notification of the first type is a notification of a request to change the output of the media in the shared content session; The method according to claim 138, wherein the first action includes outputting the media in the shared content session.

140. The notification of the second type corresponds to a notification of a request to change a queue of media added to the shared content session, The second action includes displaying the queue of media added to the shared content session, the method according to claim 138 or 139.

141. In response to detecting the input corresponding to the selection of the media action notification, According to the determination that the computer system is displaying the media within the shared content session in full screen mode, a shared content session object overlaid on the media within the shared content session, the shared content session object including information associated with the shared content session, and / or one or more selectable shared content session function options that, when selected, cause the computer system to execute an individual function associated with the shared content session, further including displaying the shared content session object, the method according to any one of claims 138 to 140.

142. In response to detecting the input corresponding to the selection of the media action notification, According to the determination that the computer system is not outputting the media of the shared content session in full screen mode, further including moving the display of the media within the shared content session, the method according to any one of claims 138 to 141.

143. Detecting an input corresponding to a request to play first content of the first application that can be added to the shared content session; In response to detecting the input corresponding to the request to play the first content of the first application that can be added to the shared content session, playing the first content in the first application without sharing the screen of the computer system in the shared content session, and adding the first content to the shared content session, further including the method according to any one of claims 129 to 142.

144. Detecting an input corresponding to a request to play second content of the first application In response to detecting the input corresponding to the request to play the second content of the first application In accordance with a determination that the second content of the first application can be added to the shared content session, playing the second content in the first application and adding the second content of the first application to the shared content session In accordance with a determination that the second content of the first application cannot be added to the shared content session, playing the second content in the first application and stopping adding the second content of the first application to the shared content session, the method according to any one of claims 129 to 143

145. Starting a connection to the shared content session, further comprising opening an audio channel for adding audio detected by the one or more input devices to the shared content session between the computer system and the external computer system, the method according to any one of claims 129 to 144

146. Displaying a user interface of a communication application that provides a protocol for communicating with an external computer system While displaying the user interface of the communication application, detecting an input corresponding to a request to start a new shared content session, wherein the input corresponding to the request to start a new shared content session includes a selection of a shared content session option provided by the communication application In response to detecting the input corresponding to the request to start a new shared content session, starting the new shared content session, the method according to any one of claims 129 to 145

147. In response to receiving the input corresponding to the request to display the first user interface of the first application, and in accordance with the determination that the first set of criteria is satisfied, further comprising simultaneously displaying a glyph and a representation of content that can be played by the first application and added to the shared content session, the method according to any one of claims 129 to 146.

148. Detecting an input corresponding to a request to play a third content while the first user interface of the first application is being output; In response to detecting the input corresponding to the request to play the third content; Outputting a notification indicating that the third content is not available for addition to the shared content session, in accordance with the determination that the third content is not available for addition to the shared content session, the method according to any one of claims 129 to 147.

149. Further comprising displaying a recommended content indicator indicating that one or more external computer systems associated with the computer system and the shared content session are qualified for a fourth content, in accordance with the determination that one or more external computer systems associated with the computer system and the shared content session are qualified for the fourth content, the method according to any one of claims 129 to 148.

150. Detecting a request to output a fifth content; In response to detecting the request to output the fifth content; According to the determination that the computer system is connected to an active shared content session, when selected, a first selectable playback option for playing the fifth content on the computer system without adding the fifth content to the shared content session, and when selected, a second selectable playback option for playing the fifth content on the computer system and adding the fifth content to the shared content session, and outputting a set of selectable playback options including the above, the method according to any one of claims 129 to 149 further includes.

151. Detecting a first option selection input corresponding to a selection of one of the first selectable playback option and the second selectable playback option; In response to detecting the first option selection input, playing the fifth content; After playing the fifth content, detecting a request to output a sixth content; In response to detecting the request to output the sixth content, According to the determination that a first set of playback criteria including criteria satisfied when the first option selection input includes a selection of the first selectable playback option is satisfied, playing the sixth content on the computer system without adding the sixth content to the shared content session; According to the determination that a second set of playback criteria including criteria satisfied when the first option selection input includes a selection of the second selectable playback option is satisfied, playing the sixth content on the computer system and adding the sixth content to the shared content session, the method according to claim 150 further includes.

152. The first set of playback criteria includes criteria satisfied when the request to output the sixth content corresponds to the request to output the sixth content in the first application; The second set of playback criteria includes criteria satisfied when the request to output the sixth content corresponds to the request to output the sixth content in the first application, the method according to claim 151.

153. The first playback criterion set includes criteria that are satisfied when the request to output the sixth content occurs in the same shared content session as the request to output the fifth content. The method according to claim 151, wherein the second playback criterion set includes criteria that are satisfied when the request to output the sixth content occurs in the same shared content session as the request to output the fifth content. **Claim 154** The method according to claim 151, wherein the request to output the sixth content corresponds to a request to output the sixth content in a second application different from the first application. **Claim 155** The method according to claim 151, wherein the request to output the sixth content occurs in a shared content session different from the request to output the fifth content. **Claim 156** Detecting a second option selection input corresponding to the selection of an option in the set of selectable playback options; After detecting the second option selection input, detecting a request to output a seventh content; In response to detecting the request to output the seventh content, Outputting the set of selectable playback options according to a determination that the second option selection input corresponds to a selection of an option that does not add the fifth content to the shared content session. The method according to any one of claims 150 to 155 further includes. **Claim 157** Detecting a third option selection input corresponding to the selection of an option in the set of selectable playback options; After detecting the third option selection input, detecting a request to output an eighth content; In response to detecting the request to output the eighth content, Ceasing to output the set of selectable playback options according to a determination that the third option selection input corresponds to an option for adding the fifth content to the shared content session. The method according to any one of claims 150 to 156 further includes. **Claim 158** Outputting an indication that the first application is capable of playing content that can be added to the shared content session includes outputting an indication as to whether the content will be added to the shared content session. The method according to any one of claims 129 to 157.

159. Receiving an indication that a request to move to a different position in the third media has occurred while the computer system is outputting the third media within the shared content session; In response to detecting that a request to move to a different position in the third media has occurred; Displaying a first media change notification according to a determination that the request to move to a different position in the third media has occurred in the computer system; Displaying a second media change notification different from the first media change notification according to a determination that the request to move to a different position in the third media has occurred in an external computer system. The method according to any one of claims 129 to 158, further comprising.

160. Receiving an indication that a request to move to a different position in the fourth media has occurred while the computer system is outputting the fourth media within the shared content session; Temporarily suspending the output of the fourth media in response to detecting that a request to move to a different position in the fourth media has occurred. The method according to any one of claims 129 to 159, further comprising.

161. Detecting an input corresponding to a request to disconnect the computer system from the shared content session while the computer system is connected to the shared content session; In response to detecting the input corresponding to a request to disconnect the computer system from the shared content session, when selected, a first selectable disconnection option for disconnecting the computer system from the shared content session without ending the shared content session, and a second selectable disconnection option for ending the shared content session when selected, and displaying a set of disconnection options including the above, the method according to any one of claims 129 to 160.

162. Detecting an input corresponding to a request to add a tenth content to the shared content session while a ninth content is within the shared content session; In response to detecting the input corresponding to the request to add the tenth content to the shared content session, when selected, a first selectable content addition option for replacing the ninth content within the shared content session with the tenth content, and a second selectable content addition option for canceling the request to add the tenth content to the shared content session when selected, and outputting a set of content addition options including the above, the method according to any one of claims 129 to 161.

163. Detecting an input corresponding to a request to open a fourth application while the computer system is connected to the shared content session; In response to detecting the input corresponding to the request to open the fourth application, outputting a shared content session indicator indicating that the shared content session is active, the method according to any one of claims 129 to 162.

164. The method according to claim 163, wherein the shared content session indicator includes a notification that the content accessible via the fourth application is not available for being added to the shared content session.

165. The method according to any one of claims 163 to 164, wherein the shared content session indicator includes a notification that content accessible via the fourth application is available for addition to the shared content session.

166. The method according to any one of claims 163 to 165, wherein the shared content session indicator includes a notification that content accessible via the fourth application is added to the shared content session if the content is played in the fourth application while the shared content session is active.

167. Receiving a request to output eleventh content in the computer system; In response to receiving the request to output the eleventh content, According to a determination that the computer system is participating in a shared content session and the eleventh content is currently within the shared content session, outputting the eleventh content at a location within the eleventh content where the external computer system is simultaneously outputting the eleventh content; Further comprising starting a process for replacing the eleventh content with twelfth content different from the eleventh content according to a determination that the computer system is participating in a shared content session including the twelfth content different from the eleventh content, the method according to any one of claims 129 to 166.

168. While the content within the shared content session is not being output by the computer system, Detecting an input corresponding to a request to display information and / or control of the shared content session; In response to detecting the input corresponding to the request to display information and / or control of the shared content session, A second shared content session object including information associated with the shared content session and / or one or more selectable options that, when selected, cause the computer system to execute an individual function associated with the shared content session. The method according to any one of claims 129 to 167, further comprising simultaneously displaying a notification including an indication of the content within the shared content session that has not been output by the computer system.

169. One or more programs configured to be executed by one or more processors of a computer system in communication with one or more output generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 129 to 168, a non-transitory computer-readable storage medium storing the one or more programs.

170. A computer system configured to communicate with one or more output generation components and one or more input devices, one or more processors, and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 129 to 168.

171. A computer system configured to communicate with one or more output generation components and one or more input devices, comprising means for performing the method according to any one of claims 129 to 168.

172. One or more programs configured to be executed by one or more processors of a computer system in communication with one or more output generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 129 to 168, a computer program product comprising the one or more programs.

173. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with one or more output generation components and one or more input devices, the one or more programs being to receive, via the one or more input devices, input corresponding to a request to display a first user interface of a first application, in response to receiving the input, A shared content session between the computer system and an external computer system is active, and the first application is the shared content session. When the shared content session is active, the computer system can output the individual content while the individual content is being output by the external computer system. When it is possible to play the content that can be added to the shared content session, according to the determination that a first set of criteria is met, via an output generation component among the one or more output generation components, an indication that the first application can play the content that can be added to the shared content session is output, and the first user interface for the first application is output. A non-transitory computer-readable storage medium including instructions to output the first user interface for the first application without outputting the indication that the first application can play the content that can be added to the shared content session, according to the determination that the first set of criteria is not met. **Claim 174** A computer system configured to communicate with one or more output generation components and one or more input devices, One or more processors, A memory storing one or more programs configured to be executed by the one or more processors, A computer system comprising: The one or more programs are Receiving an input corresponding to a request to display a first user interface of a first application via the one or more input devices, In response to receiving the input, A shared content session between the computer system and an external computer system is active, the first application being the shared content session, the shared content session enabling the computer system to output the individual content while the individual content is being output by the external computer system when active, and being capable of playing content that can be added to the shared content session. When it is determined that a first set of criteria is met, an indication that the first application is capable of playing content that can be added to the shared content session is output via an output generation component among the one or more output generation components, and the first user interface for the first application is output. A computer system including instructions to output the first user interface for the first application without outputting the indication that the first application is capable of playing content that can be added to the shared content session, according to a determination that the first set of criteria is not met. **Claim 175** A computer system configured to communicate with one or more output generation components and one or more input devices, means for receiving, via the one or more input devices, an input corresponding to a request to display a first user interface of a first application in response to receiving the input, A shared content session between the computer system and an external computer system is active, and the first application is the shared content session. When the shared content session is active, the computer system can output the individual content while the individual content is being output by the external computer system. When it is possible to play the content that can be added to the shared content session, according to the determination that a first set of criteria is met, an indication that the first application can play the content that can be added to the shared content session is output via an output generation component among the one or more output generation components, and the first user interface for the first application is output. Means for outputting the first user interface for the first application without outputting the indication that the first application can play the content that can be added to the shared content session, according to the determination that the first set of criteria is not met. A computer system comprising: **Claim 176** A computer program product including one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more output generation components and one or more input devices, the one or more programs comprising: Receiving an input corresponding to a request to display a first user interface of a first application via the one or more input devices. In response to receiving the input, A shared content session between the computer system and an external computer system is active, the first application is the shared content session, and when the shared content session is active, the computer system is enabled to output the individual content while the individual content is being output by the external computer system. When it is possible to play the content that can be added to the shared content session, according to the determination that a first set of criteria is met, via an output generation component among the one or more output generation components, an indication that the first application can play the content that can be added to the shared content session is output, and the first user interface for the first application is output. A computer program product including instructions to output the first user interface for the first application without outputting the indication that the first application can play the content that can be added to the shared content session, according to the determination that the first set of criteria is not met. Claim 177 A method comprising: In a computer system communicating with one or more output generation components and one or more input devices, Receiving first data associated with a request to add first content to a shared content session between an external computer system and the computer system; In response to receiving the first data associated with the request to add the first content to the shared content session, Outputting the first content via an output generation component among the one or more output generation components, according to the determination that a content output criterion is met based on whether the content is available for being output by the computer system in a predetermined manner. In accordance with the determination that the content output criterion is not satisfied, without outputting the first content in the computer system via the output generation component among the one or more output generation components, outputting a notification that the first content has been added to the shared content session. A method comprising this.

178. The method according to claim 177, wherein outputting the first content includes outputting the first content within a window overlaid on a part of a user interface that is simultaneously output by an output generation component among the one or more output generation components.

179. The method according to claim 177 or 178, wherein the content output criterion is based on whether an application capable of outputting the content is available on the computer system.

180. The method according to any one of claims 177 to 179, wherein the content output criterion is based on whether the computer system can access a subscription service that provides access to the first content.

181. The method according to any one of claims 177 to 180, wherein the content output criterion is based on whether an application used to output the first content is configured to output the first content in the predetermined manner.

182. The method according to any one of claims 177 to 181, wherein the content output criterion is based on the type of content sharing.

183. Outputting the first content is when the first content is added to the shared content session according to a first type of content sharing, outputting the first content with a first quality; when the first content is added to the shared content session according to a second type of content sharing, outputting the first content with a second quality different from the first quality. The method according to any one of claims 177 to 182, including this.

184. The method according to any one of claims 177 to 183, further including displaying information regarding the content output criterion.

185. The method according to claim 184, wherein the information regarding the content output criterion, when selected, includes a selectable download option for starting a process to download an application configured to output the first content.

186. The method according to claim 184 or 185, wherein the information regarding the content output criterion, when selected, includes a selectable subscription option for starting a process to obtain a subscription for providing access to the first content.

187. Detecting an input corresponding to a selection of the notification that the first content has been added to the shared content session; Displaying a user interface providing an ability to obtain an application configured to output the first content in response to detecting the input corresponding to the selection of the notification that the first content has been added to the shared content session, the method according to any one of claims 177 to 186.

188. The method according to claim 187, wherein displaying the user interface providing an ability to obtain an application for outputting the first content, when selected, includes displaying a selectable download option for starting a process to download the application configured to output the first content.

189. Detecting a request to rejoin the shared content session while the shared content session is active and after stopping the output of the first content; Outputting the first content in response to detecting the request to rejoin the shared content session, the method according to any one of claims 177 to 188.

190. The method according to claim 189, wherein the request to output the first content includes an output content option included in a shared content session object including information associated with the shared content session, and / or a selection of one or more selectable shared content session function options that, when selected, cause the computer system to execute an individual function associated with the shared content session.

191. The method according to claim 189 or 190, wherein stopping the output of the first content is performed in response to receiving an incoming call.

192. The method according to any one of claims 189 to 191, wherein stopping the output of the first content is performed in response to detecting a request to output content that cannot be added to the shared content session.

193. Detecting a request to play a second content that cannot be added to the shared content session while the first content is being output; Starting a process for playing the second content in response to detecting the request to play the second content; After playing at least a part of the second content, stopping the play of the second content; Further comprising, after stopping the play of the second content, if selected according to a determination that the shared content session is in progress, displaying a selectable output content notification for starting a process for outputting the individual content currently being played in the shared content session.

194. The method according to claim 193, further comprising canceling the display of the selectable output content notification for starting a process for outputting the individual content currently being played in the shared content session if selected according to a determination that the shared content session is no longer in progress after stopping the play of the second content.

195. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 177 to 194, a non-transitory computer-readable storage medium storing the one or more programs.

196. A computer system configured to communicate with one or more output generation components and one or more input devices, One or more processors; A memory storing one or more programs configured to be executed by the one or more processors, and a computer system, wherein the one or more programs include instructions for executing the method according to any one of claims 177 to 194.

197. A computer system configured to communicate with one or more output generation components and one or more input devices, The computer system comprising means for executing the method according to any one of claims 177 to 194.

198. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs including instructions for executing the method according to any one of claims 177 to 194, a computer program product.

199. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs Receiving first data associated with a request to add first content to a shared content session between an external computer system and the computer system, In response to receiving the first data associated with the request to add the first content to the shared content session, Based on a determination that a content output criterion is met as to whether the content is available for output by the computer system in a predetermined manner, outputting the first content via an output generation component among the one or more output generation components, Outputting a notification that the first content has been added to the shared content session without outputting the first content in the computer system via the output generation component among the one or more output generation components according to a determination that the content output criterion is not met, a non-transitory computer-readable storage medium including instructions.

200. A computer system configured to communicate with one or more output generation components and one or more input devices, One or more processors, a memory storing one or more programs configured to be executed by the one or more processors, a computer system comprising: the one or more programs, receive first data associated with a request to add first content to a shared content session between an external computer system and the computer system, in response to receiving the first data associated with the request to add the first content to the shared content session, output the first content via an output generation component of the one or more output generation components according to a determination that a content output criterion is satisfied based on whether the content is available for being output by the computer system in a predetermined manner, output a notification that the first content has been added to the shared content session without outputting the first content in the computer system via the output generation component of the one or more output generation components according to a determination that the content output criterion is not satisfied,

201. a computer system configured to communicate with one or more output generation components and one or more input devices, means for receiving first data associated with a request to add first content to a shared content session between an external computer system and the computer system, in response to receiving the first data associated with the request to add the first content to the shared content session, output the first content via an output generation component of the one or more output generation components according to a determination that a content output criterion is satisfied based on whether the content is available for being output by the computer system in a predetermined manner, Means for outputting a notification that the first content has been added to the shared content session without outputting the first content in the computer system via the output generation component among the one or more output generation components according to a determination that the content output criteria are not satisfied. A computer system comprising:

202. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs comprising: Receiving first data associated with a request to add first content to a shared content session between an external computer system and the computer system; In response to receiving the first data associated with the request to add the first content to the shared content session; Based on a determination that content output criteria are met based on whether the content is available for output by the computer system in a predetermined format, outputting the first content via an output generation component among the one or more output generation components; A computer program product comprising instructions for outputting a notification that the first content has been added to the shared content session without outputting the first content in the computer system via the output generation component among the one or more output generation components according to a determination that the content output criteria are not met.

203. A method comprising: In a computer system communicating with one or more output generation components and one or more input devices; Displaying a messaging interface for an individual message conversation via an output generation component among the one or more output generation components, The message display area of the individual message conversation among two or more participants of the individual message conversation, including a plurality of messages from different participants to other participants in the message conversation; A graphical representation of an ongoing shared content session with one or more participants in the message conversation, wherein the graphical representation of the ongoing shared content session includes first information regarding one or more parameters of the shared content session, including content in the shared content session and participant status in the shared content session, and simultaneously displaying the graphical representation. Displaying the messaging interface for the individual message conversation; After displaying the messaging interface and after one or more parameters of the ongoing shared content session are changed, receiving a request to display a portion of the individual message conversation including the graphical representation of the shared content session; In response to receiving the request to display the portion of the individual message conversation including the graphical representation of the shared content session, an updated graphical representation of the ongoing shared content session, wherein the updated representation of the ongoing shared content session includes second information regarding one or more parameters of the shared content session that is different from the first information, including different content in the shared content session and / or different participant status in the shared content session, and displaying the plurality of messages from different participants to other participants in the message conversation together with the updated graphical representation of the ongoing shared content session. A method including;

204. The method according to claim 203, further comprising displaying a selectable participation option that, when selected, initiates a process for participating in the ongoing shared content session.

205. Displaying the participation option includes displaying the participation option in the message display area of the individual message conversation, and displaying the participation option is performed in response to receiving an indication that a participant in the individual message conversation has initiated the shared content session. The method according to claim 204.

206. The method according to claim 204 or 205, further comprising canceling the display of the participation option in accordance with a determination that the shared content session has been started by the computer system.

207. The method according to any one of claims 204 to 206, further comprising canceling the display of the participation option in accordance with a determination that the ongoing shared content session between the computer system and one or more external computer systems is active.

208. The method according to any one of claims 203 to 207, further comprising displaying one or more selectable communication options that, when selected while the messaging interface for the individual message conversation is being displayed, initiate a process for starting an individual real-time communication session.

209. The method according to any one of claims 203 to 208, further comprising displaying one or more selectable status options that, when selected while the messaging interface for the individual message conversation is being displayed, cause the computer system to display status information of the two or more participants of the individual message conversation.

210. The method according to any one of claims 203 to 209, wherein displaying the graphical representation of the ongoing shared content session includes displaying the graphical representation of the ongoing shared content session in the message display area when the shared content session is started from the messaging interface or when the shared content session is not started from the messaging interface.

211. The method according to any one of claims 203 to 210, wherein the individual message conversation includes a plurality of messages that occurred before the start of the shared content session.

212. The method according to any one of claims 203 to 211, wherein the individual message conversation includes a plurality of messages that occurred after the start of the shared content session.

213. The method according to any one of claims 203 to 212, wherein the graphical representation of the shared content session includes a description of the activities in the shared content session.

214. After displaying the graphical representation of the shared content session including a description of a first activity in the shared content session, detecting a second activity in the shared content session that is different from the first activity; After detecting the second activity in the shared content session, displaying the graphical representation of the shared content session including a description of the second activity in the shared content session that is different from the description of the first activity in the shared content session. The method according to claim 213, further comprising:

215. The method according to any one of claims 203 to 214, wherein the graphical representation of the shared content session includes the number of participants in the shared content session.

216. After displaying the graphical representation of the shared content session including a first number of participants in the shared content session, detecting a change in the number of participants in the shared content session; After detecting the change in the number of participants in the shared content session, displaying the graphical representation of the shared content session including a second number of participants in the shared content session that is different from the first number of participants in the shared content session. The method according to claim 215, further comprising:

217. Receiving an indication of a change in the status of a participant in the shared content session; Updating the participant status in the graphical representation of the ongoing shared content session in response to receiving the indication of the change in the status of the participant in the shared content session. The method according to any one of claims 203 to 216, further comprising:

218. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, wherein the one or more programs include instructions for performing the method according to any one of claims 203 to 217, and storing the one or more programs, a non-transitory computer-readable storage medium.

219. A computer system configured to communicate with one or more output generation components and one or more input devices, One or more processors; A memory storing one or more programs configured to be executed by the one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 203 to 217, a computer system.

220. A computer system configured to communicate with one or more output generation components and one or more input devices, A computer system comprising means for performing the method according to any one of claims 203 to 217.

221. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 203 to 217, a computer program product.

222. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, wherein the one or more programs Via an output generation component among the one or more output generation components, displaying a messaging interface for an individual message conversation, A message display area of the individual message conversation among two or more participants of the individual message conversation, including a plurality of messages from different participants to other participants in the message conversation, A graphical representation of an ongoing shared content session with one or more participants in the message conversation, wherein the graphical representation of the ongoing shared content session includes first information regarding one or more parameters of the shared content session, including content in the shared content session and participant status in the shared content session, and simultaneously displays a graphical representation, and After displaying the messaging interface and after one or more parameters of the ongoing shared content session are changed, receive a request to display a portion of the individual message conversation that includes the graphical representation of the shared content session, In response to receiving the request to display the portion of the individual message conversation that includes the graphical representation of the shared content session, an updated graphical representation of the ongoing shared content session, wherein the updated representation of the ongoing shared content session includes second information regarding the one or more parameters of the shared content session that is different from the first information, including different content in the shared content session and / or different participant status in the shared content session, and display the plurality of messages from different participants to other participants in the message conversation, together with the updated graphical representation of the ongoing shared content session, a non-transitory computer-readable storage medium including instructions.

223. A computer system configured to communicate with one or more output generation components and one or more input devices, One or more processors, A memory storing one or more programs configured to be executed by the one or more processors, A computer system comprising, wherein the one or more programs, Displaying, via an output generation component among the one or more output generation components, a messaging interface for an individual message conversation is, The message display area of the individual message conversation among two or more participants of the individual message conversation, including a plurality of messages from different participants to other participants in the message conversation, and A graphical representation of an ongoing shared content session with one or more participants of the message conversation, wherein the graphical representation of the ongoing shared content session includes first information regarding one or more parameters of the shared content session, including content in the shared content session and participant status in the shared content session, and displaying the graphical representation simultaneously. The messaging interface for the individual message conversation includes After displaying the messaging interface and after one or more parameters of the ongoing shared content session are changed, receiving a request to display a portion of the individual message conversation including the graphical representation of the shared content session In response to receiving the request to display the portion of the individual message conversation including the graphical representation of the shared content session, an updated graphical representation of the ongoing shared content session, wherein the updated representation of the ongoing shared content session includes second information regarding one or more parameters of the shared content session, different from the first information, including different content in the shared content session and / or different participant status in the shared content session, and a computer system including an instruction to display the plurality of messages from different participants to other participants in the message conversation, together with the updated graphical representation of the ongoing shared content session

224. A computer system configured to communicate with one or more output generation components and one or more input devices, Displaying a messaging interface for an individual message conversation via an output generation component among the one or more output generation components is The message display area of the individual message conversation among two or more participants of the individual message conversation, including a plurality of messages from different participants to other participants in the message conversation, and A graphical representation of an ongoing shared content session with one or more participants of the message conversation, wherein the graphical representation of the ongoing shared content session includes first information regarding one or more parameters of the shared content session, including content in the shared content session and participant status in the shared content session, and means for simultaneously displaying the graphical representation, After displaying the messaging interface and after one or more parameters of the ongoing shared content session are changed, means for receiving a request to display a portion of the individual message conversation including the graphical representation of the shared content session, In response to receiving the request to display the portion of the individual message conversation including the graphical representation of the shared content session, an updated graphical representation of the ongoing shared content session, wherein the updated representation of the ongoing shared content session includes second information regarding the one or more parameters of the shared content session, different from the first information, including different content in the shared content session and / or different participant status in the shared content session, and means for displaying the plurality of messages from different participants to other participants in the message conversation, together with the updated graphical representation of the ongoing shared content session, a computer system comprising.

225. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with one or more output generation components and one or more input devices, wherein the one or more programs Displaying, via an output generation component among the one or more output generation components, a messaging interface for an individual message conversation, which The message display area of the individual message conversation among two or more participants of the individual message conversation, including a plurality of messages from different participants to other participants in the message conversation, and A graphical representation of an ongoing shared content session with one or more participants of the message conversation, wherein the graphical representation of the ongoing shared content session includes first information regarding one or more parameters of the shared content session, including content in the shared content session and participant status in the shared content session, and simultaneously displaying, the messaging interface for the individual message conversation, After displaying the messaging interface and after one or more parameters of the ongoing shared content session are changed, receiving a request to display a portion of the individual message conversation including the graphical representation of the shared content session, In response to receiving the request to display the portion of the individual message conversation including the graphical representation of the shared content session, an updated graphical representation of the ongoing shared content session, wherein the updated representation of the ongoing shared content session includes second information regarding one or more parameters of the shared content session, different from the first information, including different content in the shared content session and / or different participant status in the shared content session, and displaying the plurality of messages from different participants to other participants in the message conversation, together with the updated graphical representation of the ongoing shared content session, a computer program product comprising instructions.

226. A method, In a computer system communicating with one or more output generation components and one or more input devices, While a shared content session between the computer system and one or more external computer systems is active, Receiving, via the one or more input devices, a request to display information associated with the shared content session, In response to receiving the request to display information associated with the shared content session, displaying an indication of one or more participants of the shared content session and one or more users who have been invited to the shared content session but have not participated in the shared content session, via an output generation component among the one or more output generation components; displaying a representation of the first content via the output generation component among the one or more output generation components, according to a determination that the shared content session includes the first content; displaying a representation of the second content different from the representation of the first content via the output generation component among the one or more output generation components, according to a determination that the shared content session includes second content different from the first content, the method comprising:

227. The method according to claim 226, wherein the one or more users who have been invited to the shared content session but have not participated in the shared content session are participants in a group messaging conversation that occurred before the shared content session was active.

228. The method according to any one of claims 226 to 227, wherein the one or more users who have been invited to the shared content session but have not participated in the shared content session are participants in a previous shared content session that occurred before the shared content session was active.

229. The method according to any one of claims 226 to 228, further comprising, in response to receiving the request to display information associated with the shared content session, displaying a status of one or more users with respect to the shared content session, including displaying a first status of a first user with respect to the shared content session and a second status of a second user with respect to the shared content session, wherein the second user is different from the first user.

230. In response to receiving the request to display information associated with the shared content session, displaying a first status of content related to a first user and a second status of content related to a second user different from the first user, further including displaying the status of content in the shared content session for one or more users, the method according to any one of claims 226 to 229.

231. In response to receiving the request to display information associated with the shared content session, when selected, further including displaying a selectable group messaging object that causes the computer system to provide a messaging interface for a group message conversation including users associated with the shared content session, the method according to any one of claims 226 to 230.

232. In response to receiving the request to display information associated with the shared content session, when selected, further including displaying a selectable option to leave the shared content session that causes the computer system to leave the shared content session, the method according to any one of claims 226 to 231.

233. In response to receiving the request to display information associated with the shared content session, further including displaying an indication of the identity of a user associated with the shared content session, the method according to any one of claims 226 to 232.

234. The identity of the user associated with the shared content session exists after the shared content session is no longer active, the method according to claim 233.

235. In response to receiving the request to display information associated with the shared content session, when selected, further including displaying a participant addition option that starts a process for inviting a user to the shared content session, the method according to any one of claims 226 to 234.

236. In response to receiving the request to display information associated with the shared content session, when selected, a selectable reminder option is displayed to output a reminder to participate in the shared content session to one or more external computer systems associated with one or more of the one or more users who are invited to the shared content session but have not participated in the shared content session. The method according to any one of claims 226 to 235, further comprising.

237. In response to receiving the request to display information associated with the shared content session, when selected, a selectable copy invitation option is displayed to copy a link to the shared content session. The method according to any one of claims 226 to 236, further comprising.

238. In response to receiving the request to display information associated with the shared content session, one or more representations of content that was previously within the shared content session are further displayed. The method according to any one of claims 226 to 237, further comprising.

239. In response to receiving the request to display information associated with the shared content session, one or more indications of users who added the content previously output within the individual shared content session including the participants within the shared content session are further displayed. The method according to claim 238, further comprising.

240. In response to receiving the request to display information associated with the shared content session, an indication of the status of the content within the shared content session is further displayed. The method according to any one of claims 226 to 239, further comprising.

241. The request to display information associated with the shared content session includes the selection of a selectable option in a status bar on a desktop user interface. The method according to any one of claims 226 to 240, further comprising.

242. In response to receiving the request to display information associated with the shared content session, when selected, selecting parameters of the shared content session that at least partially determine whether the selected content is added to the shared content session, and further including displaying playback options for a selectable group, the method according to any one of claims 226 to 241.

243. In response to receiving the request to display information associated with the shared content session, an indication of the one or more participants in the shared content session and one or more users who have been invited to the shared content session but have not participated in the shared content session is displayed simultaneously with the content in the shared content session, the method according to any one of claims 226 to 242.

244. When selected, further including displaying a selectable display mode option that sets a layout in which the representation of the participants in the video communication session is displayed on the user interface of the video communication application via an output generation component among the one or more output generation components, the method according to any one of claims 226 to 243.

245. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs including instructions for executing the method according to any one of claims 226 to 244, a non-transitory computer-readable storage medium storing the one or more programs.

246. A computer system configured to communicate with one or more output generation components and one or more input devices, One or more processors, A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for executing the method according to any one of claims 226 to 244, a computer system.

247. A computer system configured to communicate with one or more output generation components and one or more input devices, A computer system comprising means for performing the method according to any one of claims 226 to 244.

248. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs comprising instructions for performing the method according to any one of claims 226 to 244, A computer program product comprising one or more programs.

249. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs comprising: While a shared content session between the computer system and one or more external computer systems is active, Receiving, via the one or more input devices, a request to display information associated with the shared content session; In response to receiving the request to display information associated with the shared content session, Displaying, via an output generation component among the one or more output generation components, indications of one or more participants in the shared content session and one or more users who have been invited to the shared content session but have not participated in the shared content session; Displaying, via the output generation component among the one or more output generation components, a representation of the first content according to a determination that the shared content session includes the first content; Displaying, via the output generation component among the one or more output generation components, a representation of the second content different from the representation of the first content according to a determination that the shared content session includes second content different from the first content, A non-transitory computer-readable storage medium comprising instructions.

250. A computer system configured to communicate with one or more output generation components and one or more input devices, One or more processors; A memory storing one or more programs configured to be executed by the one or more processors; A computer system comprising, wherein the one or more programs are while a shared content session between the computer system and one or more external computer systems is active, receiving, via the one or more input devices, a request to display information associated with the shared content session, in response to receiving the request to display information associated with the shared content session, displaying, via an output generation component among the one or more output generation components, indications of one or more participants in the shared content session and one or more users who have been invited to the shared content session but have not participated in the shared content session, displaying, via the output generation component among the one or more output generation components, a representation of the first content in accordance with a determination that the shared content session includes the first content, displaying, via the output generation component among the one or more output generation components, a representation of the second content different from the representation of the first content in accordance with a determination that the shared content session includes second content different from the first content, a computer system comprising instructions.

251. A computer system configured to communicate with one or more output generation components and one or more input devices, while a shared content session between the computer system and one or more external computer systems is active, receiving, via the one or more input devices, a request to display information associated with the shared content session, in response to receiving the request to display information associated with the shared content session, displaying, via an output generation component among the one or more output generation components, indications of one or more participants in the shared content session and one or more users who have been invited to the shared content session but have not participated in the shared content session, displaying, via the output generation component among the one or more output generation components, a representation of the first content in accordance with a determination that the shared content session includes the first content, A computer system comprising means for displaying a representation of the second content different from the representation of the first content via the output generation component among the one or more output generation components, in accordance with a determination that the shared content session includes second content different from the first content.

252. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with one or more output generation components and one or more input devices, the one or more programs being while a shared content session between the computer system and one or more external computer systems is active, receiving, via the one or more input devices, a request to display information associated with the shared content session, in response to receiving the request to display information associated with the shared content session, displaying, via an output generation component among the one or more output generation components, indications of one or more participants in the shared content session and one or more users who have been invited to the shared content session but have not participated in the shared content session, displaying a representation of the first content via the output generation component among the one or more output generation components, in accordance with a determination that the shared content session includes the first content, A computer program product comprising instructions for displaying a representation of the second content different from the representation of the first content via the output generation component among the one or more output generation components, in accordance with a determination that the shared content session includes second content different from the first content.

253. A method, in a computer system in communication with one or more output generation components and one or more input devices, A shared content session between the computer system and one or more external computer systems, wherein when the shared content session is active, the computer system is enabled to output the individual content while the individual content is being output by the one or more external computer systems, while the shared content session is active, and while a plurality of application interface regions including at least a part of a first application interface region and at least a part of a second application interface region are simultaneously displayed within a user interface. Receiving, via the one or more input devices, a set of one or more inputs corresponding to a request to add an application interface to the shared content session. In response to receiving a first input within the set of one or more inputs, displaying a first graphical interface object that is selectable to add the first application interface region to the shared content session without adding the second application interface region to the shared content session at a location within the user interface that is visually associated with the first application interface region, wherein the first graphical interface object is not visually associated with the second application interface region.

254. The method according to claim 253, wherein displaying the first graphical interface object includes displaying at least a part of the first graphical interface object at a location on the first application interface region.

255. Receiving an input via the one or more input devices. In response to receiving the input. Displaying the first application interface region having a visual effect while displaying the second application interface region not having the visual effect according to a determination that the input is directed to the first application interface region. In accordance with the determination that the input is directed to the second application interface area, while displaying the second application interface area having the visual effect, further including displaying the first application interface area not having the visual effect, the method according to claim 253 or 254.

256. Receiving an input corresponding to a selection of the first application interface area or the second application interface area via the one or more input devices; In response to receiving the input corresponding to the selection of the first application interface area or the second application interface area; While the first application interface area has a first appearance corresponding to a first arrangement of the first application interface area and the second application interface area, in accordance with the determination that the input is a selection of the first application interface area, displaying the first application interface area having a second appearance corresponding to a second arrangement of the first application interface area and the second application interface area different from the first arrangement; While the second application interface area has a third appearance corresponding to the second arrangement of the first application interface area and the second application interface area, in accordance with the determination that the input is a selection of the second application interface area, displaying the second application interface area having a fourth appearance corresponding to the first arrangement of the first application interface area and the second application interface area, the method according to any one of claims 253 to 255.

257. In accordance with the determination that the input is a selection of the first application interface area, displaying the first application interface area having the second appearance includes displaying the first application interface area having the second appearance without adding the first application interface area to the shared content session, In accordance with the determination that the input is a selection of the second application interface area, displaying the second application interface area having the fourth appearance includes displaying the second application interface area having the fourth appearance without adding the second application interface area to the shared content session, the method according to claim 256.

258. The method according to claim 256 or 257, wherein displaying the first graphical interface object is performed in accordance with the determination that the first application interface area is in the foreground area of the user interface.

259. In response to receiving the first input within the set of one or more inputs, displaying a third graphical interface object associated with adding the second application interface area to the shared content session at a location within the user interface visually associated with the second application interface area, the third graphical interface object being displayed simultaneously with the first graphical interface object and not visually associated with the first application interface area, the method according to any one of claims 253 to 258.

260. While the shared content session between the computer system and one or more external computer systems is active, Receiving, via the one or more input devices, an input directed to the first graphical interface object, In response to receiving the input directed to the first graphical interface object, adding the first application interface region to the shared content session without adding the second application interface region to the shared content session. The method according to any one of claims 253 to 259, further comprising.

261. In response to receiving a second input within the set of the one or more inputs, before displaying the first graphical interface object, A first sharing option selectable to add the user interface including the plurality of application interface regions to the shared content session, and A second sharing option selectable to initiate a process for adding the first application interface region or the second application interface region to the shared content session. The method according to any one of claims 253 to 260, further comprising simultaneously displaying.

262. In response to receiving a selection of the first sharing option or the second sharing option, further comprising displaying a graphical representation of a countdown until content from the computer system is added to the shared content session. The method according to any one of claims 261.

263. While the shared content session between the computer system and one or more external computer systems is active and the first application interface region is within the shared content session, for executing one or more options for executing individual functions associated with the shared content session. The method according to any one of claims 253 to 262, further comprising displaying the first application interface region including a selectable shared status affordance for displaying.

264. The method according to claim 263, wherein at least a part of the shared status affordance is displayed at a location within the first application interface region including a first set of one or more controls selectable to change the display of the first application interface region when the first application interface region has not been added to the shared content session.

265. receiving a selection of the shared status affordance while displaying the first application interface region including the shared status affordance; displaying one or more options for performing an individual function associated with the shared content session in response to receiving the selection of the shared status affordance, the method according to claim 263 or 264.

266. receiving a set of one or more inputs corresponding to a request to move the display location of the first application interface region while displaying the first application interface region including the shared status affordance, the shared status affordance being displayed at a first location within the first application interface region and the first application interface being displayed at a first location within the user interface; moving at least a part of the first application interface region to a second location within the user interface in response to receiving the set of one or more inputs corresponding to the request to move the display location of the first application interface region, the moving being By moving at least a part of the first application interface area to the second location within the user interface, while at least a part of the first application interface area is being displayed at the second location within the user interface according to the determination that the first location within the first application interface area remains disposed within the user interface, displaying the shared status affordance at the first location within the first application interface area, and While moving at least a part of the first application interface area to the second location within the user interface, according to the determination that moving at least a part of the first application interface area to the second location within the user interface moves the first location within the first application interface area outside the user interface, displaying the shared status affordance at a second location within the first application interface area, the method according to any one of claims 263 to 265. **Claim 267** The method according to any one of claims 253 to 266, further comprising displaying a shared content session object including a representation of the first application interface area while the shared content session between the computer system and one or more external computer systems is active and the first application interface area is added to the shared content session. **Claim 268** The method according to claim 267, wherein the shared content session object is persistently displayed over any of the plurality of application interface areas displayed within the user interface. **Claim 269** The method according to claim 267 or 268, wherein displaying the shared content session object including the representation of the first application interface area includes displaying a representation of a shared status affordance displayed at the first application interface area.

270. Displaying the shared content session object includes displaying a first option selectable to enable a mode in which media content that is compatible with being added to the shared content session while the shared content session is active is automatically added to the shared content session when the media content is selected for output in the computer system. The method according to any one of claims 267 to 269.

271. Displaying the shared content session object includes displaying a second option selectable to enable a mode in which media content selected for output in the computer system while the shared content session is active is not automatically added to the shared content session. The method according to any one of claims 267 to 270.

272. Displaying the shared content session object includes displaying a third option selectable to disable media output in the computer system during the shared content session, the method comprising: detecting a selection of the third option while the shared content session between the computer system and one or more external computer systems is active and the first media content is being output by the one or more external computer systems and also being output in the computer system; and further comprising, in response to detecting the selection of the third option, ending the output of the first media content in the computer system while the shared content session remains active. The method according to any one of claims 267 to 271.

273. The set of one or more inputs corresponding to a request to add an application interface to the shared content session includes a selection of a shared affordance displayed within a video conferencing application interface. The method according to any one of claims 253 to 272.

274. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 253 to 273, a non-transitory computer-readable storage medium storing the one or more programs.

275. A computer system configured to communicate with one or more output generation components and one or more input devices, one or more processors; a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 253 to 273, a computer system.

276. A computer system configured to communicate with one or more output generation components and one or more input devices, comprising means for performing the method according to any one of claims 253 to 273, a computer system.

277. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 253 to 273, a computer program product comprising the one or more programs.

278. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs A shared content session between the computer system and one or more external computer systems, wherein when the shared content session is active, the computer system is enabled to output the individual content while the individual content is being output by the one or more external computer systems, while the shared content session is active, and while a plurality of application interface regions including at least a part of a first application interface region and at least a part of a second application interface region are simultaneously displayed within the user interface. Receiving, via the one or more input devices, a set of one or more inputs corresponding to a request to add an application interface to the shared content session. In response to receiving a first input within the set of one or more inputs, a first graphical interface object selectable to add the first application interface region to the shared content session without adding the second application interface region to the shared content session to a location within the user interface visually associated with the first application interface region, the first graphical interface object including instructions to display the first graphical interface object not visually associated with the second application interface region, a non-transitory computer-readable storage medium. Claim 279 A computer system configured to communicate with one or more output generation components and one or more input devices, One or more processors; A memory storing one or more programs configured to be executed by the one or more processors; A computer system comprising, wherein the one or more programs are A shared content session between the computer system and one or more external computer systems, wherein when the shared content session is active, the computer system is enabled to output the individual content while the individual content is being output by the one or more external computer systems, while the shared content session is active, and while a plurality of application interface regions including at least a portion of a first application interface region and at least a portion of a second application interface region are simultaneously displayed within a user interface. Receiving, via the one or more input devices, a set of one or more inputs corresponding to a request to add an application interface to the shared content session. In response to receiving a first input within the set of one or more inputs, a first graphical interface object selectable to add the first application interface region to the shared content session without adding the second application interface region to the shared content session to a location within the user interface visually associated with the first application interface region, the first graphical interface object including instructions to display the first graphical interface object not visually associated with the second application interface region, a computer system.

280. A computer system configured to communicate with one or more output generation components and one or more input devices. A shared content session between the computer system and one or more external computer systems, wherein when the shared content session is active, the computer system is enabled to output the individual content while the individual content is being output by the one or more external computer systems, while the shared content session is active, and while a plurality of application interface regions including at least a part of a first application interface region and at least a part of a second application interface region are simultaneously displayed within a user interface Receiving, via the one or more input devices, a set of one or more inputs corresponding to a request to add an application interface to the shared content session A first graphical interface object that can be selected to add the first application interface region to the shared content session without adding the second application interface region to the shared content session to a location within the user interface visually associated with the first application interface region in response to receiving a first input within the set of one or more inputs, wherein the first graphical interface object comprises means for displaying the first graphical interface object that is not visually associated with the second application interface region, a computer system Claim 281 A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with one or more output generation components and one or more input devices, wherein the one or more programs A shared content session between the computer system and one or more external computer systems, wherein when the shared content session is active, the computer system is enabled to output the individual content while the individual content is being output by the one or more external computer systems, while the shared content session is active, and while a plurality of application interface regions including at least a portion of a first application interface region and at least a portion of a second application interface region are simultaneously displayed within a user interface Receiving, via the one or more input devices, a set of one or more inputs corresponding to a request to add an application interface to the shared content session In response to receiving a first input within the set of one or more inputs, a first graphical interface object selectable to add the first application interface region to the shared content session without adding the second application interface region to the shared content session to a location within the user interface visually associated with the first application interface region, the first graphical interface object being not visually associated with the second application interface region, the computer program product including instructions to display the first graphical interface object

282. A method, comprising: In a computer system communicating with one or more output generation components and one or more input devices, A shared content session between the computer system and one or more external computer systems, wherein when the shared content session is active, the computer system is enabled to output the individual content while the individual content is being output by the one or more external computer systems, while the shared content session is active Receiving data representing first content selected for the shared content session in the external computer system In response to receiving the data representing the first content selected for the shared content session, displaying a display area including a representation of the first content via an output generation component among the one or more output generation components, the method comprising: displaying the display area in accordance with a determination that a first set of criteria is not met, a first set of one or more controls for controlling a visual appearance of the display area, the first set of one or more controls being visually associated with the representation of the first content, displaying the representation of the first content together with the first set of one or more controls in accordance with a determination that the first set of criteria is met, displaying the representation of the first content without the first set of one or more controls for controlling the visual appearance of the display area. A method comprising

283. The method according to claim 282, wherein the first set of criteria includes criteria that are met when the representation of the first content is not selected

284. The method according to claim 282 or 283, wherein the first set of criteria includes criteria that are met when a size of the representation of the first content is within a predetermined size range

285. The method according to any one of claims 282 to 284, wherein the first set of criteria includes criteria that are met when the representation of the first content is an application window of an operating system that supports display of a plurality of application windows associated with individual applications

286. The method according to any one of claims 282 to 285, wherein the first set of criteria includes criteria that are met when the computer system does not detect an input directed to the representation of the first content

287. receiving data indicating a change in size of the representation of the first content from a first size to a second size while the representation of the first content is being displayed in the first size without the first set of one or more controls for controlling the visual appearance of the display area In response to receiving the data indicating the change in the size of the representation of the first content, and in accordance with the determination that the second size of the representation of the first content meets a second criterion, displaying the first set of one or more controls at a location within the display area visually associated with the representation of the first content, the method according to any one of claims 282 to 286, further comprising.

288. Displaying the representation of the first content includes displaying the representation of the first content without displaying the representation of the second set of one or more controls having an enabled state, the method according to any one of claims 282 to 287.

289. The method according to any one of claims 282 to 288, wherein the first set of one or more controls includes one or more controls that are selectable to adjust the display size of the display area.

290. The method according to any one of claims 282 to 289, wherein the first set of one or more controls includes one or more controls that are selectable to adjust the zoom level of the representation of the first content.

291. The method according to any one of claims 282 to 290, wherein the first set of one or more controls includes a size lock control that, when selected, prevents the display area from changing size in response to input from a user sharing the content within the display area.

292. Displaying the representation of the first content using the first set of one or more controls includes displaying a graphical object adjacent to the display area, the graphical object including the first set of one or more controls for controlling the visual appearance of the display area, the method according to any one of claims 282 to 291.

293. The display area including the representation of the first content occupies an amount of display space, and receiving data indicating a change in the size of the first content in the external computer system while the representation of the first content is of a third size, In response to receiving the data indicating the change in the size of the first content in the external computer system, changing the size of the representation of the first content from the third size to a fourth size different from the third size, and the changing includes adjusting the amount of display space occupied by the display area in accordance with a determination that the automatic sizing function is enabled; ceasing to adjust the amount of displayed space occupied by the display area in accordance with a determination that the automatic sizing function is disabled, the method according to any one of claims 282 to 292.

294. The method according to claim 293, wherein the automatic sizing function is disabled in response to a selection of a size lock affordance.

295. The method according to any one of claims 293 to 294, wherein the automatic sizing function is disabled in response to an input corresponding to a request to change the size of the display area received before receiving the data indicating the change in the size of the first content in the external computer system.

296. The method according to any one of claims 293 to 295, wherein the automatic sizing function is enabled in response to a selection of an unlock affordance.

297. receiving a request to enable the automatic sizing function while the display area including the representation of the first content is displayed with a fifth size and the representation of the first content is displayed with a sixth size; in response to receiving the request to enable the automatic sizing function, changing the size of the display area from the fifth size to a predetermined size based on the sixth size of the representation of the first content, the method according to any one of claims 293 to 296.

298. Changing the size of the representation of the first content from the third size to the fourth size includes displaying the representation of the first content at a location previously occupied by displayed content not included in the display area before changing the size of the representation of the first content from the third size to the fourth size. The method according to any one of claims 293 to 297.

299. Changing the size of the representation of the first content from the third size to the fourth size includes displaying content other than the representation of the first content at a location previously included in the display area before changing the size of the representation of the first content from the third size to the fourth size. The method according to any one of claims 293 to 298.

300. Displaying the representation of the first content includes displaying the representation of the first content without displaying the type of graphical object displayed with the first content in the external computer system. The method according to any one of claims 282 to 299.

301. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs including instructions for executing the method according to any one of claims 282 to 300. A non-transitory computer-readable storage medium storing one or more programs.

302. A computer system configured to communicate with one or more output generation components and one or more input devices, One or more processors, A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for executing the method according to any one of claims 282 to 300. A computer system.

303. A computer system configured to communicate with one or more output generation components and one or more input devices, A computer system comprising means for executing the method according to any one of claims 282 to 300.

304. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs comprising instructions for performing the method according to any one of claims 282 to 300, A computer program product comprising one or more programs.

305. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs comprising: A shared content session between the computer system and one or more external computer systems, the shared content session enabling the computer system to output the individual content while the individual content is being output by the one or more external computer systems when the shared content session is active. While the shared content session is active, Receiving data representing first content selected for the shared content session in the external computer system, In response to receiving the data representing the first content selected for the shared content session, displaying a display area including a representation of the first content via an output generation component of the one or more output generation components, A non-transitory computer-readable storage medium comprising instructions, wherein displaying the display area comprises: A first set of one or more controls for controlling the visual appearance of the display area according to a determination that a first set of criteria is not met, the first set of one or more controls being visually associated with the representation of the first content. Displaying the representation of the first content together with the first set of one or more controls; Displaying the representation of the first content without the first set of one or more controls for controlling the visual appearance of the display area according to a determination that the first set of criteria is met. A non-transitory computer-readable storage medium.

306. A computer system configured to communicate with one or more output generation components and one or more input devices, one or more processors, a memory storing one or more programs configured to be executed by the one or more processors, A computer system comprising: wherein the one or more programs are A shared content session between the computer system and one or more external computer systems, wherein the shared content session, when active, enables the computer system to output the individual content while the individual content is being output by the one or more external computer systems. While the shared content session is active, Receiving data representing first content selected for the shared content session in the external computer system, In response to receiving the data representing the first content selected for the shared content session, displaying a display area including a representation of the first content via an output generation component of the one or more output generation components. A computer system including instructions, wherein displaying the display area A first set of one or more controls for controlling the visual appearance of the display area according to a determination that a first set of criteria is not met, wherein the first set of one or more controls is visually associated with the representation of the first content, and displaying the representation of the first content together with the first set of one or more controls; Displaying the representation of the first content without the first set of one or more controls for controlling the visual appearance of the display area according to a determination that the first set of criteria is met. A computer system comprising:

307. A computer system configured to communicate with one or more output generation components and one or more input devices, A shared content session between the computer system and one or more external computer systems, wherein when the shared content session is active, the computer system is enabled to output the individual content while the individual content is being output by the one or more external computer systems. While the shared content session is active, Receiving data representing first content selected for the shared content session in the external computer system, In response to receiving the data representing the first content selected for the shared content session, displaying a display area including a representation of the first content via an output generation component among the one or more output generation components. Displaying the display area A first set of one or more controls for controlling the visual appearance of the display area according to a determination that a first set of criteria is not met, wherein the first set of one or more controls is visually associated with the representation of the first content, and displaying the representation of the first content together with the first set of one or more controls; Displaying the representation of the first content without the first set of one or more controls for controlling the visual appearance of the display area according to a determination that the first set of criteria is met. A computer system comprising:

308. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, wherein the one or more programs A shared content session between the computer system and one or more external computer systems, wherein when the shared content session is active, the computer system is enabled to output the individual content while the individual content is being output by the one or more external computer systems. While the shared content session is active, Receiving data representing first content selected for the shared content session in the external computer system, In response to receiving the data representing the first content selected for the shared content session, a command to display a display area including a representation of the first content via an output generation component among the one or more output generation components, A computer program product, wherein displaying the display area comprises: According to a determination that a first set of criteria is not met, a first set of one or more controls for controlling the visual appearance of the display area, wherein the first set of one or more controls is visually associated with the representation of the first content, Displaying the representation of the first content together with the first set of one or more controls; According to a determination that the first set of criteria is met, displaying the representation of the first content without the first set of one or more controls for controlling the visual appearance of the display area, A computer program product.

309. A method, In a computer system communicating with one or more output generation components and one or more input devices, Displaying a first user interface via the one or more output generation components includes, within the first user interface, A view of the content of the shared content session that is displayed over the background user interface; A first representation of a participant in a real-time communication session, wherein the first representation of the participant in the real-time communication session is displayed at a first individual location relative to the view of the content of the shared content session, Simultaneously displaying the first representation, including displaying the first user interface; Receiving a request to move the view of the content within the first user interface while the first user interface is being displayed. In response to receiving the request to move the view of the content, move the view of the content according to the request, and move the first representation of the participant so that the first representation of the participant is displayed at the first individual location with respect to the view of the content in the shared content session. After moving the view of the content and the first representation of the participant, detect a request to stop displaying the view of the content in the shared content session on the background user interface. In response to detecting the request to stop displaying the view of the content in the shared content session on the background user interface, display the view of the content that is not displayed on the background user interface without displaying the representation of the participant at the first individual location with respect to the view of the content in the shared content session via the one or more output generation components. A method comprising:

310. In response to detecting the request to stop displaying the view of the content in the shared content session on the background user interface, further comprising, via the one or more output generation components, displaying the second representation of the participant at a second individual location and / or a first size with respect to the view of the content in the shared content session. The second individual location with respect to the view of the content in the shared content session is different from the first individual location with respect to the view of the content in the shared content session. The method according to claim 309, wherein the first size is different from the size of the first representation of the participant displayed at the first individual location with respect to the view of the content in the shared content session.

311. The method according to any one of claims 309 to 310, wherein the background user interface is a system user interface.

312. The method according to claim 309 or 310, wherein the background user interface is an application user interface. **Claim 313** In the first user interface, while simultaneously displaying the view of the content of the shared content session overlaid on the background user interface and the first representation of the participant at the first individual location with respect to the view of the content of the shared content session, detecting a request to change the background user interface from a first background user interface to a second background user interface different from the first background user interface; In response to detecting the request to change the background user interface from the first background user interface to the second background user interface, the view of the content of the shared content session overlaid on the second background user interface, and simultaneously displaying the first representation of the participant, which is displayed at the first individual location with respect to the view of the content of the shared content session. The method according to any one of claims 309 to 312, further comprising: **Claim 314** While displaying the view of the content of the shared content session overlaid on the background user interface, detecting a request to perform an operation in the background user interface; In response to detecting the request to perform an operation in the background user interface, performing the operation in the background user interface while maintaining the display of the view of the content of the shared content session overlaid on the background user interface. The method according to any one of claims 309 to 313, further comprising: **Claim 315** The request to stop displaying the view of the content of the shared content session on the background user interface includes a request to display a first user interface of a video communication application, the method according to any one of claims 309 to 314.

316. While displaying the first user interface of the video communication application, further including displaying a plurality of representations of participants in the real-time communication session within the first user interface of the video communication application, the method according to claim 315.

317. The request to stop displaying the view of the content of the shared content session via the background user interface includes a request to display the content in an extended display mode, the method according to any one of claims 309 to 316.

318. In response to detecting the request to display the content in an extended display mode, displaying the content on a second user interface in the extended display mode; and while simultaneously displaying the content within the second user interface in the extended display mode, further including displaying a third representation of the participants in the real-time communication session overlaid on the second user interface, the method according to claim 317.

319. Receiving a request to move the third representation of the participants in the real-time communication session while the third representation of the participants is being displayed at a first location on the second user interface; and In response to receiving the request to move the third representation of the participants, displaying the third representation of the participants at a second location on the second user interface, where the second location is different from the first location, the method according to claim 318.

320. Receiving an indication of a change in the activity level of a second participant in the real-time communication session while the third representation of the participants in the real-time communication session is being displayed on the second user interface; In response to receiving the indication of the change in the activity level of the second participant in the real-time communication session, further displaying the representation of the second participant in the real-time communication session, the method according to claim 318 or 319.

321. While displaying, within the first user interface, the view of the content of the shared content session overlaid on the background user interface and the first representation of the participant in the real-time communication session at the first individual location with respect to the view of the content of the shared content session, Receiving an indication of a change in the activity level of a third participant in the real-time communication session; In response to receiving the indication of the change in the activity level of the third participant in the real-time communication session, displaying a representation of the third participant in the real-time communication session at the first individual location with respect to the view of the content of the shared content session overlaid on the background user interface, the method according to any one of claims 309 to 320.

322. In the first user interface, while displaying the view of the content of the shared content session overlaid on the background user interface and the first representation of the participant in the real-time communication session at the first individual location with respect to the view of the content of the shared content session, receiving a first indication that the participant in the real-time communication session is not providing video to the real-time communication session; In response to receiving the first indication that the participant in the real-time communication session is not providing video to the real-time communication session, further stopping the display of the first representation of the participant in the real-time communication session, the method according to any one of claims 309 to 321.

323. While displaying the view of the content of the shared content session overlaid on the background user interface in the first user interface, receiving an indication that the content has been removed from the shared content session; In response to receiving the indication that the content has been deleted from the shared content session; Aborting the display of the view of the content; The method according to any one of claims 309 to 322, further comprising: in the first user interface, displaying a fourth representation of a participant in the real-time communication session that is displayed overlaid on the background user interface.

324. Receiving, in the first user interface, a request to move the fourth representation of the participant in the real-time communication session; In response to receiving the request to move the fourth representation of the participant in the real-time communication session, moving the fourth representation of the participant in the real-time communication session according to the request to move the fourth representation of the participant in the real-time communication session, the method according to claim 323, further comprising.

325. Receiving, within the first user interface, a second indication that a participant in the real-time communication session is not providing video to the real-time communication session while the fourth representation of the participant in the real-time communication session is being displayed; In response to receiving the second indication that a participant in the real-time communication session is not providing video to the real-time communication session, aborting the display of the fourth representation of the participant in the real-time communication session, the method according to claim 323 or 324, further comprising.

326. After aborting the display of the fourth representation of the participant in the real-time communication session; Receiving an indication that a participant in the real-time communication session is providing video to the real-time communication session; In response to receiving the indication that a participant in the real-time communication session is providing video to the real-time communication session, further comprising displaying a fifth representation of the participant in the real-time communication session, the method according to claim 325.

327. The method according to claim 326, wherein the fifth representation of the participant in the real-time communication session includes a representation of the participant that displays the indication that the participant in the real-time communication session is providing video to the real-time communication session.

328. Detecting, via the one or more input devices, an input corresponding to a selection of the first representation of the participant in the real-time communication session; In response to detecting the input corresponding to the selection of the first representation of the participant in the real-time communication session, further comprising displaying a second user interface of a video communication application for the real-time communication session, the method according to any one of claims 309 to 327.

329. While displaying, in the first user interface, the view of the content of the shared content session overlaid on the background user interface and the first representation of the participant in the real-time communication session at the first individual location with respect to the view of the content of the shared content session, detecting an input via the one or more input devices; In response to detecting the input; Performing an operation associated with the view of the content according to a determination that the input is directed to the view of the content; In response to a determination that the input is directed to the first representation of the participant, further comprising displaying a third user interface of a video communication application for the real-time communication session, the method according to any one of claims 309 to 328.

330. Receiving, while the first user interface is being displayed, a first request to change the size of the view of the content within the first user interface; In response to receiving the first request to change the size of the view of the content, changing the size of the view of the content according to the request to change the size of the view of the content, changing the size of the first representation of the participant, and further comprising the method according to any one of claims 309 to 329.

331. While displaying the first user interface, receiving a second request to change the size of the view of the content within the first user interface; In response to receiving the second request to change the size of the view of the content, without changing the size of the first representation of the participant, changing the size of the view of the content according to the request to change the size of the view of the content, and further comprising the method according to any one of claims 309 to 329.

332. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, wherein the one or more programs include instructions for executing the method according to any one of claims 309 to 331, a non-transitory computer-readable storage medium storing the one or more programs.

333. A computer system configured to communicate with one or more output generation components and one or more input devices, one or more processors; a memory storing one or more programs configured to be executed by the one or more processors, wherein the one or more programs include instructions for executing the method according to any one of claims 309 to 331, a computer system.

334. A computer system configured to communicate with one or more output generation components and one or more input devices, comprising means for executing the method according to any one of claims 309 to 331, a computer system.

335. One or more programs configured to be executed by one or more processors of a computer system in communication with one or more output generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 309 to 331, a computer program product. [

336. ] A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with one or more output generation components and one or more input devices, the one or more programs comprising: Displaying, via the one or more output generation components, a first user interface that includes, within the first user interface, A view of the content of a shared content session that is displayed overlaid on a background user interface, and A first representation of a participant in a real-time communication session, the first representation of the participant in the real-time communication session being displayed at a first individual location relative to the view of the content of the shared content session, simultaneously displaying the first representation, including displaying the first user interface. While displaying the first user interface, receiving a request to move the view of the content within the first user interface. In response to receiving the request to move the view of the content, moving the view of the content according to the request and moving the first representation of the participant so that the first representation of the participant is displayed at the first individual location relative to the view of the content of the shared content session. After moving the view of the content and the first representation of the participant, detecting a request to stop displaying the view of the content of the shared content session on the background user interface. In response to detecting the request to stop displaying the view of the content of the shared content session on the background user interface, via the one or more output generation components, without displaying the representation of the participant at the first individual location for the view of the content of the shared content session, a non-transitory computer-readable storage medium including an instruction to display a view of the content that is not displayed on the background user interface.

337. A computer system configured to communicate with one or more output generation components and one or more input devices, One or more processors, A memory storing one or more programs configured to be executed by the one or more processors, A computer system comprising: the one or more programs, Displaying a first user interface via the one or more output generation components includes, within the first user interface, A view of the content of a shared content session that is displayed overlaid on a background user interface, and A first representation of a participant in a real-time communication session, wherein the first representation of the participant in the real-time communication session is displayed at a first individual location with respect to the view of the content of the shared content session, simultaneously displaying the first representation, While displaying the first user interface, receiving a request to move the view of the content within the first user interface, In response to receiving the request to move the view of the content, moving the view of the content according to the request, and moving the first representation of the participant so that the first representation of the participant is displayed at the first individual location with respect to the view of the content of the shared content session, After moving the view of the content and the first representation of the participant, detecting a request to stop displaying the view of the content of the shared content session on the background user interface, In response to detecting the request to stop displaying the view of the content of the shared content session on the background user interface, via the one or more output generation components, without displaying the representation of the participant at the first individual location for the view of the content of the shared content session, a computer system including an instruction to display a view of the content that is not displayed on the background user interface.

338. A computer system configured to communicate with one or more output generation components and one or more input devices, Displaying a first user interface via the one or more output generation components includes, within the first user interface, A view of the content of a shared content session that is displayed overlaid on the background user interface, and A first representation of a participant in a real-time communication session, wherein the first representation of the participant in the real-time communication session is displayed at a first individual location with respect to the view of the content of the shared content session, means for simultaneously displaying the first representation, Means for receiving a request to move the view of the content within the first user interface while the first user interface is being displayed, In response to receiving the request to move the view of the content, moving the view of the content according to the request and moving the first representation of the participant so that the first representation of the participant is displayed at the first individual location with respect to the view of the content of the shared content session, Means for detecting a request to stop displaying the view of the content of the shared content session on the background user interface after moving the view of the content and the first representation of the participant. In response to detecting the request to stop displaying the view of the content of the shared content session on the background user interface, via the one or more output generation components, without displaying the representation of the participant at the first individual location with respect to the view of the content of the shared content session, means for displaying a view of the content that is not displayed on the background user interface. A computer system comprising.

339. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with one or more output generation components and one or more input devices, wherein the one or more programs are Displaying a first user interface via the one or more output generation components includes within the first user interface A view of the content of the shared content session that is displayed overlaid on the background user interface, and A first representation of a participant in the real-time communication session, wherein the first representation of the participant in the real-time communication session is displayed at a first individual location with respect to the view of the content of the shared content session. Simultaneously displaying a first representation, including displaying the first user interface, While displaying the first user interface, receiving a request to move the view of the content within the first user interface, In response to receiving the request to move the view of the content, moving the view of the content according to the request and moving the first representation of the participant so that the first representation of the participant is displayed at the first individual location with respect to the view of the content of the shared content session. After moving the view of the content and the first representation of the participant, detecting a request to stop displaying the view of the content of the shared content session on the background user interface. In response to detecting the request to stop displaying the view of the content of the shared content session on the background user interface, via the one or more output generation components, without displaying the representation of the participant at the first individual location for the view of the content of the shared content session, display a view of the content that is not displayed on the background user interface, including instructions, a computer program product.

340. A method comprising: In a computer system communicating with one or more output generation components and one or more input devices, Displaying a user interface of a video communication application via the one or more output generation components includes, within the user interface of the video communication application, Dynamic visual content and One or more representations of participants in a video communication session, wherein the one or more representations of the participants in the video communication session are displayed in a first arrangement, simultaneously displaying the representation, and Detecting a change in the size and / or position of the dynamic visual content that changes the amount of the user interface of the video communication application covered by the dynamic video content; In response to detecting the change in the size and / or position of the dynamic visual content, via the one or more output generation components, within the user interface of the video communication application, the one or more representations of the participants in the video communication session are arranged in a second arrangement, wherein the second arrangement is different from the first arrangement and is based on the change in the size and / or position of the dynamic visual content. Displaying in a second arrangement, including methods.

341. The method according to claim 340, wherein the change in the size and / or position of the dynamic visual content is performed in response to detecting an input via the one or more input devices.

342. The method according to claim 340 or 341, wherein the change in the size and / or position of the dynamic visual content occurs in response to receiving an indication that an event has occurred.

343. The method according to any one of claims 340 to 342, wherein the change in the size and / or position of the dynamic visual content includes a change in the size of the dynamic visual content.

344. The method according to any one of claims 340 to 343, wherein the change in the size and / or position of the dynamic visual content includes a change in the position of the dynamic visual content.

345. The method according to any one of claims 340 to 342, wherein the change in the size and / or position of the dynamic visual content includes suspending the display of at least a part of the dynamic visual content.

346. The method according to any one of claims 340 to 345, wherein displaying the one or more representations of the participants in the video communication session in the second arrangement on the user interface of the video communication application includes changing the position of the one or more representations of the participants in the video communication session in the user interface of the video communication application.

347. The method according to any one of claims 340 to 346, wherein displaying the one or more representations of the participants in the video communication session in the second arrangement on the user interface of the video communication application includes changing the size of the one or more representations of the participants in the video communication session in the user interface of the video communication application.

348. The method according to any one of claims 340 to 347, wherein displaying the one or more representations of the participants in the video communication session in the second arrangement on the user interface of the video communication application includes changing the aspect ratio of the one or more representations of the participants in the video communication session in the user interface of the video communication application.

349. The method according to any one of claims 340 to 348, wherein displaying the one or more representations of the participants in the video communication session in the second arrangement on the user interface of the video communication application includes suspending displaying the one or more representations of the participants in the video communication session on the user interface of the video communication application.

350. Ceasing to display one or more representations of the participants in the video communication session in the user interface of the video communication application comprises: ceasing to display a first number of the one or more representations of the participants in the video communication session in the user interface of the video communication application according to a determination that the one or more representations of the participants in the video communication session are being displayed according to a first layout; and ceasing to display a second number of the one or more representations of the participants in the video communication session in the user interface of the video communication application according to a determination that the one or more representations of the participants in the video communication session are being displayed according to a second layout different from the first layout, the second number being different from the first number, the method according to claim 349.

351. detecting a change in size and / or position of the dynamic visual content that changes an amount of the user interface of the video communication application covered by the dynamic video content while the one or more representations of the participants in the video communication session are being displayed in a third layout; and displaying the one or more representations of the participants in the video communication session in the second arrangement in the user interface of the video communication application comprises displaying the one or more representations of the participants in the video communication session in a fourth layout different from the first layout, the method according to any one of claims 340 to 350.

352. displaying the one or more representations of the participants in the video communication session in the second arrangement in the user interface of the video communication application comprises changing an aspect ratio of a first representation of a field of view of a camera associated with the computer system, the method according to any one of claims 340 to 351.

353. receiving a request to change the position of the dynamic visual content; and in response to receiving the request to change the position of the dynamic visual content, displaying the dynamic visual content in the first position in response to a determination that the request to change the position of the dynamic visual content corresponds to a request to change the position of the dynamic visual content to a first position; The method of any one of claims 340 to 352, further comprising: displaying the dynamic visual content in a third position different from the second position in accordance with a determination that the request to change the position of the dynamic visual content corresponds to a request to change the position of the dynamic visual content to a second position different from the first position.

354. The user interface of the video communication application includes: a first region including a first set of representations of participants in the video communication session; a second region including a second set of representations of participants in the video communication session; the representations of the first set of representations are displayed at a larger size than the representations of the second set of representations; 354. The method of claim 353, wherein the second position corresponds to the second area of the user interface of the video communications application.

355. the user interface of the video communication application includes a second representation of a field of view of a camera associated with the computer system; 354. The method of claim 353, wherein the second position corresponds to the second representation of the field of view of the camera associated with the computer system.

356. ceasing to display the user interface of the video communication application; and 356. The method of any one of claims 340 to 355, further comprising: displaying the dynamic visual content after ceasing to display the user interface of the video communication application.

357. 357. The method of any one of claims 340 to 356, wherein the dynamic visual content includes content included in a first shared content session, the first shared content session including one or more of the participants of the video communication session.

358. While displaying the dynamic visual content and the one or more representations of the participants in the video communication session within the user interface of the video communication application, further comprising displaying a shared content session object that includes information associated with a second shared content session and / or one or more selectable options that, when selected, cause the computer system to perform individual functions associated with the second shared content session or the video communication session, wherein displaying the shared content session object includes displaying, via the one or more output generation components, the one or more representations of the participants in the video communication session in a third arrangement in the user interface of the video communication application, the third arrangement being different from the first arrangement and the second arrangement, the method according to any one of claims 340 to 357.

359. The method according to claim 358, wherein the shared content session object is displayed simultaneously with a notification that includes information related to the dynamic visual content.

360. The method according to any one of claims 358 to 359, wherein the shared content session object includes one or more selectable options that, when selected, cause the computer system to perform individual functions associated with the shared content session or the video communication session.

361. After displaying the one or more representations of the participants in the video communication session in the second arrangement in the user interface of the video communication application, while the one or more representations of the participants in the video communication session are being displayed in a fourth arrangement, detecting a second change in the size and / or position of the dynamic visual content that varies the amount of the user interface of the video communication application covered by the dynamic video content, In response to detecting the second change in the size and / or position of the dynamic visual content, via the one or more output generation components, a fifth arrangement within the user interface of the video communication application, wherein the fifth arrangement is different from the fourth arrangement and is based on the second change in the size and / or position of the dynamic visual content, and displaying the one or more representations of the participants in the video communication session in the fifth arrangement. The method according to any one of claims 340 to 360 further includes this.

362. Detecting a change in the video communication session; In response to detecting the change in the video communication session, via the one or more output generation components, displaying the dynamic visual content according to the change in the video communication session. The method according to any one of claims 340 to 361 further includes this.

363. While the computer system is connected to an active shared content session including the dynamic visual content, According to a determination that the dynamic visual content is not visible, displaying a third representation of the field of view of the camera associated with the computer system having a first aspect ratio within the user interface of the video communication application; According to a determination that the dynamic visual content is visible, in the user interface of the video communication application, displaying the third representation of the field of view of the camera associated with the computer system at a second aspect ratio different from the first aspect ratio. The method according to any one of claims 340 to 362 further includes this.

364. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 340 to 363, a non-transitory computer-readable storage medium storing the one or more programs.

365. A computer system configured to communicate with one or more output generation components and one or more input devices, One or more processors; A computer system comprising a memory storing one or more programs configured to be executed by the one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 340 to 363.

366. A computer system configured to communicate with one or more output generation components and one or more input devices, The computer system comprising means for performing the method according to any one of claims 340 to 363.

367. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 340 to 363, A computer program product comprising one or more programs.

368. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more output generation components and one or more input devices, the one or more programs comprising: Displaying, via the one or more output generation components, a user interface of a video communication application within the user interface of the video communication application, Dynamic visual content, and One or more representations of participants in a video communication session, the one or more representations of the participants in the video communication session being displayed in a first arrangement, simultaneously displaying the representation, displaying the user interface of the video communication application, Detecting a change in the size and / or position of the dynamic visual content that changes the amount of the user interface of the video communication application covered by the dynamic video content. In response to detecting the change in the size and / or position of the dynamic visual content, via the one or more output generation components, within the user interface of the video communication application, display the one or more representations of the participants in the video communication session in a second arrangement, wherein the second arrangement is different from the first arrangement and is based on the change in the size and / or position of the dynamic visual content, in a non-transitory computer-readable storage medium containing an instruction.

369. A computer system configured to communicate with one or more output generation components and one or more input devices, One or more processors; A memory storing one or more programs configured to be executed by the one or more processors, A computer system comprising: wherein the one or more programs Displaying the user interface of the video communication application via the one or more output generation components includes simultaneously displaying within the user interface of the video communication application Dynamic visual content; One or more representations of the participants in the video communication session, wherein the one or more representations of the participants in the video communication session are displayed in a first arrangement, Detect a change in the size and / or position of the dynamic visual content that changes the amount of the user interface of the video communication application covered by the dynamic video content, In response to detecting the change in the size and / or position of the dynamic visual content, via the one or more output generation components, within the user interface of the video communication application, display the one or more representations of the participants in the video communication session in a second arrangement, wherein the second arrangement is different from the first arrangement and is based on the change in the size and / or position of the dynamic visual content, in a computer system containing an instruction.

370. A computer system configured to communicate with one or more output generation components and one or more input devices, Displaying the user interface of a video communication application via the one or more output generation components includes, within the user interface of the video communication application, dynamic visual content and, one or more representations of participants in a video communication session, the one or more representations of the participants in the video communication session being displayed in a first arrangement, simultaneously displaying a representation, means for detecting a change in size and / or position of the dynamic visual content that changes an amount of the user interface of the video communication application covered by the dynamic video content, in response to detecting the change in size and / or position of the dynamic visual content, via the one or more output generation components, within the user interface of the video communication application, the one or more representations of the participants in the video communication session in a second arrangement, the second arrangement being different from the first arrangement and based on the change in size and / or position of the dynamic visual content, means for displaying in a second arrangement, a computer system comprising.

371. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with one or more output generation components and one or more input devices, the one or more programs being Displaying the user interface of a video communication application via the one or more output generation components includes, within the user interface of the video communication application, dynamic visual content and, one or more representations of participants in a video communication session, the one or more representations of the participants in the video communication session being displayed in a first arrangement, displaying the user interface of the video communication application, including simultaneously displaying a representation, detecting a change in size and / or position of the dynamic visual content that changes an amount of the user interface of the video communication application covered by the dynamic video content, In response to detecting the change in the size and / or position of the dynamic visual content, via the one or more output generation components, within the user interface of the video communication application, the one or more representations of the participants in the video communication session are displayed in a second arrangement, wherein the second arrangement is different from the first arrangement and is based on the change in the size and / or position of the dynamic visual content. A computer program product including an instruction to display in the second arrangement.

372. A method, In a computer system communicating with one or more display generation components and one or more input devices, While displaying a representation of first content via the one or more display generation components, receiving, via the one or more input devices, one or more inputs corresponding to a request to display options associated with the first content; In response to receiving the one or more inputs corresponding to a request to display options associated with the first content, via the one or more display generation components, an individual user interface associated with the first content, A first graphical user interface object selectable to initiate a process for performing a first action associated with the first content, the first action including sharing the first content in a live communication session; A second graphical user interface object selectable to initiate a process for performing a second action associated with the first content, the second action being different from the first action, and displaying the individual user interface including the second graphical user interface object; While displaying the individual user interface, receiving a selection input directed to the individual user interface; In response to receiving the selection input directed to the individual user interface, According to a determination that the selection input corresponds to a selection of the first graphical user interface object, starting the process for sharing the first content in the live communication session without starting the process for performing the second action. In accordance with the determination that the selection input corresponds to the selection of the second graphical user interface object, starting the process for performing the second operation without starting the process for sharing the first content in the live communication session. A method including this.

373. The method according to claim 372, wherein the second operation includes sharing the first content in a manner other than a live communication session.

374. Starting the process for sharing the first content in a live communication session is The method according to claim 372 or 373, including sharing the first content in the active live communication session in accordance with the determination that the live communication session is active.

375. Starting the process for sharing the first content in a live communication session is In accordance with the determination that the live communication session is not active, starting a live communication session with one or more external computer systems, wherein the live communication session is started and the option is displayed without starting the playback of the first content. The method according to any one of claims 372 to 374, including displaying an option that can be selected to start the playback of the first content.

376. The method according to claim 375, including displaying the option that can be selected to start the playback of the first content, and displaying the option in the user interface of an application configured to operate on the computer system.

377. The method according to claim 376, wherein displaying the option that can be selected to start the playback of the first content includes displaying a prompt for starting the playback of the first content in the live communication session in the user interface of the application configured to operate on the computer system.

378. Displaying the option selectable to start playing the first content includes displaying the option simultaneously with one or more control options of the live communication session, the method according to any one of claims 375 to 377.

379. While displaying the option selectable to start playing the first content, receiving a request to display second content different from the first content; In response to receiving the request to display second content different from the first content, further including displaying a representation of the second content simultaneously with the option selectable to start playing the first content, the method according to any one of claims 375 to 378.

380. While displaying the representation of the second content simultaneously with the option selectable to start playing the first content, receiving a first input; In response to receiving the first input, According to a determination that the first input is directed to the option selectable to start playing the first content, sharing the first content in the live communication session; According to a determination that the first input is directed to the representation of the second content, sharing the second content in the live communication session, the method according to claim 379.

381. After the one or more external computer systems participate in the live communication session with the computer system, a second option selectable to start playing the first content is displayed in the one or more external computer systems, the method according to any one of claims 375 to 380.

382. Starting the process for sharing the first content in the live communication session is According to a determination that the live communication session is not active, including displaying an invitation user interface including one or more options for selecting participants to participate in the live communication session, the method according to any one of claims 372 to 381.

383. The invitation user interface includes audio options and video options, and the method comprises: detecting a selection input directed to the invitation user interface while displaying the invitation user interface; in response to detecting the selection input directed to the invitation user interface; starting a live communication session including a live audio feed without a live video feed according to a determination that the selection input corresponds to a selection of the audio option; starting a live communication session including a live audio feed and a live video feed according to a determination that the selection input corresponds to a selection of the video option, the method according to claim 382, further comprising: **Claim 384** starting the process for sharing the first content in the live communication session; displaying a prompt for selecting one or more participants for the live communication session according to a determination that the first graphical user interface object does not include an indication of one or more participants for the live communication session; starting the live communication session with the one or more indicated participants without displaying the prompt for selecting one or more participants for the live communication session according to a determination that the first graphical user interface object includes an indication of one or more participants, the method according to any one of claims 372 to 383, comprising: **Claim 385** receiving one or more inputs corresponding to a request to display options associated with the third content while displaying a representation of third content different from the first content; displaying a respective user interface associated with the third content in response to receiving the one or more inputs corresponding to the request to display options associated with the third content, and displaying the respective user interface associated with the third content comprises: In accordance with a determination that the third content is configured to be shared in a live communication session, display the individual user interface associated with the third content, the individual user interface including a third graphical user interface object that is selectable to initiate a process for sharing the third content in the live communication session. In accordance with a determination that the third content is not configured to be shared in a live communication session, display the individual user interface associated with the third content without the third graphical user interface object that is selectable to initiate a process for sharing the third content in the live communication session, the method according to any one of claims 372 to 384. **Claim 386** Displaying the individual user interface associated with the first content comprises In accordance with a determination that the first content is associated with a first application, displaying the individual user interface having a first appearance; and In accordance with a determination that the first content is associated with a second application different from the first application, displaying the individual user interface having the first appearance, the method according to any one of claims 372 to 385. **Claim 387** The individual user interface associated with the first content is a system user interface, the method according to any one of claims 372 to 386. **Claim 388** The individual user interface associated with the first content is an application menu, the method according to any one of claims 372 to 387. **Claim 389** Displaying the individual user interface includes displaying a representation of the first content, the method according to any one of claims 372 to 388. **Claim 390** Output of the first content in the computer system is synchronized with output of the first content in one or more external computer systems participating in the live communication session, the method according to any one of claims 372 to 389.

391. The method according to claim 390, wherein the first content includes video content synchronized in the computer system participating in the live communication session and the one or more external computer systems.

392. The method according to claim 390, wherein the first content includes audio content synchronized in the computer system participating in the live communication session and the one or more external computer systems.

393. The method according to any one of claims 372 to 392, wherein the first content is screen sharing content.

394. The individual user interface associated with the first content includes the user interface of an application operating on the computer system, The method according to any one of claims 372 to 393, wherein the first graphical user interface object is displayed within the user interface of the application and is selectable to initiate a live communication session for sharing content from the application.

395. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 372 to 394, a non-transitory computer-readable storage medium storing the one or more programs.

396. A computer system configured to communicate with one or more display generation components and one or more input devices, One or more processors; A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 372 to 394, a computer system.

397. A computer system configured to communicate with one or more display generation components and one or more input devices, A computer system comprising means for performing the method according to any one of claims 372 to 394.

398. One or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 372 to 394, a computer program product comprising the one or more programs.

399. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components and one or more input devices, the one or more programs comprising: While displaying a representation of first content via the one or more display generation components, receiving, via the one or more input devices, one or more inputs corresponding to a request to display options associated with the first content; In response to receiving the one or more inputs corresponding to a request to display options associated with the first content, via the one or more display generation components, an individual user interface associated with the first content, the individual user interface comprising: A first graphical user interface object selectable to initiate a process for performing a first action associated with the first content, the first action including sharing the first content in a live communication session; A second graphical user interface object selectable to initiate a process for performing a second action associated with the first content, the second action being different from the first action, and displaying the individual user interface including the second graphical user interface object; While displaying the individual user interface, receiving a selection input directed to the individual user interface; In response to receiving the selection input directed to the individual user interface; According to a determination that the selection input corresponds to a selection of the first graphical user interface object, starting the process for sharing the first content in a live communication session without starting the process for performing the second action. A non - transitory computer - readable storage medium including instructions that, in accordance with a determination that the selection input corresponds to a selection of the second graphical user interface object, start a process for executing the second operation without starting a process for sharing the first content in a live communication session.

400. A computer system configured to communicate with one or more display - generating components and one or more input devices, including one or more processors, a memory storing one or more programs configured to be executed by the one or more processors, wherein the one or more programs, while displaying a representation of first content via the one or more display - generating components, receive, via the one or more input devices, one or more inputs corresponding to a request to display options associated with the first content, in response to receiving the one or more inputs corresponding to a request to display options associated with the first content, display, via the one or more display - generating components, a personalized user interface associated with the first content, the personalized user interface including a first graphical user interface object associated with a first operation associated with the first content, the first operation including sharing the first content in a live communication session, and the first graphical user interface object being selectable to start a process for executing the first operation, a second graphical user interface object associated with a second operation associated with the first content, the second operation being different from the first operation, and the second graphical user interface object being selectable to start a process for executing the second operation, while displaying the personalized user interface, receive a selection input directed to the personalized user interface, in response to receiving the selection input directed to the personalized user interface, In accordance with the determination that the selection input corresponds to the selection of the first graphical user interface object, start the process for sharing the first content in the live communication session without starting the process for executing the second operation. A computer system including instructions to start the process for executing the second operation without starting the process for sharing the first content in the live communication session in accordance with the determination that the selection input corresponds to the selection of the second graphical user interface object.

401. A computer system configured to communicate with one or more display generation components and one or more input devices, Means for receiving, via the one or more input devices, one or more inputs corresponding to a request to display options associated with the first content while the representation of the first content is being displayed via the one or more display generation components; In response to receiving the one or more inputs corresponding to a request to display options associated with the first content, via the one or more display generation components, an individual user interface associated with the first content, the individual user interface comprising: A first graphical user interface object selectable to start a process for executing a first operation associated with the first content, the first operation including sharing the first content in a live communication session; A second graphical user interface object selectable to start a process for executing a second operation associated with the first content, the second operation being different from the first operation; means for displaying an individual user interface including the second graphical user interface object; Means for receiving a selection input directed to the individual user interface while the individual user interface is being displayed; In response to receiving the selection input directed to the individual user interface, Means for starting the process for sharing the first content in a live communication session without starting the process for executing the second operation, in accordance with the determination that the selection input corresponds to the selection of the first graphical user interface object. Means for starting the process for executing the second operation without starting the process for sharing the first content in a live communication session, in accordance with the determination that the selection input corresponds to the selection of the second graphical user interface object. A computer system comprising: **Claim 402** A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components and one or more input devices, wherein the one or more programs While displaying a representation of first content via the one or more display generation components, receive one or more inputs via the one or more input devices in response to a request to display options associated with the first content. In response to receiving the one or more inputs in response to a request to display options associated with the first content, via the one or more display generation components, a separate user interface associated with the first content, the separate user interface A first graphical user interface object selectable to start a process for performing a first operation associated with the first content, the first operation including sharing the first content in a live communication session. A second graphical user interface object selectable to start a process for performing a second operation associated with the first content, the second operation being different from the first operation. Display a separate user interface including: While displaying the separate user interface, receive a selection input directed to the separate user interface. In response to receiving the selection input directed to the separate user interface. Without starting the process for executing the second operation, start the process for sharing the first content in a live communication session according to the determination that the selection input corresponds to the selection of the first graphical user interface object. A computer program product including instructions to start the process for executing the second operation without starting the process for sharing the first content in a live communication session according to the determination that the selection input corresponds to the selection of the second graphical user interface object.

Citation Information

Patent Citations

  • Shared Content Session User Interface

    JP2024519801A