User interface for managing visual content in media representations

Abstract

The present disclosure provides a user interface for managing visual content in a media representation. The present disclosure generally relates to managing media representations. In some embodiments, systems, methods, and user interfaces are provided for managing a context of a media representation, copying a subject of the media representation, converting one or more portions of the media representation, providing a description of one or more symbols in the media representation, and providing one or more animations of one or more detection objects and / or subjects.

Description

[0001] This application is a divisional application of the Chinese invention patent application with the application date of February 28, 2023, the national application number 202380026474.0, and the invention name “User Interface for Managing Visual Content in Media Representations”.

[0002] CROSS-REFERENCE TO RELATED APPLICATIONS

[0003] This application claims priority to U.S. Patent Application No. 18 / 167,625, filed on February 10, 2023, entitled “USER INTERFACES FOR MANAGING VISUAL CONTENT IN A MEDIA REPRESENTATION” and U.S. Provisional Patent Application No. 63 / 349,086, filed on June 4, 2022, entitled “USER INTERFACES FOR MANAGING VISUAL CONTENT IN A MEDIA REPRESENTATION” and U.S. Provisional Patent Application Serial No. 63 / 318,678, filed on March 10, 2022, entitled “USER INTERFACES FOR MANAGING VISUAL CONTENT IN A MEDIA REPRESENTATION”. The contents of each of these patent applications are incorporated herein by reference in their entirety. Technical Field

[0004] The present disclosure relates generally to computer user interfaces and, more particularly, to techniques for managing visual content in media presentations. Background Art

[0005] Smartphones and other personal electronic devices allow users to capture and view content in media. Users can capture various types of media, including video and image data. Users can store the captured media on the smart phone or other personal electronic device. Summary of the invention

[0006] However, some techniques for managing visual content in media presentations using electronic devices are often cumbersome and inefficient. For example, some prior art techniques use complex and time-consuming user interfaces that may include multiple keystrokes or keystrokes. Prior art techniques require more time than necessary, which results in wasted user time and device energy. This latter consideration is particularly important in battery-powered devices.

[0007] Therefore, the present technology provides electronic devices with faster and more efficient methods and interfaces for managing visual content in media representations. Such methods and interfaces optionally supplement or replace other methods for managing visual content in media representations. Such methods and interfaces reduce the cognitive burden of users and produce more efficient human-computer interfaces. For battery-powered computing devices, such methods and interfaces save power and increase the time interval between battery charges.

[0008] According to some embodiments, a method performed at a computer system in communication with a display generation component is described. The method includes: detecting a request to display a user interface corresponding to a media item; and in response to detecting the request to display a user interface corresponding to the media item, displaying a user interface corresponding to the media item via the display generation component, the display including: based on determining that a subject has been automatically detected in the media item, displaying a first user interface object via the display generation component, the first user interface object, when selected, causing the computer system to change the display of a portion of the media item in the representation of the media item but not the display of the subject in the representation of the media item; and based on determining that a subject has not been automatically detected in the media item, abandoning the display of the first user interface object.

[0009] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs including instructions for performing the following operations: detecting a request to display a user interface corresponding to a media item; and in response to detecting the request to display a user interface corresponding to the media item, displaying a user interface corresponding to the media item via the display generation component, the display including: based on determining that a subject has been automatically detected in the media item, displaying a first user interface object via the display generation component, the first user interface object, when selected, causing the computer system to change the display of a portion of the media item in the representation of the media item but not the display of the subject in the representation of the media item; and based on determining that a subject has not been automatically detected in the media item, abandoning the display of the first user interface object.

[0010] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs including instructions for performing the following operations: detecting a request to display a user interface corresponding to a media item; and in response to detecting the request to display a user interface corresponding to the media item, displaying a user interface corresponding to the media item via the display generation component, the display including: based on determining that a subject has been automatically detected in the media item, displaying a first user interface object via the display generation component, the first user interface object, when selected, causing the computer system to change the display of a portion of the media item in the representation of the media item but not the display of the subject in the representation of the media item; and based on determining that a subject has not been automatically detected in the media item, abandoning the display of the first user interface object.

[0011] According to some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component, the computer system comprising: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the following operations: detecting a request to display a user interface corresponding to a media item; and in response to detecting the request to display a user interface corresponding to the media item, displaying a user interface corresponding to the media item via the display generation component, the display comprising: based on determining that a subject has been automatically detected in the media item, displaying a first user interface object via the display generation component, the first user interface object, when selected, causing the computer system to change the display of a portion of the media item in the representation of the media item but not the display of the subject in the representation of the media item; and based on determining that a subject has not been automatically detected in the media item, abandoning the display of the first user interface object.

[0012] According to some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component. The computer system includes: a component for detecting a request to display a user interface corresponding to a media item; and a component for displaying a user interface corresponding to a media item via the display generation component in response to detecting a request to display a user interface corresponding to a media item, the display including: based on determining that a subject has been automatically detected in the media item, displaying a first user interface object via the display generation component, the first user interface object, when selected, causing the computer system to change the display of a portion of the media item in the representation of the media item but not changing the display of the subject in the representation of the media item; and based on determining that a subject has not been automatically detected in the media item, abandoning the display of the first user interface object.

[0013] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs including instructions for performing the following operations: detecting a request to display a user interface corresponding to a media item; and in response to detecting the request to display a user interface corresponding to the media item, displaying a user interface corresponding to the media item via the display generation component, the display including: based on determining that a subject has been automatically detected in the media item, displaying a first user interface object via the display generation component, the first user interface object, when selected, causing the computer system to change the display of a portion of the media item in the representation of the media item but not the display of the subject in the representation of the media item; and based on determining that a subject has not been automatically detected in the media item, abandoning the display of the first user interface object.

[0014] In some embodiments, a method performed at a computer system in communication with a display generation component is described. The method includes: while displaying a representation of visual content including a first portion and a second portion via the display generation component, detecting an input directed to the visual content; and in response to detecting the input directed to the visual content and based on determining that the first portion includes a body available for copying, providing an indication of an operation that can be performed to copy the body but not the second portion.

[0015] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs including instructions for performing the following operations: while displaying a representation of visual content including a first portion and a second portion via the display generation component, detecting input directed to the visual content; and in response to detecting the input directed to the visual content and based on determining that the first portion includes a subject that can be copied, providing an indication of an operation that can be executed to copy the subject but not the second portion.

[0016] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs including instructions for performing the following operations: while displaying a representation of visual content including a first portion and a second portion via the display generation component, detecting input directed to the visual content; and in response to detecting the input directed to the visual content and based on determining that the first portion includes a body that can be copied, providing an indication of an operation that can be performed to copy the body but not the second portion.

[0017] According to some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component, the computer system comprising: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the following operations: while displaying a representation of visual content including a first portion and a second portion via the display generation component, detecting input directed to the visual content; and in response to detecting the input directed to the visual content and based on determining that the first portion includes a subject that can be copied, providing an indication of an operation that can be executed to copy the subject but not the second portion.

[0018] According to some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component, the computer system comprising: a component for detecting input directed to the visual content while displaying a representation of the visual content including a first portion and a second portion via the display generation component; and a component for providing an indication of an operation that can be performed to copy the subject but not the second portion in response to detecting the input directed to the visual content and based on determining that the first portion includes a subject that is available to be copied.

[0019] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs including instructions for performing the following operations: while displaying a representation of visual content including a first portion and a second portion via the display generation component, detecting input directed to the visual content; and in response to detecting the input directed to the visual content and based on determining that the first portion includes a body that is available to be copied, providing an indication of an operation that can be performed to copy the body but not the second portion.

[0020] According to some embodiments, a method performed at a computer system in communication with a display generation component is described. The method includes: when displaying a representation including text, detecting an input corresponding to a selection of a portion of the text in the representation; and in response to detecting the input corresponding to the selection of the portion of the text in the representation and based on determining that the portion of the text in the representation satisfies a corresponding set of criteria, wherein the corresponding set of criteria includes a criterion satisfied when determining that the portion of the text corresponds to a first measurement result having a first quantity and a first measurement unit, displaying a corresponding user interface for converting the first measurement result into one or more other measurement units via the display generation component, wherein the corresponding user interface includes a visual representation of a second measurement result having a second quantity, the second quantity having a second measurement unit different from the first measurement unit, and wherein the second quantity is a conversion of the first quantity from the first measurement unit to the second measurement unit.

[0021] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component, the one or more programs including instructions for performing the following operations: when displaying a representation including text, detecting an input corresponding to a selection of a portion of the text in the representation; and in response to detecting an input corresponding to a selection of a portion of the text in the representation and according to determining that the portion of the text in the representation satisfies a corresponding set of standards, wherein the corresponding set of standards includes a standard that is satisfied when determining that the portion of the text corresponds to a first measurement result having a first quantity and a first measurement unit, displaying a corresponding user interface for converting the first measurement result into one or more other measurement units via the display generation component, wherein the corresponding user interface includes a visual representation of a second measurement result having a second quantity, the second quantity having a second measurement unit different from the first measurement unit, and wherein the second quantity is a conversion of the first quantity from the first measurement unit to the second measurement unit.

[0022] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component, the one or more programs including instructions for performing the following operations: when displaying a representation including text, detecting an input corresponding to a selection of a portion of the text in the representation; and in response to detecting the input corresponding to the selection of the portion of the text in the representation and according to determining that the portion of the text in the representation satisfies a corresponding set of standards, wherein the corresponding set of standards includes a standard that is satisfied when determining that the portion of the text corresponds to a first measurement result having a first quantity and a first measurement unit, displaying a corresponding user interface for converting the first measurement result into one or more other measurement units via the display generation component, wherein the corresponding user interface includes a visual representation of a second measurement result having a second quantity, the second quantity having a second measurement unit different from the first measurement unit, and wherein the second quantity is a conversion of the first quantity from the first measurement unit to the second measurement unit.

[0023] According to some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component. The computer system includes: one or more processors; and a memory storing one or more programs configured to be executed by one or more processors, the one or more programs including instructions for performing the following operations: when displaying a representation including text, detecting an input corresponding to a selection of a portion of the text in the representation; and in response to detecting an input corresponding to a selection of a portion of the text in the representation and according to determining that the portion of the text in the representation satisfies a corresponding set of standards, wherein the corresponding set of standards includes a standard that is satisfied when determining that the portion of the text corresponds to a first measurement result having a first quantity and a first measurement unit, displaying a corresponding user interface for converting the first measurement result into one or more other measurement units via the display generation component, wherein the corresponding user interface includes a visual representation of a second measurement result having a second quantity, the second quantity having a second measurement unit different from the first measurement unit, and wherein the second quantity is a conversion of the first quantity from the first measurement unit to the second measurement unit.

[0024] According to some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component. The computer system includes: a component for detecting an input corresponding to a selection of a portion of text in the representation when displaying a representation including text; and a component for displaying a corresponding user interface for converting the first measurement result into one or more other measurement units via the display generation component in response to detecting an input corresponding to a selection of a portion of text in the representation and according to determining that the portion of the text in the representation satisfies a corresponding set of standards, wherein the corresponding set of standards includes a standard that is satisfied when determining that the portion of the text corresponds to a first measurement result having a first quantity and a first measurement unit, wherein the corresponding user interface includes a visual representation of a second measurement result having a second quantity, the second quantity having a second measurement unit different from the first measurement unit, and wherein the second quantity is a conversion of the first quantity from the first measurement unit to the second measurement unit.

[0025] In some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs including instructions for performing the following operations: when displaying a representation including text, detecting an input corresponding to a selection of a portion of the text in the representation; and in response to detecting the input corresponding to the selection of the portion of the text in the representation and based on determining that the portion of the text in the representation satisfies a corresponding set of criteria, wherein the corresponding set of criteria includes criteria that are satisfied when determining that the portion of the text corresponds to a first measurement result having a first quantity and a first measurement unit, displaying a corresponding user interface for converting the first measurement result into one or more other measurement units via the display generation component, wherein the corresponding user interface includes a visual representation of a second measurement result having a second quantity, the second quantity having a second measurement unit different from the first measurement unit, and wherein the second quantity is a conversion of the first quantity from the first measurement unit to the second measurement unit.

[0026] In some embodiments, a method performed at a computer system in communication with a display generation component is described. The method includes: detecting a request to display a representation of a media item; and in response to detecting the request to display the representation of the media item, displaying a corresponding user interface including the representation of the media item via the display generation component, wherein displaying the corresponding user interface includes: based on determining that the representation of the media item includes one or more symbols, displaying a representation of an interpretation of at least a first symbol of the one or more symbols simultaneously with the representation of the media via the display generation component, wherein the representation of the interpretation of the one or more symbols in the media item is separate from the media item.

[0027] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs including instructions for performing the following operations: detecting a request to display a representation of a media item; and in response to detecting the request to display the representation of the media item, displaying a corresponding user interface including a representation of the media item via the display generation component, wherein displaying the corresponding user interface includes: based on determining that the representation of the media item includes one or more symbols, displaying a representation of an interpretation of at least a first symbol of the one or more symbols simultaneously with the representation of the media via the display generation component, wherein the representation of the interpretation of the one or more symbols in the media item is separated from the media item.

[0028] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs including instructions for performing the following operations: detecting a request to display a representation of a media item; and in response to detecting the request to display the representation of the media item, displaying a corresponding user interface including the representation of the media item via the display generation component, wherein displaying the corresponding user interface includes: based on determining that the representation of the media item includes one or more symbols, displaying a representation of an interpretation of at least a first symbol of the one or more symbols simultaneously with the representation of the media via the display generation component, wherein the representation of the interpretation of the one or more symbols in the media item is separate from the media item.

[0029] According to some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component. The computer system includes: one or more processors; and a memory, the memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: detecting a request to display a representation of a media item; and in response to detecting a request to display a representation of a media item, displaying a corresponding user interface including a representation of the media item via the display generation component, wherein displaying the corresponding user interface includes: based on determining that the representation of the media item includes one or more symbols, displaying an interpreted representation of at least a first symbol of the one or more symbols simultaneously with the representation of the media via the display generation component, wherein the interpreted representation of the one or more symbols in the media item is separated from the media item.

[0030] According to some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component. The computer system includes: a component for detecting a request to display a representation of a media item; and a component for displaying a corresponding user interface including a representation of the media item via the display generation component in response to detecting the request to display the representation of the media item, wherein displaying the corresponding user interface includes: based on determining that the representation of the media item includes one or more symbols, displaying a representation of an interpretation of at least a first symbol of the one or more symbols simultaneously with the representation of the media via the display generation component, wherein the representation of the interpretation of the one or more symbols in the media item is separated from the media item.

[0031] In some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs including instructions for performing the following operations: detecting a request to display a representation of a media item; and in response to detecting the request to display the representation of the media item, displaying a corresponding user interface including the representation of the media item via the display generation component, wherein displaying the corresponding user interface includes: based on determining that the representation of the media item includes one or more symbols, displaying a representation of an interpretation of at least a first symbol of the one or more symbols simultaneously with the representation of the media via the display generation component, wherein the representation of the interpretation of the one or more symbols in the media item is separate from the media item.

[0032] According to some embodiments, a method is described. The method includes: at a computer system in communication with a display generation component: while displaying a representation of visual content including a first portion and a second portion via the display generation component, detecting an input directed to the first portion of the representation of the visual content; and in response to detecting the input directed to the first portion of the representation of the visual content and based on determining that the first portion of the representation of the visual content includes a detected foreground object represented in the visual content, displaying an animation via the display generation component, the display including: during a first time period when displaying the animation, displaying the first portion of the animation via the display generation component at a position corresponding to the detected foreground object, wherein displaying the first portion of the animation includes emphasizing a detected boundary of the detected foreground object during the first time period.

[0033] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component, the one or more programs including instructions for performing the following operations: when displaying a representation of visual content including a first part and a second part via the display generation component, detecting an input pointing to the first part of the representation of the visual content; and in response to detecting the input pointing to the first part of the representation of the visual content and based on determining that the first part of the representation of the visual content includes a detected foreground object represented in the visual content, displaying an animation via the display generation component, the display including: during a first time period when the animation is displayed, displaying a first part of the animation at a position corresponding to the detected foreground object via the display generation component, wherein displaying the first part of the animation includes emphasizing a detected boundary of the detected foreground object during the first time period.

[0034] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component, the one or more programs including instructions for performing the following operations: when displaying a representation of visual content including a first portion and a second portion via the display generation component, detecting an input pointing to the first portion of the representation of the visual content; and in response to detecting the input pointing to the first portion of the representation of the visual content and based on determining that the first portion of the representation of the visual content includes a detected foreground object represented in the visual content, displaying an animation via the display generation component, the display including: during a first time period when displaying the animation, displaying the first portion of the animation at a position corresponding to the detected foreground object via the display generation component, wherein displaying the first portion of the animation includes emphasizing the detected boundary of the detected foreground object during the first time period.

[0035] According to some embodiments, a computer system configured to communicate with a display generation component is described. The computer system includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: when displaying a representation of visual content including a first part and a second part via the display generation component, detecting an input pointing to the first part of the representation of the visual content; and in response to detecting the input pointing to the first part of the representation of the visual content and based on determining that the first part of the representation of the visual content includes a detected foreground object represented in the visual content, displaying an animation via the display generation component, the display including: during a first time period when displaying the animation, displaying the first part of the animation at a position corresponding to the detected foreground object via the display generation component, wherein displaying the first part of the animation includes emphasizing the detected boundary of the detected foreground object during the first time period.

[0036] According to some embodiments, a computer system configured to communicate with a display generation component is described. The computer system includes: a component for detecting an input pointing to the first part of the representation of visual content when displaying a representation of visual content including a first part and a second part via the display generation component; and a component for displaying an animation via the display generation component in response to detecting the input pointing to the first part of the representation of visual content and based on determining that the first part of the representation of visual content includes a detected foreground object represented in the visual content, the display including: during a first time period when displaying the animation, displaying the first part of the animation at a position corresponding to the detected foreground object via the display generation component, wherein displaying the first part of the animation includes emphasizing the detected boundary of the detected foreground object during the first time period.

[0037] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component, the one or more programs including instructions for performing the following operations: when displaying a representation of visual content including a first part and a second part via the display generation component, detecting an input pointing to the first part of the representation of the visual content; and in response to detecting the input pointing to the first part of the representation of the visual content and based on determining that the first part of the representation of the visual content includes a detected foreground object represented in the visual content, displaying an animation via the display generation component, the display including: during a first time period when displaying the animation, displaying the first part of the animation at a position corresponding to the detected foreground object via the display generation component, wherein displaying the first part of the animation includes emphasizing the detected boundary of the detected foreground object during the first time period.

[0038] Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions for performing these functions are optionally included in a transient computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0039] Thus, devices are provided with faster, more efficient methods and interfaces for managing visual content in media representations, thereby increasing the effectiveness, efficiency, and user satisfaction of such devices.Such methods and interfaces may supplement or replace other methods for managing visual content in media representations. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] For a better understanding of the various described embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, wherein like reference numerals designate corresponding parts throughout the several views.

[0041] Figure 1A is a block diagram illustrating a portable multifunction device with a touch-sensitive display according to some embodiments.

[0042] Figure 1B is a block diagram illustrating exemplary components for event processing according to some embodiments.

[0043] Figure 2 A portable multifunction device with a touch screen according to some embodiments is illustrated.

[0044] Figure 3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments.

[0045] Figure 4AAn exemplary user interface for a menu of applications on a portable multifunction device according to some embodiments is illustrated.

[0046] Figure 4B An exemplary user interface for a multifunction device having a touch-sensitive surface separate from the display is illustrated according to some embodiments.

[0047] Figure 5A Personal electronic devices according to some embodiments are illustrated.

[0048] Figure 5B is a block diagram illustrating a personal electronic device according to some embodiments.

[0049] FIG. 6A to FIG. 6M An exemplary user interface for managing one or more portions of a media representation according to some embodiments is illustrated.

[0050] Figure 7 is a flow chart illustrating a method of managing context of a media representation according to some embodiments.

[0051] Figure 8 is a flow chart illustrating a method of copying a body of a media representation according to some embodiments.

[0052] FIG. 9A to FIG. 9I An exemplary user interface for converting one or more portions of a media representation according to some embodiments is illustrated.

[0053] Fig.10 is a flow chart illustrating a method of transforming one or more portions of a media representation according to some embodiments.

[0054] FIG. 11A to FIG. 11G An exemplary user interface for providing a description of one or more symbols in a media representation according to some embodiments is illustrated.

[0055] Fig.12 is a flowchart illustrating a method of providing a description of one or more symbols in a media representation according to some embodiments.

[0056] FIG. 13A to FIG. 13T An exemplary user interface for providing one or more animations of a detected object in a media representation is illustrated according to some embodiments.

[0057] Fig.14 is a flowchart illustrating a method of providing one or more animations of a detected object in a media representation according to some embodiments. DETAILED DESCRIPTION

[0058] The following description sets forth exemplary methods, parameters, etc. However, it should be appreciated that such description is not intended to limit the scope of the present disclosure, but is provided as a description of exemplary embodiments.

[0059] There is a need for electronic devices that provide efficient methods and interfaces for managing visual content in media representations (e.g., representations of media such as photographs and / or video media). For example, there is a need for electronic devices and / or computer systems that allow users to manage visual content in media representations that include objects such as signs or restaurant menus captured by one or more cameras of a computer system. Such techniques can reduce the cognitive burden on users viewing, editing, and / or managing media representations, thereby increasing productivity. In addition, such techniques can reduce processor power and battery power that would otherwise be wasted on redundant user input.

[0060] under Figure 1A to Figure 1B , Figure 2 , Figure 3 , FIG. 4A to FIG. 4B and FIG. 5A to FIG. 5B A description of an exemplary device for performing techniques for managing visual content in a media presentation is provided.

[0061] FIG. 6A to FIG. 6M An exemplary user interface for managing one or more portions of a media representation according to some embodiments is illustrated. Figure 7 is a flow chart illustrating a method of managing context of a media representation according to some embodiments. Figure 8 is a flow chart illustrating a method of copying a body of a media representation according to some embodiments. FIG. 6A to FIG. 6M The user interface in is used to illustrate the process described below, including Figure 7 and Figure 8 process.

[0062] FIG. 9A to FIG. 9I An exemplary user interface for converting one or more portions of a media representation according to some embodiments is illustrated. Fig.10 is a flow chart illustrating a method of transforming one or more portions of a media representation according to some embodiments. FIG. 9A to FIG. 9I The user interface in is used to illustrate the process described below, including Fig.10 process.

[0063] FIG. 11A to FIG. 11G An exemplary user interface for providing a description of one or more symbols in a media representation according to some embodiments is illustrated. Fig.12 is a flowchart illustrating a method of providing a description of one or more symbols in a media representation according to some embodiments. FIG. 11A to FIG. 11G The user interface in is used to illustrate the process described below, including Fig.12 process.

[0064] FIG. 13A to FIG. 13T An exemplary user interface for providing one or more animations of a detected object in a media representation is illustrated according to some embodiments. Fig.14 is a flowchart illustrating a method of providing one or more animations of a detected object in a media representation according to some embodiments. FIG. 13A to FIG. 13T The user interface in is used to illustrate the process described below, including Fig.14 process.

[0065] The processes described below enhance the operability of the device and make the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device) through various techniques, including by providing improved visual feedback to the user, reducing the number of inputs required to perform an operation, providing additional control options without cluttering the user interface with additional display controls, performing an operation without further user input when a set of conditions have been met, and / or additional techniques. These techniques also reduce power usage and extend the battery life of the device by enabling the user to use the device more quickly and more efficiently.

[0066] In addition, in the method described herein where one or more steps depend on one or more conditions being met, it should be understood that the method can be repeated in multiple repetitions so that in the process of repetition, all conditions for determining the steps in the method have been met in different repetitions of the method. For example, if the method needs to perform the first step (if the condition is met), and perform the second step (if the condition is not met), then the ordinary technician will know that the steps stated are repeated until both the condition is met and the condition is not met (in no particular order). Therefore, the method described as having one or more steps depending on one or more conditions being met can be rewritten as a method of repeating until each condition described in the method is met. However, this does not require the system or computer-readable medium to declare that the system or computer-readable medium contains instructions for performing a contingent operation based on the satisfaction of the corresponding one or more conditions, and is therefore able to determine whether the possible situation has been met without explicitly repeating the steps of the method until all conditions for determining the steps in the method have been met. It will also be understood by ordinary technicians in the art that, similar to the method with the contingent step, the system or computer-readable storage medium can repeat the steps of the method as many times as needed to ensure that all the contingent steps have been performed.

[0067] Although the following description uses the terms "first", "second", etc. to describe various elements, these elements should not be limited by the terms. In some embodiments, these terms are used to distinguish one element from another element. For example, a first touch can be named a second touch and similarly a second touch can be named a first touch without departing from the scope of the various described embodiments. In some embodiments, the first touch and the second touch are two separate references to the same touch. In some embodiments, both the first touch and the second touch are touches, but they are not the same touch.

[0068] The terms used in the description of various described embodiments herein are only for the purpose of describing specific embodiments, and are not intended to be limiting. As used in the description of various described embodiments and in the appended claims, the singular forms "one" and "the" are intended to also include plural forms, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" used herein refers to and encompasses any and all possible combinations of one or more items in the associated listed items. It will also be understood that the terms "including" and / or "comprising" when used in this specification specify the presence of stated features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or their grouping.

[0069] The term "if" is optionally interpreted to mean "when," "upon," or "in response to determining," or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined that ..." or "if [a stated condition or event] is detected" are optionally interpreted to mean "upon determining that ..." or "in response to determining that ..." or "upon detecting [a stated condition or event]," or "in response to detecting [a stated condition or event]," depending on the context.

[0070] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described herein. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as a PDA and / or a music player function. Exemplary embodiments of portable multifunction devices include, but are not limited to, the Apple Watch from Apple Inc. (Cupertino, California). Devices, iPod Equipment and Device. Optionally use other portable electronic devices, such as laptops or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and / or touch pads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with a touch-sensitive surface (e.g., touch screen displays and / or touch pads). In some embodiments, the electronic device is a computer system that communicates with the display generation component (e.g., via wireless communication, via wired communication). The display generation component is configured to provide visual output, such as display via a CRT display, display via an LED display, or display via image projection. In some embodiments, the display generation component is integrated with the computer system. In some embodiments, the display generation component is separated from the computer system. As used herein, "display" content includes transmitting data (e.g., image data or video data) to an integrated or external display generation component via a wired or wireless connection to visually generate content to display content (e.g., video data rendered or decoded by display controller 156).

[0071] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse and / or joystick.

[0072] The device typically supports a variety of applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.

[0073] Various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or adjusted and / or varied within the corresponding application. In this way, the common physical architecture of the device (such as a touch-sensitive surface) optionally supports various applications with a user interface that is intuitive and clear to the user.

[0074] Attention is now turned to embodiments of portable devices having touch-sensitive displays. Figure 1A1 is a block diagram illustrating a portable multifunction device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a "touch screen" for convenience, and is sometimes referred to as or referred to as a "touch-sensitive display system." The device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. The device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more contact force sensors 165 for detecting the intensity of contact on the device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of the device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile output on device 100 (e.g., generating tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touch pad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0075] As used in this specification and claims, the term "intensity" of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or to a surrogate (surrogate) of the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values ​​that includes at least four different values ​​and more typically includes hundreds of different values ​​(e.g., at least 256). The intensity of a contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure the force at different points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted average) to determine an estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and / or its change, the capacitance of the touch-sensitive surface near the contact and / or its change, and / or the resistance of the touch-sensitive surface near the contact and / or its change are optionally used as a substitute for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the substitute measurement of the contact force or pressure is used directly to determine whether the intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some embodiments, the substitute measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether the intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of the contact as an attribute of the user input allows the user to access additional device functions that would otherwise be inaccessible to the user on a smaller device with limited real estate, which is used to display an enable indication (e.g., on a touch-sensitive display) and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls, such as knobs or buttons).

[0076] As used in this specification and claims, the term "tactile output" refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, which will be detected by a user using the user's sense of touch. For example, in the case where a device or a component of the device is in contact with a user's touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical properties of the device or component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a "press click" or "release click" to a physical actuation button. In some cases, the user will feel a tactile sensation, such as a "press click" or "release click", even when the physical actuation button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's movement does not move. As another example, even when there is no change in the smoothness of the touch-sensitive surface, movement of the touch-sensitive surface may optionally be interpreted or sensed by the user as "roughness" of the touch-sensitive surface. Although such a user's interpretation of touch will be limited by the user's individualized sensory perceptions, many sensory perceptions of touch are common to most users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., "press click," "release click," "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or a component thereof that would generate that sensory perception for a typical (or average) user.

[0077] It should be understood that device 100 is merely one example of a portable multifunction device, and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. Figure 1A The various components shown are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0078] Memory 102 optionally includes high-speed random access memory, and optionally also includes non-volatile memory, such as one or more disk storage devices, flash memory devices or other non-volatile solid-state memory devices. Memory controller 122 optionally controls other components of device 100 to access memory 102.

[0079] The peripheral device interface 118 can be used to couple the input peripheral devices and output peripheral devices of the device to the CPU 120 and the memory 102. The one or more processors 120 run or execute various software programs (such as computer programs (e.g., including instructions)) and / or instruction sets stored in the memory 102 to perform various functions of the device 100 and process data. In some embodiments, the peripheral device interface 118, the CPU 120, and the memory controller 122 are optionally implemented on a single chip such as the chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0080] RF (radio frequency) circuit 108 receives and sends RF signals, also referred to as electromagnetic signals. RF circuit 108 converts electrical signals into / converts electromagnetic signals into electrical signals, and communicates with communication networks and other communication devices via electromagnetic signals. RF circuit 108 optionally includes well-known circuits for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, codec chipsets, user identity modules (SIM) cards, memories, and the like. RF circuit 108 optionally communicates with networks and other devices via wireless communications, such as the Internet (also referred to as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs)). RF circuit 108 optionally includes well-known circuits for detecting near field communications (NFC) fields, such as through short-range communications radio components. Wireless communication optionally uses any of a variety of communication standards, protocols and technologies, including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11d), IEEE 802.11e, IEEE 802.11f, IEEE 802.11g, IEEE 802.11g). 11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Utilizing Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)) and / or Short Message Service (SMS), or any other suitable communication protocol including communication protocols that have not been developed as of the filing date of this document.

[0081] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between a user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 111. The speaker 111 converts the electrical signals into sound waves audible to humans. The audio circuit 110 also receives electrical signals converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signals into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., Figure 2 The headset jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset having both output (e.g., a single or dual-ear headset) and input (e.g., a microphone).

[0082] The I / O subsystem 106 couples input / output peripherals on the device 100, such as a touch screen 112 and other input control devices 116, to a peripheral device interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, a depth camera controller 169, an intensity sensor controller 159, a tactile feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals from other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, etc. In some embodiments, the input controller 160 is optionally coupled to any of the following (or none of the following): a keyboard, an infrared port, a USB port, and a pointing device such as a mouse. One or more buttons (e.g., Figure 2 208) optionally includes an increase / decrease button for volume control of the speaker 111 and / or the microphone 113. The one or more buttons optionally include a push button (e.g., Figure 2206 in). In some embodiments, the electronic device is a computer system that communicates with one or more input devices (e.g., via wireless communication, via wired communication). In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a touchpad as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175), such as for tracking a user's gestures (e.g., hand gestures and / or air gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system. In some embodiments, an air gesture is a gesture that is detected without the user touching an input element that is part of the device (or is independent of an input element that is part of the device) and is based on detected movement of a part of the user's body through the air, including movement of the user's body relative to an absolute reference (for example, the angle of the user's arm relative to the ground or the distance of the user's hand relative to the ground), movement relative to another part of the user's body (for example, movement of the user's hand relative to the user's shoulder, movement of one of the user's hands relative to the user's other hand, and / or movement of the user's fingers relative to another finger or part of the user's hand), and / or absolute movement of a part of the user's body (for example, a tap gesture involving moving the hand in a predetermined position, a predetermined amount and / or speed, or a shake gesture involving a predetermined speed or amount of rotation of a part of the user's body)).

[0083] A quick press of the push button optionally disengages the lock of the touch screen 112 or optionally begins the process of unlocking the device using gestures on the touch screen, as described in U.S. Patent Application 11 / 322,549, filed on December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image" (i.e., U.S. Patent No. 7,657,849), which is hereby incorporated by reference in its entirety. A long press of the push button (e.g., 206) optionally turns the device 100 on or off. The functions of one or more buttons are optionally user-customizable. The touch screen 112 is used to implement virtual buttons or soft buttons and one or more soft keyboards.

[0084] The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch screen 112 and / or sends electrical signals to the touch screen. The touch screen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0085] The touch screen 112 has a touch-sensitive surface, sensor, or set of sensors that accept input from a user based on haptic and / or tactile contact. The touch screen 112 and display controller 156 (together with any associated modules and / or instruction sets in memory 102) detect contact (and any movement or interruption of the contact) on the touch screen 112 and convert the detected contact into interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch screen 112. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to the user's finger.

[0086] The touch screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. The touch screen 112 and display controller 156 optionally use any of a variety of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen 112 to detect contact and any movement or interruption thereof. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as in the Apple ® from Apple Inc. (Cupertino, California). and iPod The technology used in.

[0087] The touch-sensitive display in some embodiments of touch screen 112 is optionally similar to the multi-touch-sensitive touchpad described in the following U.S. Patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.), and / or U.S. Patent Publication 2002 / 0015024A1, each of which is hereby incorporated by reference in its entirety. However, touch screen 112 displays visual output from device 100, while a touch-sensitive touchpad does not provide visual output.

[0088] The touch-sensitive display in some embodiments of the touch screen 112 is described in the following applications: (1) U.S. patent application No. 11 / 381,313, filed on May 2, 2006, "Multipoint Touch Surface Controller"; (2) U.S. patent application No. 10 / 840,862, filed on May 6, 2004, "Multipoint Touchscreen"; (3) U.S. patent application No. 10 / 903,964, filed on July 30, 2004, "Gestures For Touch Sensitive Input Devices"; (4) U.S. patent application No. 11 / 048,264, filed on January 31, 2005, "Gestures For Touch Sensitive Input Devices"; (5) U.S. patent application No. 11 / 038,590, filed on January 18, 2005, "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices”; (6) U.S. patent application Ser. No. 11 / 228,758, filed on September 16, 2005, “Virtual Input Device Placement On A Touch Screen User Interface”; (7) U.S. patent application Ser. No. 11 / 228,700, filed on September 16, 2005, “Operation Of A Computer With A Touch Screen Interface”; (8) U.S. patent application Ser. No. 11 / 228,737, filed on September 16, 2005, “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard”; and (9) U.S. patent application Ser. No. 11 / 367,749, filed on March 3, 2006, “Multi-Functional Hand-Held Device”. All of these applications are incorporated herein by reference in their entirety.

[0089] The touch screen 112 optionally has a video resolution of more than 100 dpi. In some embodiments, the touch screen has a video resolution of about 160 dpi. The user optionally uses any suitable object or attachment such as a stylus, a finger, etc. to contact the touch screen 112. In some embodiments, the user interface is designed to work primarily through finger-based contacts and gestures, which may not be as accurate as stylus-based input due to the larger contact area of ​​the finger on the touch screen. In some embodiments, the device converts rough finger-based input into precise pointer / cursor positioning or commands for performing the actions desired by the user.

[0090] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touch screen, does not display visual output. The touchpad is optionally a touch-sensitive surface separate from the touch screen 112, or an extension of the touch-sensitive surface formed by the touch screen.

[0091] The device 100 also includes a power system 162 for powering the various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, a power fault detection circuit, a power converter or inverter, a power status indicator (e.g., a light emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in a portable device.

[0092] Device 100 optionally also includes one or more optical sensors 164 . Figure 1AAn optical sensor coupled to an optical sensor controller 158 in the I / O subsystem 106 is shown. The optical sensor 164 optionally includes a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In conjunction with the imaging module 143 (also called a camera module), the optical sensor 164 optionally captures a static image or video. In some embodiments, the optical sensor is located on the rear of the device 100, opposite to the touch screen display 112 on the front of the device, so that the touch screen display can be used as a viewfinder for static images and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device so that when the user views other video conference participants on the touch screen display, the image of the user is optionally obtained for video conferencing. In some embodiments, the positioning of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and sensor in the device housing) so that a single optical sensor 164 is used with the touch screen display for both video conferencing and static image and / or video image acquisition.

[0093] Device 100 optionally also includes one or more depth camera sensors 175 . Figure 1A A depth camera sensor coupled to a depth camera controller 169 in the I / O subsystem 106 is shown. The depth camera sensor 175 receives data from the environment to create a three-dimensional model of an object (e.g., a face) within the scene from a viewpoint (e.g., a depth camera sensor). In some embodiments, in conjunction with the imaging module 143 (also referred to as a camera module), the depth camera sensor 175 is optionally used to determine a depth map of different portions of an image captured by the imaging module 143. In some embodiments, the depth camera sensor is located at the front of the device 100, so that an image of the user with depth information is optionally obtained for video conferencing while the user is viewing other video conference participants on the touch screen display, and a selfie with depth map data is captured. In some embodiments, the depth camera sensor 175 is located at the rear of the device, or at both the rear and front of the device 100. In some embodiments, the positioning of the depth camera sensor 175 can be changed by the user (e.g., by rotating the lens and sensor in the device housing) so that the depth camera sensor 175 is used with the touch screen display for both video conferencing and still image and / or video image acquisition.

[0094] Device 100 optionally also includes one or more contact intensity sensors 165 . Figure 1AA contact force sensor is shown coupled to a force sensor controller 159 in the I / O subsystem 106. Contact force sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other force sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). Contact force sensor 165 receives contact force information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact force sensor is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact force sensor is located on the back of device 100, opposite to touch screen display 112 located on the front of device 100.

[0095] Device 100 optionally also includes one or more proximity sensors 166 . Figure 1A A proximity sensor 166 is shown coupled to the peripherals interface 118. Alternatively, the proximity sensor 166 is optionally coupled to the input controller 160 in the I / O subsystem 106. The proximity sensor 166 is optionally implemented as described in the following U.S. patent application numbers: 11 / 241,839, entitled "Proximity Detector In Handheld Device"; 11 / 240,788, entitled "Proximity Detector In Handheld Device"; 11 / 620,702, entitled "Using Ambient Light Sensor To Augment Proximity Sensor Output"; 11 / 586,862, entitled "Automated Response To And Sensing Of User Activity In Portable Devices"; and 11 / 638,251, entitled "Methods And Systems For Automatic Configuration Of Peripherals", which are hereby incorporated by reference in their entirety. In some embodiments, when the multifunction device is placed near the user's ear (e.g., when the user is on a phone call), the proximity sensor turns off and disables the touch screen 112.

[0096] Device 100 optionally also includes one or more tactile output generators 167 . Figure 1AA tactile output generator is shown coupled to a tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 optionally includes: one or more electroacoustic devices, such as a speaker or other audio component; and / or an electromechanical device for converting energy into linear motion, such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output generating component (e.g., a component for converting an electrical signal into a tactile output on the device). The contact force sensor 165 receives tactile feedback generation instructions from the tactile feedback module 133 and generates a tactile output on the device 100 that can be felt by a user of the device 100. In some embodiments, at least one tactile output generator is arranged in juxtaposition or proximity to a touch-sensitive surface (e.g., touch-sensitive display system 112) and optionally generates tactile output by moving the touch-sensitive surface vertically (e.g., inward / outward of the surface of the device 100) or laterally (e.g., backward and forward in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on the back of the device 100, opposite the touch screen display 112 located on the front of the device 100.

[0097] Device 100 optionally also includes one or more accelerometers 168 . Figure 1A An accelerometer 168 is shown coupled to the peripheral device interface 118. Alternatively, the accelerometer 168 is optionally coupled to the input controller 160 in the I / O subsystem 106. The accelerometer 168 is optionally implemented as described in the following U.S. Patent Publication Nos.: 20050190059, entitled "Acceleration-based Theft Detection System for Portable Electronic Devices" and 20060017692, entitled "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer", both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed in a portrait view or a landscape view on the touch screen display based on analysis of data received from one or more accelerometers. The device 100 optionally includes a magnetometer and a GPS (or GLONASS or other global navigation system) receiver in addition to the accelerometer 168 for obtaining information about the position and orientation (e.g., portrait or landscape) of the device 100.

[0098] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. In addition, in some embodiments, memory 102 ( Figure 1A ) or 370( Figure 3 ) storage device / global internal state 157, such as Figure 1A and Figure 3 . The device / global internal state 157 includes one or more of the following: active application state, which indicates which application (if any) is currently active; display state, which indicates what applications, views, or other information occupy various areas of the touch screen display 112; sensor state, including information obtained from the device's various sensors and input control devices 116; and position information related to the device's position and / or posture.

[0099] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.), and facilitating communication between various hardware components and software components.

[0100] The communication module 128 facilitates communication with other devices through one or more external ports 124, and also includes various software components for processing data received by the RF circuit 108 and / or the external port 124. The external port 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) is suitable for coupling directly to other devices, or indirectly through a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is connected to (trademark of Apple Inc.) devices.

[0101] The contact / motion module 130 optionally detects contact with the touch screen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger press event), determining the contact strength (e.g., the force or pressure of the contact, or a substitute for the force or pressure of the contact), determining whether there is movement of the contact and tracking the movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or contact disconnection). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of a contact point optionally includes determining a rate (magnitude), a velocity (magnitude and direction), and / or an acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a series of contact data. These operations are optionally applied to a single point of contact (e.g., a single finger contact) or multiple points of simultaneous contact (e.g., "multi-touch" / multiple finger contacts). In some embodiments, the contact / motion module 130 and display controller 156 detect contact on the touch pad.

[0102] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by a user (e.g., to determine whether a user has "clicked" an icon). In some embodiments, at least a subset of the intensity thresholds are determined based on software parameters (e.g., the intensity thresholds are not determined by the activation thresholds of specific physical actuators and can be adjusted without changing the physical hardware of the device 100). For example, without changing the touchpad or touchscreen display hardware, the mouse "click" threshold of a touchpad or touchscreen can be set to any one of a large range of predefined thresholds. Additionally, in some specific implementations, a software setting is provided to the user of the device for adjusting one or more intensity thresholds in a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by utilizing a system-level click on an "intensity" parameter to adjust multiple intensity thresholds at once).

[0103] The contact / motion module 130 optionally detects gesture input by the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contacts). Thus, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger press event, and then detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift-off) event.

[0104] The graphics module 132 includes various known software components for rendering and displaying graphics on the touch screen 112 or other display, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual attributes) of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0105] In some embodiments, the graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes for specifying the graphics to be displayed from an application or the like, along with coordinate data and other graphic attribute data if necessary, and then generates screen image data to be output to the display controller 156.

[0106] Haptic feedback module 133 includes various software components for generating instructions used by tactile output generator 167 to produce tactile output at one or more locations on device 100 in response to user interaction with device 100 .

[0107] The text input module 134, which is optionally a component of the graphics module 132, provides a soft keyboard for entering text in various applications (e.g., the contacts module 137, the email client module 140, the instant messaging module 141, the browser module 147, and any other application requiring text input).

[0108] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone module 138 for use in location-based dialing; to the camera module 143 as picture / video metadata; and to applications that provide location-based services, such as a weather widget, a local yellow pages widget, and a map / navigation widget).

[0109] Application 136 optionally includes the following modules (or instruction sets) or a subset or superset thereof:

[0110] ● Contacts module 137 (sometimes called address book or contact list);

[0111] ● Telephone module 138;

[0112] ● Video conferencing module 139;

[0113] ● Email client module 140;

[0114] ●Instant messaging (IM) module 141;

[0115] ●Fitness support module 142;

[0116] ● Camera module 143 for still images and / or video images;

[0117] ●Image management module 144;

[0118] ●Video player module;

[0119] ●Music player module;

[0120] ●Browser module 147;

[0121] ●Calendar module 148;

[0122] A widget module 149, which optionally includes one or more of the following: a weather widget 149-1, a stock market widget 149-2, a calculator widget 149-3, an alarm widget 149-4, a dictionary widget 149-5, and other widgets acquired by the user, and a user-created widget 149-6;

[0123] A widget creator module 150 for forming a user-created widget 149-6;

[0124] ●Search module 151;

[0125] ● Video and music player module 152, which merges the video player module and the music player module;

[0126] ●Note module 153;

[0127] ● Map module 154; and / or

[0128] ●Online video module 155.

[0129] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.

[0130] In combination with the touch screen 112, display controller 156, touch / motion module 130, graphics module 132 and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (for example, stored in the application internal state 192 of the contact module 137 in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating telephone numbers, email addresses, physical addresses or other information with names; associating images with names; categorizing and classifying names; providing telephone numbers or email addresses to initiate and / or facilitate communications via the telephone module 138, video conferencing module 139, email client module 140 or IM module 141; and the like.

[0131] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, phone module 138 is optionally used to enter a sequence of characters corresponding to a phone number, access one or more phone numbers in contact module 137, modify an entered phone number, dial a corresponding phone number, conduct a conversation, and disconnect or hang up when the conversation is complete. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.

[0132] In combination with the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch screen 112, the display controller 156, the optical sensor 164, the optical sensor controller 158, the contact / motion module 130, the graphics module 132, the text input module 134, the contact module 137 and the telephone module 138, the video conferencing module 139 includes executable instructions for initiating, conducting and terminating a video conference between a user and one or more other participants in accordance with user instructions.

[0133] In conjunction with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to create and send emails with still images or video images captured by camera module 143.

[0134] In conjunction with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, instant messaging module 141 includes executable instructions for the following operations: inputting a character sequence corresponding to an instant message, modifying previously input characters, transmitting a corresponding instant message (e.g., using a short message service (SMS) or multimedia message service (MMS) protocol for phone-based instant messaging or using XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or enhanced messaging services (EMS). As used herein, "instant messaging" refers to both phone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0135] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, the GPS module 135, the map module 154 and the music player module, the fitness support module 142 includes executable instructions for creating a fitness (e.g., with time, distance and / or calorie burn goals); communicating with fitness sensors (sports equipment); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting and playing music for fitness; and displaying, storing and transmitting fitness data.

[0136] In conjunction with the touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132 and image management module 144, the camera module 143 includes executable instructions for the following operations: capturing still images or videos (including video streams) and storing them in the memory 102, modifying the characteristics of the still images or videos, or deleting the still images or videos from the memory 102.

[0137] In conjunction with touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing) or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.

[0138] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132 and the text input module 134, the browser module 147 includes executable instructions for browsing the Internet in accordance with user instructions, including searching, linking to, receiving and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.

[0139] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the email client module 140 and the browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying and storing calendars and data associated with the calendar (e.g., calendar entries, to-do items, etc.) in accordance with user instructions.

[0140] In conjunction with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147, widget module 149 is a mini-application that is optionally downloaded and used by a user (e.g., weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm widget 149-4, and dictionary widget 149-5) or a mini-application created by a user (e.g., user-created widget 149-6). In some embodiments, the widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., Yahoo! widget).

[0141] In combination with the RF circuit 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134 and browser module 147, the widget creator module 150 is optionally used by a user to create widgets (e.g., converting a user-specified portion of a web page into a widget).

[0142] In combination with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132 and text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user instructions.

[0143] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, and executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touch screen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).

[0144] In conjunction with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the note module 153 includes executable instructions for creating and managing notes, to-do lists, etc. according to user instructions.

[0145] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the GPS module 135 and the browser module 147, the map module 154 is optionally used to receive, display, modify and store maps and data associated with the maps (e.g., driving directions, data relating to stores and other points of interest at or near a particular location, and other location-based data) in accordance with user instructions.

[0146] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes instructions for the following operations: allowing a user to access, browse, receive (e.g., by streaming and / or downloading), playback (e.g., on the touch screen or on an external display connected via external port 124), send an email with a link to a specific online video, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, instant messaging module 141 is used instead of email client module 140 to send a link to a specific online video. Additional descriptions of online video applications may be found in U.S. Provisional Patent Application No. 60 / 936,562, filed on June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed on December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are hereby incorporated by reference in their entirety.

[0147] Each of the modules and applications described above corresponds to an executable instruction set for performing one or more of the functions described above and the methods described in this patent application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) do not have to be implemented as independent software programs (such as computer programs (e.g., including instructions)), processes, or modules, so various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. For example, a video player module is optionally combined with a music player module into a single module (e.g., Figure 1A In some embodiments, the memory 102 optionally stores a subset of the above modules and data structures. In addition, the memory 102 optionally stores additional modules and data structures not described above.

[0148] In some embodiments, the device 100 is a device where the operation of a predefined set of functions on the device is performed exclusively through a touch screen and / or a touch pad. By using a touch screen and / or a touch pad as the primary input control device for operating the device 100, the number of physical input control devices (e.g., push buttons, dials, etc.) on the device 100 is optionally reduced.

[0149] A predefined set of functions that are performed exclusively through a touch screen and / or a touch pad optionally includes navigation between user interfaces. In some embodiments, the touch pad, when touched by a user, navigates the device 100 from any user interface displayed on the device 100 to a main menu, a main desktop menu, or a root menu. In such embodiments, a touch pad is used to implement a "menu button." In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a touch pad.

[0150] Figure 1B is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370( Figure 3 ) includes an event classifier 170 (e.g., in the operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).

[0151] Event classifier 170 receives event information and determines the application 136-1 and the application view 191 of application 136-1 to which the event information is to be delivered. Event classifier 170 includes event monitor 171 and event distributor module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information is to be delivered.

[0152] In some embodiments, the application internal state 192 includes additional information, such as one or more of the following: resumption information to be used when application 136-1 resumes execution, user interface state information indicating that information is being displayed or is ready to be displayed by application 136-1, a state queue for enabling a user to return to a previous state or view of application 136-1, and a repeat / undo queue of previous actions taken by the user.

[0153] Event monitor 171 receives event information from peripherals interface 118. Event information includes information about sub-events (e.g., user touches on touch-sensitive display 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (through audio circuit 110). The information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.

[0154] In some embodiments, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other embodiments, peripheral device interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or receiving an input for more than a predetermined duration).

[0155] In some embodiments, the event classifier 170 also includes a hit view determination module 172 and / or an active event identifier determination module 173.

[0156] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides software procedures for determining where within one or more views a sub-event has occurred. A view consists of controls and other elements that a user can see on the display.

[0157] Another aspect of the user interface associated with an application is a set of views, sometimes also referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of the respective application) in which a touch is detected optionally correspond to a programmatic level within the programmatic or view hierarchy of the application. For example, the lowest level view in which a touch is detected is optionally referred to as a hit view, and the set of events that are identified as correct input is optionally determined at least in part based on the hit view of the initial touch that started the touch-based gesture.

[0158] Hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should handle the sub-events. In most cases, the hit view is the lowest level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source for which it is identified as the hit view.

[0159] Active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with one particular view, higher views in the hierarchy will still remain as actively participating views.

[0160] Event distributor module 174 distributes event information to event recognizers (e.g., event recognizers 180). In embodiments including active event recognizer determination module 173, event distributor module 174 delivers the event information to the event recognizers determined by active event recognizer determination module 173. In some embodiments, event distributor module 174 stores the event information in an event queue, which is retrieved by corresponding event receivers 182.

[0161] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a standalone module or is part of another module stored in memory 102, such as contact / motion module 130.

[0162] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the user interface of the application. Each application view 191 of application 136-1 includes one or more event identifiers 180. Typically, the corresponding application view 191 includes multiple event identifiers 180. In other embodiments, one or more event identifiers in event identifiers 180 are part of an independent module, which is a higher-level object such as a user interface toolkit or application 136-1 from which methods and other properties are inherited. In some embodiments, the corresponding event handler 190 includes one or more of the following: data updater 176, object updater 177, GUI updater 178 and / or event data 179 received from event classifier 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177 or GUI updater 178 to update application internal state 192. Alternatively, one or more of the application views 191 include one or more corresponding event handlers 190. In addition, in some embodiments, one or more of the data updater 176, the object updater 177, and the GUI updater 178 are included in the corresponding application view 191.

[0163] The corresponding event identifier 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event based on the event information. The event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event identifier 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0164] Event receiver 182 receives event information from event classifier 170. Event information includes information about sub-events such as touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves the movement of the touch, the event information optionally also includes the speed and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another orientation (for example, from a longitudinal orientation to a transverse orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device posture).

[0165] Event comparator 184 compares event information with predefined event or sub-event definitions, and determines an event or sub-event based on the comparison, or determines or updates the state of an event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 includes a definition of an event (e.g., a predefined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in event (187) include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, the definition of event 1 (187-1) is a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on a displayed object, a first lift-off (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on a displayed object, and a second lift-off (touch end) of a predetermined duration. In another example, the definition of event 2 (187-2) is a drag on a displayed object. For example, dragging includes a touch (or contact) of a predetermined duration on a displayed object, movement of the touch on the touch-sensitive display 112, and lifting of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0166] In some embodiments, event definition 187 includes definitions of events for corresponding user interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler associated with a sub-event and the object that triggered the hit test.

[0167] In some embodiments, the definition of the corresponding event (187) also includes a delay action that delays the delivery of the event information until it has been determined that the sub-event sequence does or does not correspond to the event type of the event identifier.

[0168] When a corresponding event recognizer 180 determines that a sequence of sub-events does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which subsequent sub-events of the touch-based gesture are ignored. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.

[0169] In some embodiments, the corresponding event recognizers 180 include metadata 183 with configurable properties, flags, and / or lists that indicate how the event delivery system should perform sub-event delivery to actively participating event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact or can interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0170] In some embodiments, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates an event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and deferred sending) the sub-events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a tag associated with the identified event, and the event handler 190 associated with the tag obtains the tag and executes a predefined process.

[0171] In some embodiments, the event delivery instructions 188 include a sub-event delivery instruction that delivers event information about a sub-event without activating an event handler. Instead, the sub-event delivery instruction delivers the event information to an event handler associated with a sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or with an actively participating view receives the event information and executes a predetermined process.

[0172] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the positioning of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on a touch-sensitive display.

[0173] In some embodiments, event handler 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0174] It should be understood that the above discussion of event processing for user touches on a touch-sensitive display also applies to other forms of user input that utilize input devices to operate the multifunction device 100, and not all user input is initiated on the touch screen. For example, mouse movement and mouse button presses, optionally in conjunction with single or multiple keyboard presses or hold; contact movement on a touch pad, such as tapping, dragging, scrolling, etc.; stylus input; movement of the device; verbal commands; detected eye movement; biometric input; and / or any combination thereof are optionally used as input corresponding to sub-events that define the event to be distinguished.

[0175] Figure 2A portable multifunction device 100 with a touch screen 112 according to some embodiments is illustrated. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more of these graphics by, for example, making gestures on the graphics using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, when the user interrupts contact with one or more graphics, selection of one or more graphics will occur. In some embodiments, gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, up and / or down) and / or rolling of fingers that have been in contact with the device 100 (from right to left, from left to right, up and / or down). In some specific implementations or in some cases, inadvertent contact with a graphic will not select the graphic. For example, when the gesture corresponding to the selection is a tap, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application.

[0176] The device 100 optionally also includes one or more physical buttons, such as a "home" or menu button 204. As previously described, the menu button 204 is optionally used to navigate to any application 136 in a set of applications that are optionally executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen 112.

[0177] In some embodiments, the device 100 includes a touch screen 112, a menu button 204, a push button 206 for turning the device on / off and for locking the device, one or more volume adjustment buttons 208, a user identity module (SIM) card slot 210, an earphone jack 212, and a docking / charging external port 124. The push button 206 is optionally used to turn the device on / off by pressing the button and keeping the button in a pressed state for a predefined time interval; lock the device by pressing the button and releasing the button before the predefined time interval passes; and / or unlock the device or initiate an unlocking process. In an alternative embodiment, the device 100 also accepts voice input for activating or deactivating certain functions through a microphone 113. The device 100 also optionally includes one or more contact strength sensors 165 for detecting the strength of contact on the touch screen 112, and / or one or more tactile output generators 167 for generating tactile output for a user of the device 100.

[0178] Figure 3300 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments. The device 300 does not have to be portable. In some embodiments, the device 300 is a laptop, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a children's learning toy), a game system, or a control device (e.g., a home controller or an industrial controller). The device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, a memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuits (sometimes referred to as a chipset) that interconnect system components and control communications between system components. The device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touch screen display. The I / O interface 330 also optionally includes a keyboard and / or a mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 for generating tactile output on the device 300 (e.g., similar to the above reference Figure 1A The tactile output generator 167 described above), the sensor 359 (e.g., an optical sensor, an acceleration sensor, a proximity sensor, a touch sensitive sensor, and / or a contact intensity sensor (similar to the above reference Figure 1A Memory 370 optionally includes one or more storage devices located away from CPU 310. In some embodiments, memory 370 stores data related to portable multifunction device 100 ( Figure 1A ) or a subset thereof. In addition, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while portable multifunction device 100 ( Figure 1A )'s memory 102 optionally does not store these modules.

[0179] Figure 3Each element in the above-mentioned elements in is optionally stored in one or more memory devices of the previously mentioned memory device. Each module in the above-mentioned modules corresponds to the instruction set for performing the function described above. The above-mentioned modules or computer programs (for example, instruction sets or including instructions) do not have to be realized with independent software programs (such as computer programs (for example, including instructions)), processes or modules, and therefore the various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores the subset of the above-mentioned modules and data structures. In addition, memory 370 optionally stores additional modules and data structures not described above.

[0180] Attention is now turned to an embodiment of a user interface that is optionally implemented on, for example, portable multifunction device 100.

[0181] Figure 4A An exemplary user interface of an application menu on portable multifunction device 100 according to some embodiments is illustrated. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:

[0182] ● Signal strength indicators 402 for wireless communications such as cellular signals and Wi-Fi signals;

[0183] ●Time 404;

[0184] ●Bluetooth indicator 405;

[0185] ●Battery status indicator 406;

[0186] A tray 408 with icons for commonly used applications, such as:

[0187] o An icon 416 of the phone module 138 labeled "Phone," which optionally includes an indicator 414 of the number of missed calls or voicemails;

[0188] o an icon 418 of the email client module 140 labeled “Mail”, which optionally includes an indicator 410 of the number of unread emails;

[0189] o An icon 420 labeled "Browser" of the browser module 147; and

[0190] o An icon 422 labeled “iPod” for the video and music player module 152 (also referred to as the iPod (trademark of Apple Inc.) module 152); and

[0191] ● Icons for other apps, such as:

[0192] o Icon 424 labeled "Message" of IM module 141;

[0193] o An icon 426 labeled “Calendar” of the calendar module 148;

[0194] o Icon 428 labeled “Photos” of the image management module 144;

[0195] o An icon 430 labeled “Camera” of the camera module 143;

[0196] ○ Icon 432 labeled “Online Video” of the online video module 155;

[0197] ○ Icon 434 labeled “Stock Market” of the Stock Market Widget 149 - 2 ;

[0198] o An icon 436 labeled “Map” of the map module 154;

[0199] ○ Icon 438 labeled “Weather” of the weather widget 149-1;

[0200] ○ Icon 440 labeled as “Clock” of the alarm clock widget 149 - 4 ;

[0201] o An icon 442 labeled “Fitness Support” of the fitness support module 142;

[0202] o An icon 444 labeled "Notes" of the notes module 153; and

[0203] o An icon 446 of a settings application or module labeled “Settings” that provides access to settings for the device 100 and its various applications 136 .

[0204] It should be noted that Figure 4A The illustrated icon labels are exemplary only. For example, the icon 422 of the video and music player module 152 is labeled "Music" or "Music Player". Other labels are optionally used for various application icons. In some embodiments, the label of the corresponding application icon includes the name of the application corresponding to the corresponding application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.

[0205] Figure 4B The example embodiment has a touch-sensitive surface 451 (eg, touch screen display 112) that is separate from a display 450 (eg, touch screen display 112). Figure 3 tablet computer or touch pad 355) device (e.g., Figure 3Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) for detecting intensity of contacts on touch-sensitive surface 451 and / or one or more tactile output generators 357 for generating tactile output for a user of device 300.

[0206] Although some of the examples below are given with reference to input on a touch screen display 112 (where a touch-sensitive surface and a display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, such as Figure 4B In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a main axis (e.g., Figure 4B 453) corresponding to the principal axis (for example, Figure 4B According to these embodiments, the device detects a position corresponding to a corresponding position on the display (e.g., Figure 4B 460 corresponds to 468 and 462 corresponds to 470) in contact with touch-sensitive surface 451 (e.g., Figure 4B Thus, when the touch-sensitive surface (e.g., Figure 4B 451) and a display of a multi-function device (e.g., Figure 4B When the user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is separated, the device is used to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.

[0207] Additionally, although the following examples are primarily given with reference to finger inputs (e.g., finger contacts, single-finger tap gestures, finger swipe gestures), it should be understood that in some embodiments, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). As another example, a tap gesture is optionally replaced by a mouse click when the cursor is over the location of the tap gesture (e.g., instead of detecting contact, followed by ceasing to detect contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or a mouse and finger contact are optionally used simultaneously.

[0208] Figure 5AAn exemplary personal electronic device 500 is illustrated. Device 500 includes a body 502. In some embodiments, device 500 may include components related to devices 100 and 300 (e.g., Figures 1A to 4B ) some or all of the features described in the foregoing. In some embodiments, device 500 has a touch-sensitive display screen 504, referred to hereinafter as touch screen 504. Alternatively, or in addition to touch screen 504, device 500 also has a display and a touch-sensitive surface. As with devices 100 and 300, in some embodiments, touch screen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors for detecting the intensity of contact (e.g., touch) applied. One or more intensity sensors of touch screen 504 (or touch-sensitive surface) can provide output data representing the intensity of touch. The user interface of device 500 can respond to touch based on the intensity of the touch, which means that touches of different intensities can invoke different user interface operations on device 500.

[0209] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related patent applications: International patent application serial number PCT / US2013 / 040061, entitled “Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application,” filed on May 8, 2013, published as WIPO patent publication number WO / 2013 / 169849; and International patent application serial number PCT / US2013 / 069483, entitled “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships,” filed on November 11, 2013, published as WIPO patent publication number WO / 2014 / 105276, each of which is hereby incorporated by reference in its entirety.

[0210] In some embodiments, the device 500 has one or more input mechanisms 506 and 508. The input mechanisms 506 and 508 (if included) can be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, the device 500 has one or more attachment mechanisms. Such attachment mechanisms (if included) can allow the device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watchbands, bracelets, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow the user to wear the device 500.

[0211] Figure 5B An exemplary personal electronic device 500 is depicted. In some embodiments, the device 500 may include information about Figure 1A , Figure 1B and Figure 3 Some or all of the components described. Device 500 has a bus 512 that operatively couples an I / O portion 514 to one or more computer processors 516 and a memory 518. I / O portion 514 may be connected to a display 504, which may have a touch-sensitive component 522 and optionally an intensity sensor 524 (e.g., a contact intensity sensor). In addition, I / O portion 514 may be connected to a communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, input mechanism 506 is optionally a rotatable input device or a depressible input device and a rotatable input device. In some examples, input mechanism 508 is optionally a button.

[0212] In some examples, input mechanism 508 is optionally a microphone. Personal electronic device 500 optionally includes various sensors, such as GPS sensor 532, accelerometer 534, orientation sensor 540 (e.g., compass), gyroscope 536, motion sensor 538, and / or combinations thereof, all of which are operably connected to I / O portion 514.

[0213] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, may cause the computer processors to perform the techniques described below, including processes 700, 800, 1000, 1200, and 1400 ( Figure 7 , Figure 8 , Fig.10 , Fig.12 and Fig.14). Computer-readable storage media can be any medium that can tangibly contain or store computer-executable instructions for use by or in conjunction with instruction execution systems, devices, and apparatuses. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and persistent solid-state memories such as flash memory, solid-state drives, and the like. Personal electronic device 500 is not limited to Figure 5B Rather, the components and configurations may include other components or additional components in a variety of configurations.

[0214] As used herein, the term "indicative representation" refers to an optional feature of the apparatus 100, 300, and / or 500 ( Figure 1A , Figure 3 and FIG. 5A to FIG. 5B ) is a user-interactive graphical user interface object displayed on a display screen of a computer. For example, an image (e.g., an icon), a button, and text (e.g., a hyperlink) optionally each constitute an affordance.

[0215] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface that a user is interacting with. In some implementations that include a cursor or other position marker, the cursor acts as a "focus selector" such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), a focus selector is displayed on a touch-sensitive surface (e.g., Figure 3 Touchpad 355 or Figure 4B In the event that an input (e.g., a press input) is detected on the touch-sensitive surface 451 in the display, the particular user interface element is adjusted according to the detected input. In the case that a touch-screen display (e.g., Figure 1A A touch-sensitive display system 112 or Figure 4AIn some implementations of the touch screen 112 in FIG. 1 , a contact detected on the touch screen acts as a "focus selector" such that when an input (e.g., a press input by the contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touch screen display, the particular user interface element is adjusted in accordance with the detected input. In some implementations, the focus moves from one area of ​​the user interface to another area of ​​the user interface without corresponding movement of a cursor or movement of a contact on the touch screen display (e.g., by using a tab key or arrow keys to move the focus from one button to another); in these implementations, the focus selector moves in accordance with the movement of the focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is typically a user interface element (or contact on the touch screen display) that is controlled by the user to deliver the user's intended interaction with the user interface (e.g., by indicating to the device the element of the user interface with which the user desires to interact). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen), the position of a focus selector (e.g., a cursor, contact, or selection box) over a corresponding button will indicate that the user intends to activate the corresponding button (rather than other user interface elements shown on the device display).

[0216] As used in this specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of a contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected during a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted off, before or after contact starts to move, before contact ends, before or after the intensity of the contact is detected to be increased, and / or before or after the intensity of the contact is detected to be reduced). The characteristic intensity of a contact is optionally based on one or more of the following: the maximum value of the intensity of the contact, the mean value of the intensity of the contact, the average value of the intensity of the contact, the value at the top 10% of the intensity of the contact, the half-maximum value of the intensity of the contact, the 90% maximum value of the intensity of the contact, etc. In some embodiments, the duration of the contact is used when determining the characteristic intensity (e.g., when the characteristic intensity is the average value of the intensity of the contact over time). In some embodiments, the feature strength is compared to a set of one or more strength thresholds to determine whether the user has performed an operation. For example, the set of one or more strength thresholds optionally includes a first strength threshold and a second strength threshold. In this example, a contact whose feature strength does not exceed the first threshold results in a first operation, a contact whose feature strength exceeds the first strength threshold but does not exceed the second strength threshold results in a second operation, and a contact whose feature strength exceeds the second threshold results in a third operation. In some embodiments, a comparison between the feature strength and one or more thresholds is used to determine whether to perform one or more operations (e.g., whether to perform the corresponding operation or to abandon the corresponding operation) rather than to determine whether to perform the first operation or the second operation.

[0217] As used herein, an "installed application" refers to a software application that has been downloaded to an electronic device (e.g., device 100, 300, and / or 500) and is ready to be launched (e.g., become open) on the device. In some embodiments, a downloaded application becomes an installed application using an installer that extracts program portions from a downloaded software package and integrates the extracted portions with the operating system of a computer system.

[0218] As used herein, the term "open application" or "executing application" refers to a software application that has retained state information (e.g., as part of device / global internal state 157 and / or application internal state 192). An open or executing application is optionally any of the following types of applications:

[0219] ● The active app currently displayed on the display of the device on which the app is being used;

[0220] ● Background applications (or background processes) that are not currently displayed but for which one or more processes are being processed by one or more processors; and

[0221] ●Not running but has data stored in memory (volatile and non-volatile respectively)

[0222] A suspended or dormant application that contains status information that can be used to resume execution of the application.

[0223] As used herein, the term "closed application" refers to a software application that does not have retained state information (e.g., the state information of a closed application is not stored in the memory of the device). Therefore, closing an application includes stopping and / or removing the application process of the application and removing the state information of the application from the memory of the device. Generally speaking, when in a first application, opening a second application does not close the first application. When the second application is displayed and the first application stops being displayed, the first application becomes a background application.

[0224] Attention is now turned to embodiments of a user interface ("UI") and associated processes implemented on an electronic device, such as portable multifunction device 100, device 300, or device 500.

[0225] FIG. 6A to FIG. 6M An exemplary user interface for managing one or more portions of a media representation according to some embodiments is illustrated. FIG. 6A to FIG. 6M The user interface in is used to illustrate the process described below, including Figure 7 and Figure 8 process.

[0226] Fig. 6A A computer system 600 is shown displaying a web browser user interface. The web browser user interface includes a browser control area 602, a browser display area 604, and a browser control area 606. The browser control area 602 includes an address field 602a in which a website address can be entered so that the computer system 600 can navigate to the website. The browser display area 604 is located between the application control areas 602 and 606. Fig. 6A , computer system 600 is currently displaying a media representation 610 on a web page having a web address that includes "example.com" (e.g., as shown in address field 602a in browser display area 604). Fig. 6A As shown, media representation 610 depicts subject 610a (e.g., a cat) and subject 610b (e.g., a lizard) in a physical environment. Media representation 610 includes background 610c (e.g., Fig. 6AThe browser control area 606 includes one or more controls for interacting with a web browser application corresponding to a web browser user interface. The browser control area 606 includes a back control 606a (e.g., wherein in response to detecting a selection of the back control 606a, the computer system 600 displays a web page of a previously visited web address in a first direction in a queue of recently visited web addresses), a forward control 606b (e.g., wherein in response to detecting a selection of the forward control 606b, the computer system 600 displays a web page of a previously visited web address in a second direction in a queue of recently visited web addresses), a share control 606c (e.g., wherein in response to detecting a selection of the share control 606c, the computer system 600 initiates a process for sharing visual content from a web address), a history control 606d (e.g., wherein in response to detecting a selection of the history control 606d, the computer system 600 displays a list of previously visited web addresses), and a navigation control 606e (e.g., wherein in response to detecting a selection of the navigation control 606e, the computer system 600 displays one or more objects for navigating to a different previously displayed web page). In some embodiments, computer system 600 includes one or more components of electronic devices 100, 300, and / or 500. Fig. 6A , the computer system 600 detects a tap input 650a1 on the sharing control 606c (e.g., pointing to the sharing control and / or at a location corresponding to the sharing control) or a press and hold input 650a2 on the media representation 610 (e.g., pointing to the media representation and / or at a location corresponding to the media representation). In some embodiments, the tap input 650a1 and / or the press and hold input 650a2 (as well as other inputs described below) can be one or more other inputs, such as a mouse click and / or a hover input (e.g., a mouse hovering over a particular location).

[0227] like Figure 6B As shown, in response to detecting input 650a1 on sharing control 606c (or in some embodiments, pressing and holding input 650a2), computer system 600 displays sharing user interface 616. Sharing user interface 616 includes exit control 616a (e.g., where in response to detecting input pointing to exit control 616a, computer system 600 stops displaying sharing user interface 616, and in some embodiments, redisplays Fig. 6A), a web browser user interface of the computer system 600, a sharing with users region 622, a sharing via applications region 624, and a control menu 626. The media representation 620 is a version of the media representation 610 (e.g., a thumbnail representation of the media representation 610 and / or a reduced size version of the media representation 610). The media representation 620 includes a subject 610a (e.g., a cat) and a subject 610b (e.g., a lizard) in a physical environment (e.g., including a background 610c), which are also included in the media representation 610. The sharing with users region 622 includes a group of sharing controls (e.g., 622a-622d), which, when a single sharing control in the group of sharing controls is selected, causes the computer system 600 to share the media representation 620 with one or more computer systems and / or accounts associated with the single sharing control. Figure 6B As shown, the sharing with users area 622 includes a sharing control 622a with David (e.g., wherein in response to detecting input directed to the sharing control 622a with David, the computer system 600 shares the media representation 620 with an account and / or computer system associated with a user named "DavidAppleseed"), a sharing control 622b with climbers (e.g., wherein in response to detecting input directed to the sharing control 622b with climbers, the computer system 600 shares the media representation 620 with an account and / or computer system associated with a user and / or user group named "climbers"), a sharing control 622c with Sarah (e.g., wherein in response to detecting input directed to the sharing control 622c with Sarah, the computer system 600 shares the media representation 620 with an account and / or computer system associated with a user named "Sarah Apples"), and a sharing control 622d with Andrew (e.g., wherein in response to detecting input directed to the sharing control 622d with Andrew, the computer system 600 shares the media representation 620 with an account and / or computer system associated with a user and / or user group named "Andrew"). Casey) Figure 6BAs shown, in response to the computer system 600 detecting the selection of a single sharing control, the computer system 600 displays each of the sharing controls with an indication of the application and / or mechanism (e.g., transfer mechanism indications 622a1 and / or 622a2) indicating the application and / or mechanism with which the computer system 600 will share the media representation 620. For example, in response to detecting input directed to share with David control 622a, the computer system 600 shares the media representation 620 via a communication protocol application (e.g., Bluetooth and / or a wireless protocol application), as indicated by transfer mechanism indication 622a1. In response to detecting input directed to share with climber control 622b, the computer system 600 shares the media representation 620 via a messaging application, as indicated by transfer mechanism indication 622b1. The sharing via application area 624 includes a group of sharing controls (e.g., 624a-624d) that, when selected, cause the computer system 600 to send the media representation 620 to the application corresponding to the selected single sharing control. As shown Figure 6B As shown, the sharing area 624 via applications includes sharing via a delivery control 624a (e.g., wherein in response to detecting input directed to the delivery sharing control 624a, the computer system 600 initiates a process of sharing the media representation 620 via a communication protocol application), sharing via a message control 624b (e.g., wherein in response to detecting input directed to the message sharing control 624b, the computer system 600 initiates a process of sharing the media representation 620 via a messaging application such as a text messaging application), sharing via a mail control 624c (e.g., wherein in response to detecting input directed to the mail sharing control 624c, the computer system 600 initiates a process of sharing the media representation 620 via an email messaging application), and sharing via a chat control 624d (e.g., wherein in response to detecting input directed to the chat sharing control 624d, the computer system 600 initiates a process of sharing the media representation 620 via a chat application).

[0228] like Figure 6B As shown, the control menu 626 includes a copy photo control 626a and a copy subject control 626b. The copy photo control 626a is a control that, when selected, causes the computer system 600 to copy the media representation 620 (e.g., the subject 610a-610b and the background 610c) (e.g., copy the data corresponding to the media representation 620 into a copy buffer), and the copy subject control 626b is a control that, when selected, causes the computer system 600 to copy the subject 610a-610b of the media representation 610 but not the background 610c (e.g., copy the data corresponding to the subject 610a-610b but not the data corresponding to the background 610c into a copy buffer). Figure 6BAs shown, in response to detecting input 650a1, computer system 600 also displays a remove background control 614 including background status indication 614a. Figure 6B , background status indication 614a indicates (e.g., via a check mark in background status indication 614a) that computer system 600 is currently displaying media representation 620, such that media representation 620 includes background 610c. Figure 6B , the computer system 600 displays a copy subject control 626b and removes a background control 614 (e.g., including a background status indication 614a) because it has been determined that the media representation 620 (or the media representation 610 and / or the media items represented by the media representation 610 and / or the media representation 620) includes at least one subject (e.g., subjects 610a-610b). In addition, the computer system 600 also displays a copy subject control 626b because it has been determined that the media representation 620 includes two or more subjects (e.g., subjects 610a-610b). In some embodiments, the computer system 600 displays the copy subject control based on determining that the media representation (and / or the media items represented by the media representation) includes one subject (rather than multiple subjects). In some embodiments, the subject is a person, an animal, and / or an object. In some embodiments, in response to detecting an input pointing to the copy subject control 626b, the computer system 600 copies the background 610c of the detected subject but does not copy the media representation 610. In some embodiments, when it is determined that the media representation does not include at least one subject, the computer system 600 does not display the remove background control 614, the copy subject control 626b, or the copy subject control. In some embodiments, the computer system 600 displays the copy photo control 626a, regardless of whether the determination is made based on the inclusion of at least one subject in the media representation. Figure 6B In the embodiment, the computer system 600 detects a tap input 650b on the remove background information control 614a. In some embodiments, as part of detecting the tap input 650b on the remove background control 614a, the computer system 600 detects an input on the update background status indication 614a.

[0229] like Figure 6C As shown, in response to detecting the tap input 650b, the computer system 600 Figure 6C Media said 620 removed Figure 6B Therefore, in Figure 6C , media representation 620 includes subjects 610a-610b but does not include Figure 6B In addition, the computer system 600 updates the background status indication 614a (e.g., Figure 6CThe background status indication 614a of FIG. 6 shows no check mark in the background status indication 614a to indicate that the computer system 600 has removed the background 610 from the media representation 620. Figure 6C In response to the computer system 600 detecting a shared control (e.g., as described above with respect to Figure 6B The computer system 600 shares the main body 610a-610b with one or more computer systems and / or applications but does not include the input on the one or more shared controls) Figure 6B In some embodiments, in response to detecting a tap input 650c1 on the removed background 614, the computer system 600 redisplays the media representation 620 of the background 610c. Figure 6B The user interface and / or display media representation 620 includes the main body 610a-610b and the background 610c. In some embodiments, in response to detecting the tap input 650c2 on the exit control 616a, the computer system 600 redisplays Fig. 6A The user interface (e.g., background 610c is removed from Fig. 6A Media said 610 removed). Review Fig. 6A , the computer system 600 alternatively (eg, as an alternative to detecting the tap input 650a1 ) detects a press and hold input 650a2 on the media representation 610 .

[0230] like Fig.6D As shown, in response to detecting press and hold input 650a2 (or in some embodiments, tap input 650a1), computer system 600 displays media representation 612 and menu 636. Media representation 612 is a version of media representation 610 (e.g., a reduced size version of media representation 610). In response to detecting press and hold input 650a2, computer system 600 displays media representation 612 and menu 636 using the same method as described above with respect to FIG. 6B to FIG. 6C One or more similar techniques described above display a remove background control 614 including a background status indicator 614a above the media representation 610. The menu 636 includes a copy photo control 626a and a copy subject control 626b, and the computer system 600 uses the above-mentioned FIG. 6B to FIG. 6C Menu 636 also includes other controls, such as a share control 636d (wherein in response to detecting input directed to the share control 636d, the computer system 600 displays Figure 6B), an add to photos control 636e (e.g., wherein in response to detecting input directed to the add to photos control 636e, the computer system 600 adds the currently displayed media representation 612 to a gallery of media items), a copy body for later use control 636f (e.g., wherein in response to detecting input directed to the copy body for later use control 636f, the computer system 600 copies the bodies 610a-610b and saves one or more graphic objects including body 610a without background 610c and body 610b without background 610c), and a find control 636g (e.g., wherein in response to detecting input directed to the find control 636g, the computer system 600 initiates a process of providing additional information corresponding to the media representation 612 (e.g., location information of the captured media item, the file size of the representation of the media item, and / or one or more media items associated with the media item)). In some embodiments, in response to detecting input 650d2 on the copy body control 626b, the computer system 600 copies the bodies 610a-610b to the copy buffer (or one or more applications) but does not copy the body 610c to the copy buffer (or one or more applications). In some embodiments, in response to detecting input 650d3 directed to the copy body for later use control 636f, the computer system 600 saves one or more files including the body 610a without the background 610c and the body 610b without the background 610c so that the body 610a can be accessed via keyboard input (e.g., such as described below). Figure 6G The computer system 600 may select a representation (e.g., a graphical object) of the subject 610a (e.g., without the background 610) and / or a representation (e.g., a graphical object) of the subject 610b (e.g., without the background 610) by inputting on a keyboard in the keyboard area 632 of the computer system 600. In some embodiments, the computer system 600 may reduce and display the media representation 612 and the menu 636 when displaying the media representation 612 and the menu 636. Fig. 6A One or more portions of a browser application (e.g., such as text in a browser display area 604) where media representations 612 and menus 636 are relative to Fig. 6A In some embodiments, in response to detecting input directed to remove background control 614, computer system 600 stops displaying background 610 and continues to display subject 610a-610b as part of media representation 612. Fig.6D , the computer system 600 detects a press and hold input 650d1 on the subject 610a (eg, a cat) and / or a tap input 650d2 on the replica subject control 626b.

[0231] like Fig. 6EAs shown, in response to detecting a press and hold input 650d1 and / or a tap input 650d2 of a copy body control 626b, the computer system 600 displays a copy body control 628a and a share control 628b, wherein the copy body control 628a and the share control 628b are associated with the body 610a instead of the body 610b. Here, the copy body control 628a and the share control 628b are associated with the body 610a instead of the body 610b because the computer system 600 detects a press and hold input 650d1 on the body 610a. If the computer system 600 detects a press and hold input 650d1 on the body 610c, the computer system 600 will display the copy body control and the share control associated with the body 610b instead of the body 610a. Fig. 6E In response to detecting a tap input 650e1 on the copy body control 628a, the computer system 600 copies the body 610a to the copy buffer but does not copy the body 610b and the background 610c to the copy buffer. Fig. 6E In response to detecting a tap input 650e2 on a sharing control 628b, the computer system 600 initiates a process (e.g., a process such as one or more of the processes described above with respect to sharing controls on a sharing user interface 616 (in some embodiments, without displaying the sharing user interface 616) and / or a process including displaying the sharing user interface 616) of sharing a representation of the subject 610a without sharing representations of the subject 610b and the background 610c. Fig. 6E As shown, in response to detecting a press and hold input 650d1 and / or a tap input 650d2, the computer system 600 weakens the background 610c relative to the subjects 610a-610b (e.g., grays it out). In some embodiments, in response to detecting a press and hold input 650d and / or a tap input 650d2, the computer system 600 weakens the background 610c and the subject 610b relative to the subject 610a. In some embodiments, as part of weakening the background 610c and the subject 610b relative to the subject 610a, the computer system 600 determines and selects a boundary between the subject 610a and the background 610c. In some embodiments, in response to detecting a press and hold input and / or a tap input 650d2 directed to the subject 610b, the computer system 600 weakens the background 610c and the subject 610a relative to the subject 610b. Fig. 6E , while continuing to detect the press and hold input 650d1, the computer system 600 moves the press and hold input 650d1 to the right.

[0232] like Fig. 6FAs shown, in response to detecting rightward movement of press and hold input 650d1 (e.g., and while continuing to detect press and hold input 650d), computer system 600 displays reduced-size representation 610a1 and moves reduced-size representation 610a1 on the display of computer system 600 based on the movement of press and hold input 650d1. Reduced-size representation 610a1 is a representation of subject 610a, and reduced-size representation 610a1 is smaller than the representation of subject 610a currently displayed as part of media representation 612. Fig. 6F As shown, in response to detecting the rightward movement of the press and hold input 650d1, the body 610b does not move and the reduced size representation of the body 610b is not displayed. In some embodiments, the reduced size representation 610a1 includes a representation of the body 610a and the background 610c. In some embodiments where the reduced size representation 610a1 includes a representation of the body 610a and a representation of the background 610c, the representation of the background 610 is weakened relative to the representation of the background 610c in the reduced size representation 610a1. In some embodiments, in response to detecting the rightward movement of the press and hold input 650d1, the computer system 600 moves the display of the body 610a on the display of the computer system 600. In some embodiments, in response to detecting the rightward movement of the press and hold input 650d1 (or another input pointing to the body 610b), the computer system 600 displays the reduced size representation of the body 610b and moves the reduced size representation of the body 610b on the display of the computer system 600. In some embodiments, in response to detecting one or more inputs, the computer system 600 moves the subjects 610a-610b (and / or moves reduced-size representations of the subjects 610a-610b on the display of the computer system 600). In some embodiments, when the press and hold input 650d1 is detected, one or more of the subjects 610a-610b are visually attenuated relative to the reduced-size representation 610a1. In some embodiments, in response to detecting a lift-off of the press and hold input 650d1, the computer system 600 displays the subject 610a at a location on the media representation 612 where the computer system 600 detected the press and hold 650d1 before the lift-off of the press and hold input 650d1 was detected (e.g., a location in a second portion of the media representation 612 that initially did not include the subject 610a). In some embodiments, in response to detecting a lift-off of the press and hold input 650d1, the computer system 600 stops attenuating the background relative to the subject 610a and / or the subject 610b. In some embodiments, in response to detecting the release of the press and hold input 650d1, the computer system 600 stops displaying the reduced size representation 610a1. Fig. 6F, while continuing to detect the press and hold input 650d1, the computer system 600 detects a downward movement of the press and hold input 650d1.

[0233] like Figure 6G As shown, in response to detecting the downward movement of the press and hold input 650d1, the computer system 600 displays a note-taking application including a note content area 630 and a keyboard area 632. Figure 6G As shown, in response to detecting the downward movement of the press and hold input 650d1 (eg, the size reduction representation 610a1 has been dragged to the note content area 630), the computer system 600 displays the size reduction representation 610a1 in the note content area 630. Figure 6G In FIG. 6 , the computer system 600 detects the lift of the press and hold input 650d1. Figure 6H As shown, in response to detecting the release of the press and hold input 650d1, the computer system 600 displays the representation 630a, wherein the representation 630a is Fig.6D The subject 610a in the media representation 612 of . Figure 6H , representation 630a continues to be displayed as part of the note-taking application when computer system 600 detects one or more other inputs and / or after detecting a lift of press and hold input 650d1. FIG. 6D to FIG. 6H As described, computer system 600 may copy one or more bodies from one portion of an application to another portion of an application and / or to a different application based on detecting one or more inputs.

[0234] FIG. 6I to FIG. 6M A computer system 690 is illustrated that displays a copy subject control and / or removes a background control. FIG. 6I to FIG. 6M In some embodiments, computer system 690 is a laptop and is a different computer system than computer system 600, which is a phone. In some embodiments, computer system 690 includes one or more components of electronic devices 100, 300, and / or 500. In some embodiments, computer system 690 is the same as computer system 600. In some embodiments, computer system 690 performs the operations described above with respect to 6A to 6H In some embodiments, the computer system 600 performs one or more techniques and / or operations as described above with respect to FIG. 6I to FIG. 6M In some embodiments, the computer system displays a copy body control and / or removes a background control, and the copy body control and / or removes a background control are directed to the user in the context of the user being associated with the computer system 690. FIG. 6A to FIG. 6MThe application performs one or more operations on a media representation displayed in a different application (e.g., a photo editing application, a camera application, and / or a file manager application). In some embodiments, the computer system uses the media representation displayed in the different applications (e.g., a photo editing application, a camera application, and / or a file manager application). FIG. 6A to FIG. 6M One or more of the techniques described above are used to display a copy subject control and / or remove a background control, and in view of the copy subject control and / or the removal of the background control, one or more operations are performed for video media, photo media, previously captured media, live media, and / or live preview media (e.g., media currently being captured and / or visual content within the field of view of one or more cameras of the computer system). In some embodiments, when the computer system removes the background and / or the copy subject from the media representation, the computer system modifies the media representation and modifies the data of the underlying media item represented by the media representation (e.g., only the displayed media representation). In other embodiments, when the computer removes the background and / or the copy subject from the media representation, the computer system modifies the underlying data of the underlying media item.

[0235] like Fig.6I As shown, computer system 690 displays a user interface including media representation 642 and menu 646. Media representation 642 is a version of media representation 610 (e.g., as described above with respect to Fig. 6A ), wherein media representation 610 includes body 610a-610b and background 610. Menu 646 is a tool menu and includes copy option 646a, copy body control 626b, emphasize body control 646b, and remove background control 674, as well as other controls for editing media. In some embodiments, in response to detecting pointing to a tool option (e.g., Fig.6I ), the computer system 600 displays a menu 646. Fig.6I In response to detecting input on the copy option 646a, the computer system 690 copies the media representation 642 (e.g., the bodies 610a-610b and the background 610c) (e.g., to copy data corresponding to the media representation 620 into a copy buffer).

[0236] exist Fig.6I In response to detecting input on the copy body control 626b, the computer system 690 copies the bodies 610a-610b but does not copy the background 610c (e.g., and using the same method as described above with respect to 6A to 6H One or more of the techniques described above). Fig.6I In response to detecting input on the emphasize subject control 646b, the computer system 690 updates the representation 642 to emphasize the subject 610a and / or the subject 610b relative to the background 610c. Fig.6IIn response to detecting input on the remove background control 674, the computer system 690 updates the representation 642 to include the subjects 610a-610b but not the background 610c (e.g., and using the method described above with respect to 6A to 6H One or more techniques described in removing background controls 614). Fig.6I As shown, computer system 690 displays media representation 642 such that subjects 610a-610b are emphasized relative to background 610c (e.g., as indicated by Fig.6I 610c in FIG. 1 ). Fig.6I , the computer system 690 emphasizes the subjects 610a-610b relative to the background 610c because the cursor 680 is within a predetermined distance (e.g., 0.1 cm to 5 cm) from the replicated subject control 626b and / or is on the replicated subject control for a predetermined period of time (e.g., 0.05 seconds to 5 seconds). In some embodiments, in response to detecting that the cursor 680 is within a predetermined distance (e.g., 0.1 cm to 5 cm) from the emphasized subject control 646b and / or is on the emphasized subject control for a predetermined period of time (e.g., 0.05 seconds to 5 seconds), the computer system 690 displays the representation 642 such that the background 610c is removed from the media representation 642. In some embodiments, in response to detecting that the cursor 680 is within a predetermined distance (e.g., 0.1 cm to 5 cm) from the remove background control 674 and / or is on the remove background control for a predetermined period of time (e.g., 0.05 seconds to 5 seconds), the computer system 690 displays the representation 642 such that the background 610c is removed from the media representation 642. Fig.6I In FIG. 6 , the computer system 690 detects the movement of the cursor 680. Figure 6J In response to detecting the movement of the cursor 680, it is determined that the cursor 680 is no longer within a predetermined distance from the replica body control 626b and / or on the replica body control (e.g., for a predetermined period of time (e.g., 1 second to 5 seconds)). Figure 6J As shown, the computer system 690 stops emphasizing the bodies 610a-610b relative to the background 610c (e.g., as indicated by the background 610c not being grayed out) because it is determined that the cursor 680 is no longer within a predetermined distance from and / or over the replica body control 626b (e.g., for longer than a predetermined period of time).

[0237] Figure 6K A computer system 690 is illustrated that displays a file manager user interface that includes a file navigation panel 654 and media icons 658. The media icons 658 include a landscape icon 658a (e.g., corresponding to a photo of a media item that looks like the image included with the landscape icon 658a), a food icon 658b (e.g., corresponding to a photo of a media item that looks like the image included with the food icon 658b), a park icon 658c (e.g., corresponding to a park icon that also corresponds to Fig. 6A ) and a favorites icon 658d (e.g., a video corresponding to a frame of a video that looks like an image included with the favorites 658d). Figure 6K As shown, computer system 690 displays icon 658 as the contents of a folder (e.g., "Project Files"). Figure 6K , the computer system 690 detects one or more inputs (e.g., click inputs) including pointer activation 650k (e.g., a left mouse click (and in some embodiments, a trackpad click), a right mouse click, and / or a press and hold mouse click).

[0238] like Figure 6L As shown, in response to detecting one or more inputs including pointer activation 650k, computer system 690 displays menu 656 including copy document 656a (which, when selected, causes computer system 690 to copy park icon 658c to a copy buffer), copy body control 626b, highlight body control 646b, and remove background control 674. Figure 6L As shown, in response to detecting one or more inputs including pointer activation 650k and in response to detecting that cursor 680 is within a predetermined distance (e.g., 0.1 cm to 5 cm) from background removal control 674 and / or is on the background removal control for a predetermined period of time (e.g., 0.05 seconds to 5 seconds), computer system 690 modifies park icon 658c so that park icon 658c is displayed with subjects 610a-610b but without background 610c. Figure 6L In the example of FIG. 6 , the computer system 650 detects pointer activation 6501. Figure 6M As shown, in response to detecting pointer activation 6501, computer system 690 continues to display park icon 658c such that park icon 658c is displayed with subjects 610a-610b but without background 610c. Figure 6M As shown, the computer system 690 displays the file manager user interface after detecting the pointer activation input on the landscape icon 658a. Figure 6M In some embodiments, in response to detecting a pointer activation input on a landscape icon 658a, the computer system 690 displays a menu 656, wherein the menu 656 does not include a copy subject control 626b, an emphasis subject control 646b, and a remove background control 674, because the media item represented by the landscape icon 658a (and / or an image that is part of the landscape icon 658a) does not include at least one subject. Therefore, in some embodiments, the computer system does not display one or more controls for copying a subject in a corresponding media representation, emphasizing a subject in the corresponding media representation, and / or removing the background of the corresponding media representation when at least one subject has not been detected in the corresponding media representation.

[0239] Figure 7 700 is a flowchart illustrating a method for managing the background of a media representation according to some embodiments. Method 700 is performed at a computer system (e.g., 100, 300, 500, and / or 600) (e.g., a smart phone, a desktop computer, a laptop, a tablet computer) that communicates with a display generation component (e.g., a display controller, a touch-sensitive display system). In some embodiments, the computer system communicates with one or more input devices (e.g., a touch-sensitive surface). Some operations in method 700 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0240] As described below, method 700 provides an intuitive way to manage the context of a media representation. The method reduces the cognitive burden on the user to manage the context of a media representation, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling the user to manage the context of a media representation faster and more efficiently saves power and increases the time interval between battery charges.

[0241] The computer system detects (702) (e.g., via one or more input devices) a request to display a user interface (e.g., 650a1 and / or 650a2) that corresponds to (e.g., is associated with) a media item (as described above with respect to, for example, 610, 612, 620, 642, and / or 658a-658c) (e.g., photo media, video media) (e.g., live media, live preview (e.g., media corresponding to a representation of a field of view of one or more cameras that has not yet been captured (e.g., the current field of view)) (e.g., in response to detecting a request to capture media (e.g., detecting a selection of a shutter enable indication)) and / or previously captured media (e.g., media corresponding to a representation of a field of view of one or more cameras that has already been captured (e.g., a previous field of view), a media item that has been saved and can be accessed by a user at a later time, and / or a media representation that is displayed in response to receiving a gesture on a thumbnail representation of the media (e.g., in a media gallery)). In some embodiments, as part of detecting the request to display the user interface, the computer system detects the request to display the media item.

[0242] In response to detecting a request to display a user interface corresponding to a media item (e.g., 650a1 and / or 650a2), a computer system displays (704) a user interface corresponding to the media item via a display generation component, the display including: based on determining that a subject has been automatically detected in the media item (e.g., without user input identifying the subject), displaying (706) via the display generation component a first user interface object (e.g., 614, 614a, and / or 674) that, when selected, causes the computer system (e.g., 600) to change (e.g., remove) display of a portion (e.g., 610c) (e.g., the background) of the media item in a representation (e.g., 610, 612, 620, 642, and / or 658a-658c) of the media item without changing display of the subject (e.g., 610a-610b) in the representation of the media item; and based on determining that a subject has not been automatically detected in the media item, forgoing displaying (708) the first user interface object (e.g., as described above with respect to FIG. 6A to FIG. 6D and Figure 6M In some embodiments, the first user interface object is displayed simultaneously with the representation of the media item. In some embodiments, based on determining that the subject has not been automatically detected in the media item, the representation of the media item is displayed and / or continues to be displayed. In some embodiments, before detecting a request to display a user interface corresponding to the media item, the computer system displays the representation of the media item. In some embodiments, the media item includes (and / or is) an image or video (e.g., as described above with respect to FIG. 6I to FIG. 6M Selecting whether to display a first user interface object when specified conditions are met allows a computer system to automatically display a first user interface object when relevant (e.g., based on a subject automatically detected in a media item), which performs an operation without further user input when a set of conditions have been met and provides additional control options without cluttering the user interface.

[0243] In some embodiments, in response to detecting a request to display a user interface corresponding to a media item, a computer system displays a user interface corresponding to the media item (e.g., a user interface including 610, 612, 620, 642, and / or 658a-658c) via a display generation component, including: displaying a representation of the media item (e.g., 610, 612, 620, 642, and / or 658a-658c) (e.g., displaying a body and a portion of the media item) via the display generation component; and selecting (e.g., automatically and / or without intervening input and / or without detecting a request and automatically (e.g., after detecting a request to display the user interface)) a boundary between the portion of the media item and the body (e.g., 610a-610b) in the representation of the media item based on determining that a body has been automatically detected in the media item (e.g., as described above with respect to FIG. 6E to FIG. 6FIn some embodiments, based on determining that a subject has been automatically detected in the media item, the computer system displays a border. In some embodiments, based on determining that a subject has not been automatically detected in the media item, the computer system does not select and / or does not display a representation of a border. In some embodiments, the representation of the media item is displayed simultaneously with the first user interface object. Selecting a border between a portion of the media item in the representation of the media item and the subject when specified conditions are met allows the computer system to automatically distinguish between the portion of the media item in the representation of the media item and the subject in the representation of the media item, and visual feedback about the difference between the portion of the media item in the representation of the media item and the subject in the representation of the media item can be provided to the user to inform the user how the selection of the first user interface object will affect the representation of the media item, which performs an operation without further user input and provides visual feedback when a set of conditions have been met.

[0244] In some embodiments, based on determining that a subject has been automatically detected in the media item, the computer system displays a second user interface object (e.g., 626b and / or 628a) via the display generation component that, when selected, replicates the subject in the media item (e.g., 610a-610b) but does not replicate a portion of the media item (e.g., 610c). Selecting whether to display the second user interface object when specified conditions are met allows the computer system to automatically display the second user interface object when relevant (e.g., based on the subject automatically detected in the media item), which performs operations without further user input when a set of conditions have been met and provides additional control options without cluttering the user interface.

[0245] In some embodiments, a second user interface object (e.g., 626b and / or 628a) is displayed simultaneously with a third user interface object (e.g., 626a, 646a, and / or 656a) that, when selected, causes a computer system (e.g., 600) to copy a subject (e.g., 610a-610b) and a portion (e.g., 610c) of a media item. In some embodiments, the second user interface object and the third user interface object are displayed in a first menu (e.g., 636, 646, and / or 646) (e.g., a context menu and / or a menu for a particular application). In some embodiments, the menu includes the second user interface object and the third user interface object. In some embodiments, in response to detecting an input, such as a left mouse click, a press and hold input, and / or a tap input, the first menu, the first user interface object, and / or the second user interface object are provided in a first menu. In some embodiments, the third user interface object is displayed regardless of and / or regardless of determining that a subject is automatically detected in a media item. Displaying the second user interface object and the third user interface object simultaneously allows the computer system to provide multiple control options based on satisfying a set of specified conditions, which provides additional control options without cluttering the user interface.

[0246] In some embodiments, in response to detecting a request to display a user interface corresponding to a media item (e.g., 650a1 and / or 650a2), the computer system displays a user interface corresponding to the media item via a display generation component, the display including: based on determining that a subject has been automatically detected in the media item (e.g., 610a-610b), displaying a fourth user interface object (e.g., 636f and / or 646b) via the display generation component, the fourth user interface object, when selected, causing the computer system (e.g., 600) to visually emphasize (e.g., bold, highlight, increase and / or decrease size, fade in and out, and / or display a border) the subject relative to a portion of the media item. In some embodiments, based on determining that a subject has not been automatically detected in the media item, the computer system does not display (and / or abandons displaying) the fourth user interface object. In some embodiments, the fourth user interface object is displayed simultaneously with one or more of the first user interface object, the second user interface object, and the third user interface object. Selecting whether to display a fourth user interface object when specified conditions are met allows the computer system to automatically display a fourth user interface object when relevant (e.g., based on a subject automatically detected in a media item), which performs an operation when a set of conditions have been met without further user input and provides additional control options without cluttering the user interface.

[0247] In some embodiments, in response to detecting a request to display a user interface corresponding to a media item (e.g., 650a1 and / or 650a2), the computer system displays a user interface corresponding to the media item via a display generation component, the display including: based on determining that a subject has been automatically detected in the media item, displaying a fifth user interface object (e.g., 636f) via the display generation component, the fifth user interface object, when selected, causing the computer system (e.g., 600) to create a graphical user interface object (e.g., a sticker object, an animation, and / or an emoticon) that includes the subject (e.g., 610a-610b) but does not include a portion (e.g., 610c) of the media item. In some embodiments, based on determining that a subject has not been automatically detected in the media item, the computer system does not display the fifth user interface object. In some embodiments, the graphical user interface object can be shared and / or used in multiple applications (e.g., a text messaging application, an email application, and / or a keyboard application). In some embodiments, the graphical user interface object is displayed with one or more other graphical user interface objects before the graphical user interface object can be selected for use in one or more of the multiple applications. In some embodiments, two or more of the first user interface object, the second user interface object, the third user interface object, the fourth user interface object, and / or the fifth user interface object are displayed simultaneously. In some embodiments, two or more of the first user interface object, the second user interface object, the third user interface object, the fourth user interface object, and / or the fifth user interface object are displayed simultaneously in a menu (e.g., a context menu). Selecting to display the fifth user interface object when a specified condition is met allows the computer system to automatically display the fifth user interface object when relevant (e.g., based on a subject automatically detected in a media item), which performs an operation without further user input when a set of conditions have been met and provides additional control options without cluttering the user interface.

[0248] In some embodiments, a user interface corresponding to a media item is displayed in a browser associated with a media editing application (e.g., as described above in Figure 6J In and below Fig.11A ) (or a media viewing application) (e.g., an application including one or more selectable user interface objects for editing media) and a different corresponding application (e.g., Fig. 6A and / or Figures 6K to 6M Selecting whether to display the first user interface object in a user interface different from the media editing user interface when a specified condition is met allows the computer system to automatically display the first user interface object, thereby enabling the computer system to edit representations of media items in applications that are not constructed for the purpose of editing media and / or representations of media, which provides additional control options and expanded functionality to other applications.

[0249] In some embodiments, the corresponding application is a file manager application (e.g., Figures 6K to 6M Selecting whether to display the first user interface object in a user interface different from the media editing user interface when a specified condition is met allows the computer system to automatically display the first user interface object, thereby enabling the computer system to edit representations of media items in a file manager application that is not constructed for the purpose of editing media and / or representations of media, which provides additional control options and extended functionality to other applications.

[0250] In some embodiments, the corresponding application is a file viewer application (e.g., Figures 6K to 6M Selecting whether to display the first user interface object in a user interface different from the media editing user interface when a specified condition is met allows the computer system to automatically display the first user interface object, thereby enabling the computer system to edit representations of media items in a file viewer application that is not constructed for the purpose of editing media and / or representations of media, which provides additional control options and extended functionality to other applications.

[0251] In some embodiments, the corresponding application is a productivity application (e.g., FIG. 6G to FIG. 6H Selecting whether to display the first user interface object in a user interface different from the media editing user interface when a specified condition is met allows the computer system to automatically display the first user interface object, thereby enabling the computer system to edit representations of media items in productivity applications that are not constructed for the purpose of editing media and / or representations of media, which provides additional control options and expanded functionality to other applications.

[0252] In some embodiments, as part of detecting a request to display a user interface corresponding to media, the computer system detects a pointer activation event (e.g., 650k and / or 680) (e.g., a mouse click or a press input on a trackpad) (e.g., an alternative click (e.g., a right click / press, a two-finger click / press, an option click / press, and / or a shift click / press)). Detecting pointer activation events as part of detecting a request to display a user interface gives the user more control over the computer system by allowing the computer system to detect a request to display a user interface via detecting pointer activation events, which provides conditional control options without cluttering the user interface.

[0253] In some embodiments, as part of displaying a user interface via a display generation component, a computer system displays a representation of a media item (e.g., 610, 612, 620, 642, and / or 658a-658c) via the display generation component. In some embodiments, after detecting a request to display a user interface corresponding to the media item and while displaying the representation of the media item and the first user interface object, the computer system detects (e.g., 680) a first input directed to the first user interface object. In some embodiments, in response to detecting the first input directed to the first user interface object (e.g., 680) and based on determining that the first input has been directed to the first user interface object for more than a predetermined time period (e.g., 0.05 seconds to 5 seconds), the computer system displays an indication of a portion corresponding to the media item via the display generation component (e.g., as described above with respect to Fig. 6E and FIG. 6I to FIG. 6J In some embodiments, the indication corresponding to the portion of the media item does not correspond to the main body in the media item. In some embodiments, in response to detecting an input directed to a first user interface object and based on determining that the input has been directed to the first user interface object for less than a predetermined time period, the computer system does not display (abandons displaying) the indication corresponding to the portion of the media item. In some embodiments, as part of displaying the indication corresponding to the portion of the media item, the computer system emphasizes (e.g., highlights, bolds, fades, desaturates and / or amplifies) and / or weakens (e.g., removes, stops displaying, blurs, dims and / or desaturates) the portion of the media item. Displaying the indication corresponding to the portion of the media item when specified conditions are met allows the computer system to automatically display the indication and provide visual feedback to the user about the portion of the media item when it may be relevant (e.g., based on the input pointing to the first user interface object exceeding a predetermined time period), which performs an operation without further user input and provides visual feedback when a set of conditions have been met.

[0254] In some embodiments, as part of displaying an indication corresponding to a portion of a media item, the computer system displays a portion of the media item in a representation (e.g., 610, 612, 620, 642, and / or 658a-658c) (e.g., as described above with respect to Fig. 6E and FIG. 6I to FIG. 6J In some embodiments, the portion of the media item is attenuated relative to a body in the representation of the media item. Attenuating the portion of the media item as part of displaying an indication corresponding to the media item provides visual feedback to the user that the portion of the media item will be removed in response to detecting selection of the first user interface object, which provides visual feedback of the identified foreground of the media item.

[0255] In some embodiments, as part of detecting a request to display a user interface corresponding to a media item, the computer system detects display of a shared user interface (e.g., Figure 6B In some embodiments, as part of detecting a request to display a shared user interface, the computer system detects input directed to a user interface object for displaying a shared user interface and in response to detecting the input directed to the user interface object for displaying a shared user interface, the computer system detects a request to display a user interface corresponding to the media item and / or to display the shared user interface. Detecting a request to display a shared user interface as part of detecting a request to display a user interface provides a user with more control over the computer system by allowing the computer system to detect a request to display a particular user interface via detecting a request to display a particular user interface, which provides additional control options without cluttering the user interface.

[0256] In some embodiments, as part of changing (e.g., removing) the display of a portion (e.g., the background) of a media item in a representation of the media item (e.g., the representation of the media item continues to include the subject, while the background of the media item is removed) but not changing the display of the subject in the representation of the media item (e.g., 610, 612, 620, 642, and / or 658a-658c), the computer system forgoes changing the visual content (e.g., data) of the media item (e.g., as described with respect to FIG. 6B to FIG. 6C and Figures 6L to 6M In some embodiments, the first user interface object (e.g., 614) is overlaid on one or more portions of the representation (e.g., 620) of the media item.

[0257] In some embodiments, while displaying the first user interface object, the computer system detects a second input directed to the first user interface object. In some embodiments, in response to detecting the second input directed to the first user interface object (e.g., 650b and / or 650c1) and based on determining that display of a portion of the media item in the representation of the media item and display of a subject in the media item in the representation of the media item have not changed (and / or based on determining that the first user interface object is in a first state (e.g., an active state)), the computer system changes display of a portion (e.g., 610c) (e.g., a background) of the media item in the representation of the media item but does not change display of a subject in the media item (e.g., 610a-610b) in the representation of the media item. In some embodiments, in response to detecting a second input directed to the first user interface object (e.g., 650b and / or 650c1) and based on determining that display of a portion of the media item in the representation of the media item has changed but display of a body of the media item in the representation of the media item has not changed (and / or based on determining that the first user interface object is in a second state different from the first state (e.g., an inactive state)), the computer system abandons changing display of a portion of the media item (e.g., the background) in the representation of the media item but not changing display of a body of the media item in the representation of the media item. Selecting whether to change display of a portion of the media item in the representation of the media item but not changing display of a body of the media item in the representation of the media item or to change display of a portion of the media item in the representation of the media item but not changing display of a body of the media item in the representation of the media item when a specified condition is met allows the computer system to perform different operations based on the state of the representation being displayed, which provides additional control options without cluttering the user interface.

[0258] In some embodiments, the request to display a user interface corresponding to the media item is a request to display a second menu (e.g., 646 and / or 656) (e.g., a tools menu and / or a menu having one or more media tool user interface objects) (e.g., Fig.6I and Figure 6M 650k and / or 680 in FIG. 6). Detecting a request to display a second menu as part of detecting a request to display a user interface enables a user to have more control over the computer system by allowing the computer system to detect a request to display a user interface via detecting a request to display a menu, which provides additional control options without cluttering the user interface.

[0259] In some embodiments, while displaying a first user interface object (e.g., 614 and / or 674), the computer system detects a third input (e.g., 650b, 650l) directed to the first user interface object (e.g., a tap input and / or a non-tap input (a mouse click, a double-click input, a press and hold input, and / or a swipe input)). In some embodiments, in response to detecting the third input directed to the first user interface object, the computer system displays a second representation (e.g., 612 and / or 658c) of the media item that includes the body but does not include a portion of the representation of the media item (e.g., 610, 612, 620, 642, and / or 658a-658c) (e.g., a modified version of the representation of the media item). Displaying the second representation of the media item that includes the body but does not include a portion of the representation of the media item in response to detecting the third input directed to the first user interface object enables the user to display a representation of the media item with the portion of the representation of the media item removed, which provides additional control options without cluttering the user interface.

[0260] In some embodiments, in response to detecting a third input directed to the first user interface object (and while displaying the second representation of the media item), the computer system displays a sixth user interface object that, when selected, displays a third representation (e.g., 610, 612, 620, 642, and / or 658a-658c) of the media item including the body (e.g., 610a-610b) and including a portion (e.g., 610c) of the representation of the media item. In some embodiments, while displaying the sixth user interface object, the computer system detects the input directed to the sixth user interface object. In some embodiments, in response to the computer system detecting the input directed to the sixth user interface object, the computer system replaces the display of the second representation of the media item with the display of the third representation of the media item. In some embodiments, in response to the computer system detecting the input directed to the sixth user interface object, the computer system replaces the display of the sixth user interface object with the display of the first user interface object (e.g., displays the first user interface object at a location where the sixth user interface object was previously displayed). In some embodiments, in response to detecting the input directed to the first user interface object, the computer system replaces the display of the first user interface object with the display of the sixth user interface object (e.g., displays the sixth user interface object at a location where the first user interface object was previously displayed). Displaying a sixth user interface object in response to detecting a third input directed to the first user interface object enables the user to reverse (e.g., undo) changes caused in response to detecting the third input at a time that may be relevant (e.g., after the computer system has modified the representation), which provides additional control options without cluttering the user interface.

[0261] It should be noted that the process described above with respect to method 700 (eg Figure 7) also applies in a similar manner to the methods described below. For example, method 700 optionally includes one or more features of the various methods described above with reference to method 800. For example, method 700 can be used to display a user interface object for managing a background of a media representation, which is displayed simultaneously with a user interface object for replicating a body of a media representation based on method 800. For the sake of brevity, these details are not repeated below.

[0262] Figure 8 800 is a flowchart illustrating a method of copying a subject of a media representation according to some embodiments. Method 800 is performed at a computer system (e.g., 100, 300, 500, and / or 600) (e.g., a smart phone, a desktop computer, a laptop, a tablet computer) that communicates with a display generation component (e.g., a display controller, a touch-sensitive display system). In some embodiments, the computer system communicates with one or more input devices (e.g., a touch-sensitive surface). Some operations in method 800 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0263] As described below, method 800 provides an intuitive way to copy the body of a media representation according to some embodiments. According to some embodiments, the method reduces the cognitive burden on the user to copy the body of the media representation, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling the user to copy the body of the media representation according to some embodiments saves power and increases the time interval between battery charges.

[0264] While displaying, via display generation components, a representation (e.g., 610, 612, 620, 642, and / or 658a-658c) of visual content (e.g., visual content of a media item (e.g., a photo, a video, and / or a series of animated images)) that includes a first portion (e.g., 610a-610b) (e.g., a foreground portion and / or a portion having one or more subjects) and a second portion (e.g., 610c) (e.g., a background portion, one or more portions of a subject surrounding the subject of the media and / or a body of the subject, one or more portions of a representation of the media that are not the subject, and / or one or more portions of a representation of the media that are distinct from and / or separate from the subject), the computer system detects (802) (e.g., via one or more input devices) an input directed to (e.g., located therein) the representation of the visual content (e.g., as described above with respect to Fig.6I and Figure 6M650a2, 650k, 680) (e.g., drag input, long press input and / or press and hold input, and / or in some embodiments, tap input, mouse click, hover input after mouse click and / or voice input). In some embodiments, the second part is the background of the first part. In some embodiments, the location in the visual content is not in the first part of the representation of the visual content. In some embodiments, the location in the visual content is in the first part of the representation of the visual content. In some embodiments, the location in the visual content is in the first part and the second part of the representation of the visual content (e.g., wherein the first part covers and / or is surrounded by the second part of the representation of the visual content).

[0265] In response to detecting an input directed to (eg, located within) a representation of visual content (eg, as described above with respect to Fig.6I and Figure 6M 650a2, 650k, 680) and based on determining that the first portion (e.g., 610a-610b) includes a subject (e.g., 610a-610b) that is available for copying (e.g., determined to be available for copying and / or includes a subject, wherein an operation of copying the subject but not copying a second portion of the representation of the visual content can be performed), the computer system (e.g., in the visual content) provides (804) (e.g., displayed and / or output via a display generation component) an indication (e.g., 626b and / or 628a) (e.g., a visual, tactile and / or audible indication) that an operation of copying the subject (e.g., 610a-610b) but not copying the second portion (e.g., 610c) (e.g., a background portion) can be performed (e.g., performed by the computer system). In some embodiments, the operation is an operation of copying the subject separately from the background portion. In some embodiments, performing the operation does not include copying a subset of the first portion that does not include the first subject. Selecting whether to provide an indication of an executable operation that copies the main body but not the second portion allows the computer system to automatically notify the user of the executable operation, which performs the operation without further user input and provides visual feedback when a set of conditions have been met.

[0266] In some embodiments, the input directed to the representation of visual content (e.g., 650a2) is a press and hold input (and / or a long press input) (e.g., an input detected for a time longer than a predetermined time period (e.g., 0.25 seconds to 10 seconds) and / or an input detected at a location longer than a tap input is detected) (e.g., a press and hold input on a display and / or a press and hold input at an external device (e.g., a mouse click and hold input)). In some embodiments, in response to detecting an input different from a press and hold input (e.g., a tap input and / or in some embodiments a non-tap input (e.g., such as a mouse click, a trackpad click, and / or a swipe input), the computer system does not display an indication (e.g., 626b and / or 628a) and performs one or more other operations (e.g., selecting an object and / or subject in the representation of visual content, displaying a user interface of an application corresponding to the object and / or subject selected in response to the different input, displaying a preview of the representation of visual content, opening a file, and / or displaying a representation of the visual content in a user interface corresponding to the representation of the visual content). Detecting a press and hold input as part of detecting input directed to visual content enables a user to have more control over the computer system by allowing the user to provide a press and hold input without displaying additional user interface elements, which provides additional control options without cluttering the user interface.

[0267] In some embodiments, displaying the representation of the visual content includes displaying the main body (e.g., 610a-610b) at a first position and displaying the second portion (e.g., 610c) at a second position. In some embodiments, upon detecting input (e.g., 650d) directed to the representation of the visual content (e.g., 612), the computer system detects movement of the input directed to the representation of the visual content (e.g., while continuing to detect the input) (e.g., from the first position to the third position). In some embodiments, in response to detecting movement of the input directed to the representation of the visual content (e.g., from the first position to the third position), the computer system moves the display of the main body (e.g., 610a) from the first position (e.g., Fig. 6E 610a in the figure) to a third position (eg, FIG. 6F to FIG. 6G 610a in the figure) (different from the first position), but without moving the display of the second part from the second position (and / or without moving a second subject different from the subject) (e.g., as described above with respect to FIG. 6E to FIG. 6H Moving the display of the subject from the first position to the third position without moving the display of the second portion from the second position in response to detecting movement of an input directed to a representation of visual content enables a user to control a computer system to move the subject between locations on the computer system without moving the second portion, which provides additional control options without cluttering the user interface.

[0268] In some embodiments, when input directed to a representation of visual content (e.g., 650d) is detected and the subject (e.g., 610a-610b) is displayed at the third position, the computer system detects the end (e.g., upward click and / or lift) of the input directed to the representation of visual content (e.g., 650d) (and / or stops detecting input directed to the visual content). In some embodiments, in response to detecting the end of the input directed to the representation of visual content (and / or stopping detecting input directed to the visual content) (and / or in response to detecting the end of the input directed to the visual content at the third position), the computer system displays the subject (e.g., 610a and / or 630a) at the third position without displaying the second portion (e.g., 610c) at the third position (e.g., as described with respect to Figure 6H In some embodiments, after detecting the end of the input and in response to detecting a corresponding input different from the input directed to the visual content, the computer system continues to display the subject at the third location and continues to display the second portion, where the second portion was displayed before the corresponding input was detected. Displaying the subject at the third location without displaying the second portion at the third location in response to detecting the end of the input directed to the visual content enables a user to control the computer system to display and / or project the subject at a specific location on the display via the input, which provides additional control options without cluttering the user interface.

[0269] In some embodiments, a representation of the visual content is displayed in a first application (e.g., Fig. 6F In some embodiments, the third location is in a second application different from the first application (e.g., Figure 6G In some embodiments, the first position is in the first application. Moving the display of the subject from the first position to a third position in a different application without moving the display of the second portion from the second position in response to detecting movement of the input directed to the representation of the visual content enables a user to control the computer system to move the subject between applications on the computer system without moving the second portion between different applications, which provides additional control options without cluttering the user interface.

[0270] In some embodiments, a representation of the visual content is displayed in a first area of ​​a third application (e.g., FIG. 6E to FIG. 6F In some embodiments, the third location is in a second area of ​​the third application that is different from the first area of ​​the third application (e.g., Fig. 6FIn some embodiments, the first position is in the first area of ​​the second application. In some embodiments, the second position is in the first area of ​​the second position. In some embodiments, the first area does not cover the second area and / or is outside the second area. In some embodiments, the second area does not cover the second area and / or is outside the second area. In response to detecting the movement of the input directed to the visual content, the display of the subject is moved from the first position to a third position in a different area of ​​an application without moving the display of the second part from the second position, enabling the user to control the computer system to move the subject between different areas of an application on the computer system without moving the second part between different areas of an application, which provides additional control options without cluttering the user interface.

[0271] In some embodiments, displaying a representation of visual content (e.g., 610, 612, 620, and / or 658a-658d) includes displaying the subject in the representation of the visual content at a first size. In some embodiments, moving the display of the subject from the first position to the third position includes moving a first user interface object (e.g., 610a1) (e.g., a proxy object and / or thumbnail) that includes the first representation of the subject but does not include the first representation of the second portion. In some embodiments, the first representation of the subject in the first user interface object is displayed at a second size that is smaller than the first size. In some embodiments, the first representation is smaller than the representation of the visual content. Displaying the first user interface object that includes the first representation of the subject but does not include the first representation of the second portion provides the user with visual feedback that the subject can be moved in response to detecting input pointing to the visual content, which provides feedback to the user.

[0272] In some embodiments, displaying the representation of the visual content includes displaying the subject at a third size in the representation of the visual content. In some embodiments, moving the display of the subject from the first position to the third position includes moving a second user interface object (e.g., a proxy object and / or thumbnail) that includes a second representation of the subject that is emphasized relative to a second representation of the second portion (e.g., as described above with respect to Fig. 6F In some embodiments, the second representation of the subject in the second user interface object is displayed at a fourth size that is smaller than the third size. In some embodiments, the second representation is smaller than the representation of the visual content. Displaying a second user interface object including a second representation of the subject emphasized relative to the second representation of the second portion provides visual feedback to the user that the subject may be moved in response to detecting input directed to the visual content, which provides feedback to the user.

[0273] In some embodiments, detecting input directed to the representation of the visual content includes detecting pointer activation (e.g., 680) (e.g., a mouse click or a trackpad press) and detecting that the pointer is hovering over a third user interface object (e.g., 626a) that, when selected, causes the computer system to copy the main body but not the second portion (e.g., as described above with respect to Fig.6I The invention further provides that the pointer activation is detected before the pointer is detected to be hovering over the third user interface object. Detecting pointer activation as part of detecting input directed to visual content and detecting the pointer hovering over the third user interface object enables the user to have more control over the computer system by allowing the user to provide input via mouse clicks and hovering without displaying additional user interface elements, which provides additional control options without cluttering the user interface.

[0274] In some embodiments, upon detecting that the pointer (e.g., 680) is hovering over the third user interface object, the computer system detects movement of the pointer (e.g., and / or mouse) away from the third user interface object (e.g., as described above with respect to FIG. 6I to FIG. 6J In some embodiments, in response to detecting movement of the pointer away from the third user interface object, the computer system stops displaying instructions for performing operations to copy the main body (e.g., 610a-610b) but not the second part (e.g., 610c) (and / or stops emphasizing the main body relative to the second part). In some embodiments, in response to detecting input pointing to a representation of visual content (e.g., located therein) and based on determining that the first part includes a subject that can be copied, the computer system emphasizes the main body relative to the second part. Stopping displaying instructions for performing operations to copy the main body but not the second part in response to detecting movement of the mouse pointer away from the third user interface object enables the user to control the computer system to stop displaying the instructions, and allows the computer system to reduce the number of user interface objects displayed in certain situations, which provides additional control options without cluttering the user interface and performs operations without further user input and provides visual feedback when a set of conditions have been met.

[0275] In some embodiments, in response to detecting input directed to a representation of visual content (e.g., 650a2, 650k, and / or as described above with respect to 680), the computer system provides (e.g., displays) an indication (e.g., 614 and / or 674) of an operation that can be performed to modify the representation of the visual content so that the representation of the visual content includes the main body (e.g., 610a-610b) but does not include the second portion (e.g., 610c). In some embodiments, in response to detecting input while displaying the indication, the computer system modifies the representation of the visual content that includes the main body but does not include the second portion (e.g., as described above with respect to method 700). Providing an indication of an operation that can be performed to modify the representation of the visual content in response to detecting input directed to the visual content so that the representation of the visual content includes the main body but does not include the second portion provides additional control options to the user, which provides additional control options without cluttering the user interface.

[0276] In some embodiments, the first portion of the representation of the visual content includes a first body (e.g., 610a) and a second body (e.g., 610b). In some embodiments, based on determining that the input directed to the representation of the visual content (e.g., 650d) is directed to the first body in the first portion (e.g., and / or a first position corresponding to its position), an indication that an operation of copying the body but not the second portion may be performed is that the first body may be copied but the second body may not be copied (and optionally the second portion may not be copied) (e.g., as described above with respect to FIG. 6D to FIG. 6E In some embodiments, when providing an indication of an operation that can be performed to copy the first body but not the second part, the computer system detects the input, and in response to detecting the input, the computer system copies the first body but not the second body and the second part. In some embodiments, based on determining that the input pointing to the representation of the visual content points to a second body in the first part that is different from the first body (for example, and / or a second position corresponding to its position that is different from the first position), the indication of the operation that can be performed to copy the body but not the second part is that the second body but not the first body (for example, as described above with respect to FIG. 6D to FIG. 6E In some embodiments, when providing an indication of an operation that can perform copying the second body but not the second part, the computer system detects the input, and in response to detecting the input, the computer system copies the second body but not the first body and the second part. Providing an indication about the first body or the second body based on input directed to a specific body enables the user to control which body can be copied without copying the second part, which provides additional control options without cluttering the user interface.

[0277] In some embodiments, in response to detecting input directed to (e.g., located within) a representation of visual content and based on determining that the first portion is not a body available for copying, the computer system forgoes providing an executable copy body without copying the second portion (e.g., as described above with respect to Figure 6H Selecting whether to provide an indication of an action that can be performed to copy the main body but not the second part allows the computer system to automatically notify the user about the action that can be performed, which performs the action without further user input and provides visual feedback when a set of conditions have been met.

[0278] In some embodiments, in response to detecting an input directed to (e.g., located within) a representation of visual content and based on determining that a first portion of the visual content includes a third subject and a fourth subject that are available to be copied, the computer system provides an executable program to copy the third subject and the fourth subject without copying the second portion of the visual content (e.g., as described above with respect to FIG. 6A to FIG. 6E In some embodiments, as part of detecting input directed to visual content, the computer system detects movement of the input from a location corresponding to the third subject to a location corresponding to the fourth subject and / or the opposite movement. In some embodiments, in response to detecting the input while displaying the indication, the computer system copies the third subject and the fourth subject but does not copy the second portion of the visual content. In some embodiments, in response to detecting input directed to a representation of visual content and based on determining that the representation of the visual content includes one subject, an indication operation may be performed (e.g., by a computer system) to copy the subject (e.g., 610a-610b) but not copy a second portion having a first visual appearance (e.g., including the word "Subject"). In some embodiments, in response to detecting input directed to a representation of visual content and based on determining that the representation of the visual content includes multiple subjects, an indication operation may be performed (e.g., by a computer system) to copy the subject (e.g., 610a-610b) but not copy a second portion having a second visual appearance (e.g., including the word "Subject" but not including the word "Subjects") that is different from the first visual appearance (e.g., including the word "Subject" but not including the word "Subjects"). Providing an indication of an operation that can be performed to copy a third subject and a fourth subject but not a second portion of the visual content in response to detecting input directed to visual content allows a user to perform the operation of copying multiple subjects but not a second portion of the visual content, performing the operation without further user input and providing visual feedback when a set of conditions have been met.

[0279] In some embodiments, the representation of visual content includes (and / or is) a representation of an image or video (e.g., as described above with respect to Figure 6M described above).

[0280] Note that the process described above with respect to method 800 (eg, Figure 8 ) also applies in a similar manner to the methods described below / above. For example, method 800 optionally includes one or more features of the various methods described above with reference to method 700. For example, method 700 is used to display a user interface object for managing a background of a media representation, which is displayed simultaneously with a user interface object for replicating a body of a media representation based on method 800. For the sake of brevity, these details are not repeated below.

[0281] FIG. 9A to FIG. 9I An exemplary user interface for converting one or more portions of a media representation according to some embodiments is illustrated. FIG. 9A to FIG. 9I The user interface in is used to illustrate the process described below, including Fig.10 process.

[0282] Fig.9A The computer system 600 is illustrated displaying a settings user interface including a device locale setting 932. Fig.9A , device locale 932 is set to "United States," which indicates that computer system 600 is associated with a location corresponding to the area occupied by the United States. Fig. 9B As shown, the computer system 600 is displaying a web application user interface. The web application user interface includes an application control area 602, an application display area 604, and an application control area 606. The computer system 600 uses the above-mentioned Fig. 6A The regions are displayed using one or more of the techniques described above. Display region 604 includes text 906 discussing the process of boiling water. Text 906 includes length measurement 906a ("21CM") and degree measurement 906b ("100°"), as well as other text. Fig. 9B In the example, the computer system 600 emphasizes (e.g., Fig. 9B ) length measurements 906a and degree measurements 906b are underlined to indicate that it has been determined that computer system 600 can convert these measurements and / or that these portions of text have been identified as measurements that can and / or should be converted. Fig. 9B , the computer system 600 detects a tap input 950b on the length measurement 906a.

[0283] like Fig. 9C As shown, the computer system 600 displays a transformation user interface including a transformation representation 908a and a transformation control 910. Here, the transformation user interface covers Fig. 9B The converted representation 908a indicates the measurement results in the text 906 (e.g., Fig. 9B906a), the computer system 600 can convert the measurement result into an equivalent measurement result having a different measurement unit than the measurement unit in the text 906. Each of the conversion controls 910 indicates a specific equivalent measurement result of the measurement result indicated by the conversion representation 908a, which corresponds to the measurement result obtained by Fig. 9B 906a selected by input 950b in . Specifically, each conversion control 910 indicates a unit of measurement indicating a length measurement, because the unit of measurement (e.g., "cm") of length measurement 906a (e.g., "21CM") is a measurement of length (e.g., because the determination of the length measurement corresponds to a measurement of length). Conversion controls 910 include inch conversion control 910a (e.g., "inches"), feet and inches conversion control 910b (e.g., "feet and inches"), yard conversion control 910c (e.g., "yards"), millimeter conversion control 910d (e.g., "millimeters"), centimeter conversion control 910e (e.g., "centimeters"), and meter conversion control 910f (e.g., "meters"). Inch conversion control 910a indicates that length measurement 906a (e.g., "21CM") is equivalent to a measurement of 8 inches. Feet and inches conversion control 910b indicates that length measurement 906a (e.g., "21CM") is equivalent to a measurement of 0 feet and 8 inches. The yards conversion control 910c indicates that the length measurement 906a (e.g., "21CM") is equivalent to a measurement of 0.23 yards. The millimeters conversion control 910d indicates that the length measurement 906a (e.g., "21CM") is equivalent to a measurement of 210mm. The centimeters conversion control 910e indicates that the length measurement 906a (e.g., "21CM") is equivalent to a measurement of 21cm. The meters conversion control 910f indicates that the length measurement 906a (e.g., "21CM") is equivalent to a measurement of 0.21 meters. Fig. 9C As shown by Fig. 9C Each of the conversion controls indicates a measurement result that is equal to each other's length measurement result 906a. FIG. 9A to FIG. 9I For purposes of the description, an equivalent measurement or equivalent measurement may be absolutely and / or approximately (e.g., rounded up and / or down to the nearest tenth, hundredth, tenth, and / or thousandth) equivalent to the measurement being converted by computer system 600. In some embodiments, an equivalent measurement is only an absolutely equivalent measurement.

[0284] In some embodiments, computer system 600 displays one or more other conversion controls for converting length measurement 906a to an equivalent length measurement having a different unit of measurement than the unit of measurement represented by conversion control 910. In some embodiments, computer system 600 displays one or more corresponding conversion controls of conversion control 910 because the unit of measurement indicated by the one or more corresponding conversion controls is a unit of measurement corresponding to a location currently associated with computer system 600, such as a location represented by Fig.9A The region indicated by the device locale 932 of the computer system 600 ("United States") and / or a location detected by the computer system 600 based on geographic location information (e.g., based on data obtained by the computer system 600 via one or more GPS sensors and / or based on data detected by one or more Wi-Fi and / or cellular connections) (e.g., current geographic location information and / or information obtained within a period of time (e.g., within 30 minutes, within 5 hours, within 2 weeks, and / or within 1 month)). In some embodiments, based on a determination of whether a particular unit of measurement is commonly used in the particular location, the unit of measurement corresponds to the particular location. For example, in some embodiments, when it is determined that the computer system 600 is not in an area where yards and / or imperial units of measurement are commonly used, the computer system 600 does not display the yard conversion control 910c. In some embodiments, based on a determination that the computer system 600 is currently associated with a location where hectares are commonly (e.g., and / or preferably) used, the computer system 600 displays a conversion control indicating that the unit of measurement represented by the conversion representation 908a is converted to hectares. In some embodiments, in Fig. 9B In, based on determining that length measurement 906a is a unit of measurement that is the only unit of measurement commonly used in the location associated with computer system 600 (and / or represents a unit of measurement from a unique measurement system, such as metric and / or imperial measurements), computer system 600 de-emphasizes length measurement 906a (and / or another measurement result). In some embodiments, in response to detecting input pointing to a corresponding measurement result that is not currently emphasized and / or a measurement result that has been determined to be represented by a corresponding measurement result that is the only unit of measurement commonly used in the location associated with computer system 600 (and / or represents a unit of measurement from a unique measurement system), the computer system 600 does not display a conversion user interface. In some embodiments, control 910 displays measurement values ​​that are all rounded to the same decimal place (such as tenths, hundredths, or thousandths decimal places). In Fig. 9C In the example of FIG. 6 , the computer system 600 detects a tap input 950c1 on a first portion of the code conversion control 910c or a tap input 950c2 on a second portion of the code conversion control 910c. In some embodiments, the first portion of the code conversion control 910c (e.g., or another control) includes a copy control (e.g., such as Fig. 9CThe input 950c1 is indicated as shown in the middle graphical user interface object).

[0285] like Fig.9D As shown, in response to detecting tap input 950c1 or tap input 950c2, computer system 600 replaces the display of length measurement result 906c ("0.23 yards") in text 906. Fig. 9B The length measurement result 906a ("21CM") is displayed. The length measurement result 906c is Fig. 9C The code conversion control 910c indicates the measurement result ("0.23 code"), which is equivalent to Fig. 9B Length measurement 906a ("21CM"). In some embodiments, the computer system 600 overlays the length measurement 906c in the text 906. Fig. 9B In some embodiments, the computer system 600 highlights the length measurement 906c to indicate that the length measurement 906c is not an initial part of the text 906. In some embodiments, the computer system 600 highlights the length measurement 906c by displaying the length measurement 906c in a box and / or with Fig. 9B The computer system 600 may display the length measurement result 906c with different visual characteristics (e.g., color, font, size, proportion, and / or outline) from the visual characteristics of the length measurement result 906a to emphasize the length measurement result 906c. In some embodiments, in response to detecting the tap input 950c1 or the tap input 950c2, the computer system 600 may Fig. 9B In some embodiments, in response to detecting tap input 950c1, computer system 600 copies the display of length measurement result 906a to the copy buffer without replacing the display of length measurement result 906c ("0.23 yards") in text 906. Fig. 9B In some embodiments, in response to detecting the tap input 950c1, the computer system 600 displays the length measurement result 906c in another application such as a word processing application, a communication application (e.g., an email application and / or a text application), and / or a productivity application (e.g., a note-taking application and / or a presentation application) without detecting an intervening user input after detecting the tap input 950c1. In some embodiments, in response to detecting the transition control 910 with the transition control 910, the computer system 600 displays the length measurement result 906c in another application such as a word processing application, a communication application (e.g., an email application and / or a text application), and / or a productivity application (e.g., a note-taking application and / or a presentation application). Fig. 9C In response to input on a toggle control different from toggle control 910c in FIG. 1 , computer system 600 uses one or more similar techniques as described above to copy the measurement represented by the corresponding toggle control and / or replace the display with the measurement represented by the corresponding toggle control (e.g., different from length measurement 906c). Fig. 9BThe length measurement result 906a is displayed. Fig.9D , computer system 600 detects a tap input 950d on degree measurement 906b ("100°").

[0286] like Fig.9E As shown, in response to detecting the tap input 950d, the computer system 600 displays a blur conversion user interface including a conversion representation 908b (eg, "100°"), a conversion option control 912, and a copy control 914. The computer system 600 displays Fig.9E 906b is ambiguous because the unit of measurement of the degree measurement result 906b is ambiguous. Here, the unit of measurement (e.g., "°") of the degree measurement result 906b is ambiguous because the unit of measurement does not represent a type of degree, such as a degree of a particular temperature (e.g., Celsius and / or Fahrenheit) and / or an angle. Therefore, the computer system 600 displays Fig.9E The fuzzy conversion user interface in the embodiment of the present invention is to determine (e.g., based on input from a user) how the computer system 600 should interpret the measurement unit corresponding to the degree measurement result 906b. The conversion option control 912 is an option for how the computer system 600 can interpret the measurement unit corresponding to the measurement unit of the degree measurement result 906b. The computer system 600 displays a corresponding conversion option control of the conversion option control 912 because it is determined that the corresponding conversion option control indicates an appropriate measurement unit that can correspond to the measurement unit of the degree measurement result 906b. The conversion option control 912 includes a convert to Fahrenheit option control 912a, a convert to Celsius option control 912b, and a convert to angle option control 912c. The convert to Fahrenheit option control 912a includes a temperature indication 912a1, which indicates that the measurement unit ("F") corresponding to the convert to Fahrenheit option control 912a represents a type of temperature measurement. The convert to Celsius option control 912b includes a temperature indication 912b1, which indicates that the measurement unit ("C") corresponding to the convert to Celsius option control 912b represents a type of temperature measurement. The convert to angle option control 912c includes a degree indication 912c1 indicating that the unit of measurement corresponding to the convert to angle option control 912c represents a type of angle measurement. It is worth noting that both the temperature indication 912a1 and the temperature indication 912b1 include a picture of a thermometer to indicate a temperature measurement result. However, in Fig.9E, the thermometer of temperature indication 912a1 is less filled than temperature indication 912b1. Here, the thermometer of temperature indication 912a1 is less filled than temperature indication 912b1 to indicate that 100℉ is a colder temperature than 100℃. In other words, in some embodiments, the indication corresponding to the conversion option control may indicate the degree of difference between the fuzzy measurement result converted into one unit of measurement and the fuzzy measurement result converted into another unit of measurement (e.g., hot, warm, cold, long, short, wide, and / or narrow). Fig.9E , the computer system 600 detects a tap input 950e on the Convert to Celsius option control 912b.

[0287] like Fig.9F As shown, in response to detecting the tap input 950e, the computer system 600 displays the Fahrenheit conversion control 982b1 and the Kelvin temperature conversion control 982b2. In addition, the computer system 600 continues to display the Convert to Celsius option control 912b with the temperature indication 912b1 and stops displaying the Convert to Fahrenheit option control 912a and the Convert to Degree option control 912c. Fig.9F As shown, in response to detecting tap input 950e, computer system 600 adds "C" to degree measurement 906b in text 906. Fig.9F In some embodiments, in response to detecting the tap input 950e, the computer system 600 does not add the "C" to the degree measurement 906b. In some embodiments, in response to detecting the input on one of the Fahrenheit conversion control 982b1 and the Kelvin conversion control 982b2, the computer system 600 uses the above-described input on the Fahrenheit conversion control 982b1 to convert the temperature to the Kelvin temperature. FIG. 9B to FIG. 9D The computer system 600 uses one or more techniques described in the input 950c1-950c2 to perform one or more operations corresponding to the control and degree measurement result 906b to which the input is directed. In some embodiments, the computer system 600 expands the Convert to Celsius option control 912b to display the Fahrenheit conversion control 982b1 and the Kelvin temperature conversion control 982b2. In some embodiments, the computer system 600 continues to display one or more Convert to Fahrenheit option controls 912a and Convert to Angle option controls 912c while continuing to display the Fahrenheit conversion control 982b1 and the Kelvin temperature conversion control 982b2. In some embodiments, the computer system 600 continues to display one or more Convert to Fahrenheit option controls 912a and Convert to Angle option controls 912c while continuing to display the Fahrenheit conversion control 982b1 and the Kelvin temperature conversion control 982b2. Fig.9E Detects input on the Fahrenheit option control 912a and responds to the Fig.9EIn some embodiments, the computer system 600 detects input on the Convert to Fahrenheit option control 912a, displays one or more different conversion controls corresponding to 100°F, such as a control that, when selected, causes the computer system 600 to convert 100°F to 37.78°C. Fig.9E Detects input on the Convert to Angle option control 912c and responds to Fig.9E , the computer system 600 detects input on the Convert to Degrees option control 912c, displays one or more different conversion controls (e.g., different from controls 982b1-982b2) corresponding to 100° (e.g., degrees), such as a control that, when selected, causes the computer system to convert 100° to 1.74533 (or 1.7, 1.75, or 1.745) radians. In some embodiments, the computer system 600 detects input on the Convert to Degrees option control 912c, displays one or more different conversion controls (e.g., different from controls 982b1-982b2) corresponding to 100° (e.g., degrees), such as a control that, when selected, causes the computer system to convert 100° to 1.74533 (or 1.7, 1.75, or 1.745) radians. Fig.9E Detect input on copy control 914, and in response to Fig.9E The computer system 600 detects input on the copy control 914 without expanding Fig.9E In the case of one or more of the conversion option controls 912, 100° will be copied to the copy buffer.

[0288] Figure 9G An alternative user interface is illustrated. If the corresponding Fig.9D The unit of measurement of degree measurement result 906b is clear and is Celsius, which can be detected in response to pointing to Fig.9D The alternative user interface is displayed based on the input of the degree measurement result 906b. Figure 9G In the example shown in FIG. 1 , the computer system 600 displays a transition user interface including the transition control 916 instead of displaying an obscure transition user interface. Figure 9G The transition user interface in , because in response to detecting the pointing Fig.9D The degree measurement result 906b is input to determine the corresponding Fig.9D The unit of measurement of degree measurement 906b is explicit and is degrees Celsius. In response to detecting input directed to one of the toggle controls 916, computer system 600 uses the same unit as described above with respect to FIG. 9B to FIG. 9C One or more of the techniques described will Figure 9G The 100°C in the text is converted to an equivalent measurement result.

[0289] Figure 9H 1 and 2 illustrate exemplary scenarios of how a computer system may translate information and convert measurements from source material differently based on a particular location associated with the computer system. Computer systems 600a1-600a4 include one or more components and / or perform one or more operations described above with respect to electronic devices 100, 300, and / or 500 and computer system 600. For discussion Figure 9HFor purposes of this disclosure, computer systems 600a1-600a4 are all in the same physical location and are positioned close together. Figure 9H 9, computer systems 600a1-600a4 are displaying a web page that includes a representation of menu 940. The representation of menu 940 is a representation of the media captured previously. The representation of menu 940 includes English text describing each menu item, and the currency of the menu items is U.S. dollars. Therefore, the initial representation of menu 940 looks like the representation of menu 940 being displayed by computer system 600a1. In other words, in Figure 9H In , computer system 600a1 does not translate any portion of the presentation of menu 940 or convert any price on menu 940 into any other currency. Figure 9H 940 or convert any price on the menu 940 into any other currency because the locale of the device of the computer system 600a1 (e.g., as described above with respect to Fig.9A The fact that the device locale of computer system 600a1 is set to "United States" (e.g., as indicated by device locale indication 988a) determines that computer system 600a1 is associated with the United States. In addition, computer system 600a1 does not translate any portion of the presentation of menu 940 or convert any prices on menu 940 into any other currency because it is determined that English is a language commonly used in the United States and that the U.S. dollar is a currency commonly used in the United States (e.g., the device locale to which the device locale of computer system 600a1 is set). Figure 9H , computer system 600a2 does not translate any portion of the representation of menu 940 but converts the prices on menu 940 into British Pounds because it is determined that computer system 600a2 is associated with the United Kingdom based on the device locale of computer system 600a2 being set to "United Kingdom" (e.g., as indicated by device locale indication 988b). Specifically, computer system 600a2 does not translate any portion of the representation of menu 940 because it is determined that English is a language commonly used in the United Kingdom. However, computer system 600a2 converts the prices on menu 940 because British Pounds are a currency commonly used in the United Kingdom (or a more preferred currency and / or official currency of the United Kingdom). Figure 9H, computer system 600a3 translates portions of the representation of menu 940 and converts the prices on menu 940 into Australian dollars because computer system 600a3 is determined to be associated with Australia based on the device locale of computer system 600a3 being set to "Australia" (e.g., as indicated by device locale indication 988c). Specifically, computer system 600a3 does not translate any portion of the representation of menu 940 because it is determined that English is a language commonly used in Australia. However, computer system 600a3 converts the prices on menu 940 because Australian dollars are a currency commonly used in Australia (or a preferred (e.g., relative to an initial currency) currency and / or an official currency of Australia). Figure 9H , computer system 600a4 translates a portion of the representation of menu 940 into German and converts the prices on menu 940 into Euros because it is determined that computer system 600a4 is associated with Germany based on the device locale of computer system 600a4 being set to "Germany" (e.g., as indicated by device locale indication 988d). Specifically, computer system 600a4 translates a portion of the representation of menu 940 into German because it is determined that German is a language commonly used in Germany (or a more preferred language for Germany (e.g., relative to the initial language of menu 440)). Additionally, computer system 600a4 converts one or more prices on menu 940 from U.S. dollars into Euros because Euros are a currency commonly used in Germany (or a more preferred currency and / or official currency for Germany). In some embodiments, in addition to or alternatively to using the device locale to determine whether to translate or convert units of measurement, the computer system uses the geographic location of the computer system to determine whether to translate (e.g., automatically translate) or convert measurements (e.g., also as described above with respect to FIG. 9A to FIG. 9B described). Figure 9H , computer system 600a4 detects a tap input 950h on price 962.

[0290] Fig.10 1 is a flowchart illustrating a method of converting one or more parts of a media representation according to some embodiments. Method 1000 is performed at a computer system (e.g., 100, 300, 500, and / or 600) (e.g., a smart phone, a desktop computer, a laptop, a tablet computer) that communicates with a display generation component (e.g., a display controller, a touch-sensitive display system). In some embodiments, the computer system communicates with one or more input devices (e.g., a touch-sensitive surface). Some operations in method 1000 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0291] As described below, method 1000 provides an intuitive way to convert one or more parts of a media representation. The method reduces the cognitive burden of a user converting one or more parts of a media representation, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling a user to convert one or more parts of a media representation faster and more efficiently saves power and increases the time interval between battery charges.

[0292] Method 1000 is performed at a computer system (e.g., 600) (e.g., a smartphone, a desktop computer, a laptop computer, a tablet computer) in communication with a display generation component (e.g., a display controller, a touch-sensitive display system). In some embodiments, the computer system communicates with one or more input devices (e.g., a touch-sensitive surface).

[0293] While displaying a representation (e.g., a representation of an image, a paragraph, one or more lines, a receipt, and / or a document) that includes text (e.g., 906 and / or 940), the computer system detects (1002) an input (e.g., 950b and / or 950d) corresponding to a selection of a portion of the text in the representation (and / or a selection of a first measurement result) (e.g., a tap input or a non-tap input (e.g., a long press input, a swipe input, a multi-tap input, an input on a physical input mechanism (e.g., a rotatable input mechanism and / or a button) and / or a mouse click).

[0294] In response to detecting an input (e.g., 950b and / or 950d) corresponding to a selection of a portion of text in the representation (e.g., 906a and / or 906b) and based on determining that the portion of text in the representation satisfies a corresponding set of criteria, wherein the corresponding set of criteria includes criteria that are satisfied when determining that the portion of text corresponds to a first measurement having a first quantity and a first unit of measurement, the computer system displays (1004) via a display generation component a corresponding user interface (e.g., a user interface that displays 910, 912, 912b, 916, 960, 982b1, and / or 982b2) for converting the first measurement to one or more other units of measurement, wherein the corresponding user interface includes a visual representation (e.g., one or more of 910, 912, 912b, 916, 960, 982b1, and / or 982b2) of a second measurement of a second quantity having a second unit of measurement that is different from the first unit of measurement (e.g., the first unit and the second unit are units for the same type of measurement (e.g., length, width, volume, currency, and / or temperature)). The second quantity is a conversion of the first quantity from a first measurement unit to a second measurement unit. In some embodiments, the corresponding user interface includes a second measurement result having a second quantity (different from the first quantity) and a second unit different from the first unit (e.g., the first unit and the second unit are units for the same type of measurement result (e.g., length, width, volume, currency and / or temperature)). In some embodiments, the second measurement result is a conversion of the first measurement result. In some embodiments, in response to detecting an input corresponding to a selection of a portion of the text in the representation and according to determining that the portion of the text in the representation meets a corresponding set of standards, the second measurement result and / or the corresponding user interface are displayed simultaneously with the representation including the text. In some embodiments, in response to detecting an input corresponding to a selection of a portion of the text in the representation and according to determining that the portion of the text in the representation does not meet a corresponding set of standards, the computer system does not display the corresponding user interface and / or the second measurement result. Displaying a corresponding user interface for converting the first measurement result into one or more other measurement units when the specified conditions are met allows the computer system to automatically display the conversion of the measurement result of the portion of the text in the representation that meets the corresponding set of standards (and converts), which performs the operation without further user input when a set of conditions have been met.

[0295] In some embodiments, a corresponding user interface (e.g., a user interface displaying 910, 912, 912b, 916, 960, 982b1, and / or 982b2) includes a visual representation of a third quantity having a third measurement unit different from the first measurement unit (e.g., 906a, 906b, and / or 940) and the second measurement unit (e.g., one or more of 910, 912, 912b, 916, 940, 960, 982b1, and / or 982b2) (e.g., one or more of 910, 912, 912b, 916, 960, 982b1, and / or 982b2). In some embodiments, the third quantity is a conversion of the first quantity from the first measurement unit to the third measurement unit. In some embodiments, the visual representation of the third quantity having the third measurement unit is displayed simultaneously with the visual representation of the second quantity having the second measurement unit. In some embodiments, the visual representation of the third quantity in the third unit of measurement is displayed simultaneously with the visual representation of the second quantity in the second unit of measurement and the visual representation of the first quantity in the first unit of measurement. Displaying the visual representation of the third quantity in the third unit of measurement simultaneously with the visual representation of the second quantity in the second unit of measurement when specified conditions are met allows the computer system to automatically display multiple conversions of the measurement results for the portion of the text in the representation that meets the corresponding set of criteria and perform the conversion, which performs the operation without further user input when a set of conditions have been met.

[0296] In some embodiments, displaying a corresponding user interface for converting the first measurement result into one or more other measurement units includes displaying a first user interface object (e.g., one or more of 910, 912, 912b, 914, 916, 960, 982b1, and / or 982b2) via a display generation component. In some embodiments, while displaying the first user interface object, the computer system detects input pointing to the first user interface object (e.g., 950c1 and / or 950c2). In some embodiments, in response to detecting input pointing to the first user interface object, the computer system copies a second quantity with a second measurement unit (e.g., copied to a copy buffer) (e.g., without copying the first quantity with a first measurement unit). Copying a second quantity with a second measurement unit in response to detecting input pointing to the first user interface object provides the user with a control option for conversion of measurement units in a portion of the copied text, which provides additional control options without cluttering the user interface.

[0297] In some embodiments, displaying a corresponding user interface for converting the first measurement result into one or more other measurement units includes displaying a second user interface object (e.g., one or more of 910, 912, 912b, 916, 960, 982b1, and / or 982b2) via a display generation component. In some embodiments, while displaying the second user interface object, the computer system detects input pointing to the second user interface object (e.g., 950c1 and / or 950c2). In some embodiments, in response to detecting input pointing to the second user interface object, the computer system replaces the display of a portion of the text (e.g., 906a) (e.g., a portion of the text corresponding to the first portion of the text) with a display of a second quantity having a second measurement unit (e.g., 906c) (e.g., while continuing to display at least a second portion of the text (e.g., the second portion of the text is different from the portion of the text)). Replacing the display of the portion of the text with the display of the second quantity having the second measurement unit provides the user with a control option for replacing the measurement result in the portion of the text with a conversion of the measurement result in the portion of the text, which provides additional control options without cluttering the user interface.

[0298] In some embodiments, the corresponding standard set includes determining that the unit of the measurement result (and / or the first measurement result) is ambiguous (e.g., as described above with respect to Fig.9D In some embodiments, in response to detecting an input corresponding to a selection of a portion of text in a representation (e.g., 950b and / or 950d) and based on determining that the portion of the text corresponding to the first measurement (and / or the first measurement) is not ambiguous (e.g., not a measurement for two different types of measurements (e.g., Kelvin and / or inches)), the computer system displays a second user interface (e.g., a user interface including 912a-912c) that is different from the corresponding user interface (e.g., the user interface including 910) via a display generation component. In some embodiments, the second user interface does not include a visual representation of the second quantity having a second unit of measurement. Selecting whether to display the corresponding user interface or the second user interface based on a specified condition allows the computer system to display different user interfaces based on whether the detected measurement in the portion of the text is ambiguous, which performs operations without further user input when a set of conditions have been met.

[0299] In some embodiments, the second user interface includes: a third user interface object (e.g., 912a-912c) that, when selected, causes the computer system to identify the first unit of measurement as a third unit of measurement; and a fourth user interface object (e.g., 912a-912c) that, when selected, causes the computer system to identify the second unit of measurement as a fourth unit of measurement that is different from the third unit of measurement (e.g., a different type of measurement). In some embodiments, the third user interface object is displayed simultaneously with the fourth user interface object. Displaying the second user interface including the third user interface object and the fourth user interface object allows the computer system to provide the user with different user interface objects for selecting a measurement type in a portion of text, which provides additional control options without cluttering the user interface.

[0300] In some embodiments, while displaying a second user interface (e.g., a user interface including 912a-912c) that includes a third user interface object and a fourth user interface object, the computer system detects a first input directed to the second user interface. In some embodiments, in response to detecting the first input directed to the second user interface, the computer system displays a visual representation of a second quantity with a second unit of measurement (e.g., 982b1-982b2) via a display generation component. Displaying the visual representation of the second quantity with a second unit of measurement in response to detecting the input directed to the second user interface allows the computer system to display the second quantity with a second unit of measurement after a user has selected a user interface object to select a measurement type in a portion of text, which performs an operation without further user input when a set of conditions have been met.

[0301] In some embodiments, while displaying a second user interface (e.g., a user interface including 912a-912c) that includes a third user interface object and a fourth user interface object, the computer system detects a second input (e.g., 950e) directed to the second user interface. In some embodiments, in response to detecting the second input (e.g., 950e) directed to the second user interface and based on determining that the second input directed to the second user interface has been directed to the third user interface object, the computer system displays, via a display generation component, a visual representation of a third quantity having a third measurement unit that is different from the first measurement unit (e.g., 982b1-982b2). In some embodiments, the third quantity is based on a conversion of the first quantity to the third measurement unit (and the third quantity is not based on a conversion of the first quantity to the fourth measurement unit) (e.g., as described above with respect to Fig.9FIn some embodiments, in response to detecting a second input directed to the second user interface (e.g., 950e) and based on determining that the second input directed to the second user interface has been directed to a fourth user interface object, the computer system displays, via the display generation component, a visual representation of a fourth quantity having a fourth measurement unit that is different from the first measurement unit and the third measurement unit (e.g., 982b1-982b2). In some embodiments, the fourth quantity is based on a conversion of the first quantity in the fourth measurement unit (and the fourth quantity is not based on a conversion of the first quantity in the third measurement unit) (e.g., as described above with respect to Fig.9F In some embodiments, the third quantity is different from the fourth quantity. In some embodiments, the third unit of measurement is different from the fourth unit of measurement. Displaying the second quantity and the second unit of measurement as different quantities and / or different units of measurement based on input directed to the third user interface object or the fourth user interface object allows the computer system to automatically display the second quantity and the second unit of measurement based on the input, which performs operations without further user input when a set of conditions have been met and provides additional control options without cluttering the user interface.

[0302] In some embodiments, while displaying a representation including text (e.g., 940), the computer system detects an input corresponding to a request to translate one or more portions of the text. In some embodiments, in response to detecting an input corresponding to a request to translate one or more portions of the text and based on determining that one or more portions of the text meet a corresponding set of standards and that the one or more portions of the text are not in a first language (and / or in a second language different from the first language), the computer system displays a first translated version of the one or more portions of the text via a display generation component. In some embodiments, the first translated version of the one or more portions of the text includes a visual representation of a seventh quantity having a seventh unit of measurement. In some embodiments, the first translated version is in the first language (e.g., as described above with respect to Figure 9HIn some embodiments, the seventh unit of measurement and the seventh quantity are different units of measurement and quantities from the units of measurement and quantities in one or more parts of the text. In some embodiments, the first language is associated with a device region (e.g., the primary, second, and / or third language of the region) setting (e.g., the setting specifies that the computer system is set to a region commonly used therein (e.g., the United States, Europe, China, India, etc.). In some embodiments, one or more parts of the text include items (e.g., products, foods, services, and / or menu items) and currencies, wherein the currencies are units of measurement. A first translated version of one or more parts of the text is displayed. In some embodiments, the first translated version of one or more parts of the text includes a visual representation of the seventh quantity with a seventh unit of measurement. In some embodiments, the first translated version adopts the first language when the specified conditions are met, allowing the computer system to automatically and simultaneously translate the text and convert the measurements in the text, which performs operations without further user input when a set of conditions have been met and provides additional control options without cluttering the user interface.

[0303] In some embodiments, in response to detecting an input corresponding to a selection of a portion of text in a representation (e.g., 950b and / or 950d) and based on determining that the portion of text in the representation satisfies a corresponding set of criteria, the computer system displays, via a display generation component, a corresponding indication (e.g., 912a1, 912b1, and / or 912c1) representing a first quantity and a first unit of measurement. In some embodiments, based on determining that the first quantity is within a first range of values ​​for the first unit of measurement (e.g., as indicated by 912a-912c), the corresponding indication (e.g., 912a1, 912b1, and / or 912c1) is a first indication. In some embodiments, based on determining that the first quantity is within a second range of values ​​for the first unit of measurement (e.g., as indicated by 912a-912c), wherein the second range of values ​​is different from the first range of values ​​(e.g., not within the first range of values), the corresponding indication (e.g., 912a1, 912b1, and / or 912c1) is a second indication that is different from (e.g., visually different from and / or represented by one or more different words, symbols, characters, and / or images) the first indication. In some embodiments, the second indication corresponds to the second range of values, and the first indication corresponds to the first range of values. In some embodiments, the computer system does not display the corresponding indication after the first quantity having the first unit of measurement has been converted (e.g., as described above and with respect to FIG. 9E to FIG. 9F912b) (e.g., an indication indicating that zero degrees Celsius is colder (such as a corresponding indication) will not change even if zero degrees Celsius is converted to Fahrenheit or Kelvin). Displaying the corresponding indication as a different indication based on whether the first quantity is within a first value range of the first measurement unit or a second value range of the first measurement unit provides visual feedback to the user about how the first quantity relates to the first measurement unit and / or the measurement type of the first measurement unit, and provides feedback to the user about the indication of the value even if the user is not familiar with the measurement system and / or the measurement unit accompanying the value, which provides visual feedback to the user.

[0304] In some embodiments, the corresponding set of criteria includes criteria that are met when determining that a location associated with a computer system is one of a set of locations (e.g., as described above with respect to FIG. 9A to FIG. 9B and / or Figure 9H Displaying a corresponding user interface for converting a first measurement result into one or more other measurement units when specified conditions are met allows a computer system to automatically display conversions of the measurement results in a representation based on location, which is performed when a set of conditions have been met without further user input.

[0305] In some embodiments, the location associated with the computer system is determined via a system setting (e.g., 932) (e.g., a locale setting and / or a device locale setting) (e.g., a setting that does not change (e.g., without additional user input) based on the location of the computer system (e.g., once the setting is set). In some embodiments, the setting is set manually by a user of the computer system. Displaying a corresponding user interface for converting a first measurement result into one or more other units of measurement when specified conditions are met allows the computer system to automatically display a conversion of the measurement result in the representation based on the location determined via the system setting (e.g., a device locale setting), which performs the operation without further user input when a set of conditions have been met.

[0306] In some embodiments, a location associated with a computer system is determined via geographic location information (e.g., information that varies based on the location of the computer system and / or based on data detected by one or more GPS sensors in communication with the computer system) (e.g., as described above with respect to FIG. 9A to FIG. 9B and / or Figure 9H Displaying a corresponding user interface for converting a first measurement result into one or more other measurement units when specified conditions are met allows a computer system to automatically display a conversion of the measurement result in a representation based on a location determined via geographic location information, performing the operation without further user input when a set of conditions have been met.

[0307] In some embodiments, the set of locations is a set of locations using multiple measurement units (e.g., multiple types of measurement units) corresponding to the first measurement unit (e.g., as described above with respect to FIG. 9A to FIG. 9B and / or Figure 9H Displaying a corresponding user interface for converting a first measurement result into one or more other measurement units when specified conditions are met allows a computer system to automatically display conversion of measurement results in a portion of text based on locations where multiple types of measurement units are used that correspond to the first measurement unit, performing the operation without further user input when a set of conditions have been met.

[0308] In some embodiments, the corresponding standard set includes a first unit of measurement that is not a native unit of measurement in a second location associated with the computer system (e.g., a commonly used unit of measurement and / or a unit of measurement that is identified (e.g., by the computer system) as commonly used in the second location) (e.g., as described above with respect to FIG. 9A to FIG. 9B and / or Figure 9H The criteria are met when the first measurement is associated with a location associated with the computer system (e.g., based on (e.g., based on and / or via) current (e.g., detected within the last 1 minute to 60 minutes, 1 day to 31 days, and / or 1 week to 8 weeks) geographic location information and / or current system settings). Displaying a corresponding user interface for converting a first measurement result into one or more other measurement units when the specified conditions are met allows the computer system to automatically display a conversion of the measurement result in a portion of the text in the representation based on whether the measurement unit is native to a location associated with the computer system, which performs an operation without further user input when a set of conditions have been met.

[0309] Note that the above reference method 1000 (e.g., Fig.10 ) also apply in a similar manner to the methods described below / above. For example, method 1000 optionally includes one or more of the characteristics of the various methods described below with reference to method 1200. For example, method 1000 can be used to convert one or more parts of a media representation while providing a description of one or more symbols in the media representation based on method 1200.

[0310] FIG. 11A to FIG. 11G An exemplary user interface for providing a description of one or more symbols in a media representation according to some embodiments is illustrated. FIG. 11A to FIG. 11G The user interface in is used to illustrate the process described below, including Fig.12 process.

[0311] Fig.11AComputer system 700 is illustrated displaying a media viewer user interface including an application control region 1192, a media viewer region 1194, and an application control region 1196. Media viewer region 1194 includes an enlarged representation 1104a that represents the same media item as thumbnail representation 1106a. Media viewer region 1194 is substantially not covered by controls, while application control region 1192 and application control region 1196 are substantially covered by controls. Enlarged representation 1104a includes a person standing under a sign. Enlarged representation 1104a does not include one or more symbols, such as the following reference FIG. 11B to FIG. 11G The symbols discussed (e.g., one or more signs, road signs, washing symbols, packaging symbols and / or material hazard symbols).

[0312] The application control area 1196 includes some of the thumbnail representations 1106 (e.g., 1106a-1106c) displayed in a single row. Because the enlarged representation 1104a is displayed in the media viewer area 1194, the thumbnail representation 1112a is displayed as being selected. Specifically, the thumbnail representation 1112a is displayed as being in the middle by being displayed with space with other thumbnails (e.g., 1112b and 1112c). Fig.11A In addition, the application control area 1196 includes a share control 1126a (e.g., when selected, causes the computer system 600 to initiate a process for transferring the media item represented by the enlarged representation 1104a), a favorites control 1126b (e.g., when selected, causes the computer system 600 to mark / unmark the media item represented by the enlarged representation 1104a as favorite media), an information control 1126c (e.g., when selected, causes the computer system 600 to display additional information about the media item represented by the enlarged representation 1104a), and a recycle bin control 1126d (e.g., when selected, causes the computer system 600 to delete (or initiate a deletion process) the media item represented by the enlarged representation 1104a). Fig.11A , computer system 600 detects a right swipe input 1150a on media viewer area 1194 and / or magnified representation 1104a.

[0313] like Fig. 11BAs shown, in response to detecting right swipe input 1150a, computer system 600 displays enlarged representation 1104b and stops displaying enlarged representation 1104a. Enlarged representation 1104b includes Nigerian flag 1104b1 and United States flag 1104b2, but does not include flag description 1120a and flag description 1120b. Instead, computer system 700 displays flag description 1120a and flag description 1120b by overlaying each description on a corresponding portion of enlarged representation 1104b. As further evidence that enlarged representation 1104b does not include flag description 1120a and flag description 1120b, enlarged representation 1104b can be compared to thumbnail media representation 1106b representing the same media item. Fig. 11B As shown, thumbnail media representation 1106b does not include banner description 1120a or any representation of banner description 1120b and is a smaller version of enlarged representation 1104b. Fig. 11B , computer system 600 displays flag description 1120a because it is determined that Nigeria flag 1104b1 has a set of one or more attributes that are representative of the Nigerian flag. Therefore, flag description 1120a is a description that is representative of Nigeria flag 1104b1 ("Flag of the Federal Republic of Nigeria"). Similarly, in Fig. 11B , computer system 600 displays flag description 1120b because it is determined that United States flag 1104b2 has a set of one or more attributes that are representative of a United States flag. Therefore, flag description 1120b is a description that is representative of United States flag 1104b2 ("flag of the United States of America"). Notably, computer system 600 overlays flag description 1120a on a portion of enlarged representation 1104b proximate to Nigerian flag 1104b1, and overlays flag description 1120b on a portion of enlarged representation 1104b proximate to United States flag 1104b2. In some embodiments, computer system 600 overlays flag description 1120a on a portion of enlarged representation 1104b proximate to United States flag 1104b2. Fig. 11B One or more of the flag description 1120a and the flag description 1120b may be displayed in another portion of the user interface of the display device and / or one or more of the flags may not be overlaid on a portion of the enlarged representation 1104b. Fig. 11B , the computer system 600 detects a tap input 1150b on the Nigerian flag 1104b1.

[0314] like Fig. 11C As shown, in response to detecting the tap input 1150b, the computer system 600 displays additional descriptions 1120c, which include additional descriptions about the Nigerian flag 1104b1. Fig. 11CAs shown, in response to detecting tap input 1150b, computer system 600 does not display any additional description related to and / or near United States flag 1104b2 because input 1150b is not directed to United States flag 1104b2. FIG. 11B to FIG. 11C As shown, computer system 600 can display additional information about a symbol based on input pointing to the symbol. Fig. 11C In some embodiments, the computer system 600 continues to display the flag descriptions 1120a-1120b on the enlarged representation 1104b in response to detecting the tap input 1150b. In some embodiments, the computer system 600 stops displaying one or more of the flag descriptions 1120a-1120b in response to detecting the tap input 1150b. In some embodiments, in response to detecting the tap input 1150b, the computer system 600 emphasizes the Nigerian flag 1104b1 relative to the United States flag 1104b2 and / or emphasizes the additional description 1120c relative to one or more of the flag descriptions 1120a-1120b. Fig. 11C , the computer system 600 detects a right swipe input 1150c on the enlarged representation 1104b.

[0315] like Fig.11D As shown, in response to detecting the right swipe input 1150c, the computer system 600 displays the enlarged representation 1104c and stops displaying the enlarged representation 1104c. Fig.11D As shown, the enlarged representation 1104c includes the road sign 1104c1 but does not include the road sign description 1120d (e.g., as evidenced by the thumbnail representation 1160c including the road sign 1104c1 but not the road sign description 1120d, for reasons similar to those described above with respect to Fig. 11B 1104b and thumbnail representation 1160b in FIG. Fig.11D In the example above, it is determined that road sign 1104c1 has a set of one or more attributes that represent a particular type of road sign (a "slippery when wet" road sign). Fig.11D As shown, because it is determined that road sign 1104c1 has a set of one or more attributes indicative of a particular type of road sign, computer system 600 displays road sign description 1120d ("Slippery When Wet") on the portion of zoomed-in representation 1104c. Fig.11D , the computer system detects a right swipe input 1150d on the enlarged representation 1104c.

[0316] like Fig.11E As shown, in response to detecting the right swipe input 1150d, the computer system 600 displays the enlarged representation 1104d and stops displaying the enlarged representation 1104c. Fig.11EAs shown, the enlarged representation 1104d includes the wash representations 1104d1-1104d4 but does not include the wash symbol description 1120e (e.g., as evidenced by the thumbnail representation 1160d including the wash representations 1104d1-1104d4 but does not include the wash symbol description 1120e, for reasons similar to those described above with respect to Fig. 11B As described in the enlarged representation 1104b and the thumbnail representation 1160b in FIG. Fig.11E As shown, wash representations 1104d1-1104d4 are determined to have a set of one or more attributes representing different types of wash symbols. Fig.11E As shown, because it is determined that the wash representations 1104d1-1104d4 have a set of one or more attributes representing different types of wash symbols, the computer system 600 displays the wash symbol description 1120e ("Do not wash or bleach this item. This item can be ironed at low heat or professionally dry cleaned."). It is worth noting that in Fig.11E In , the computer system 600 provides a single description for multiple wash symbols (e.g., wash representations 1104d1-1104d4). Here, the computer system 600 provides a single description because the computer system 600 has determined that the wash symbols should be interpreted as a group (e.g., rather than as a single description). FIG. 11B to FIG. 11C In some embodiments, the computer system 600 interprets multiple symbols individually and / or separately, as in the flag interpreted in the text. In some embodiments, the computer system 600 provides a single description for multiple symbols, such as multiple wash symbols, packaging symbols, and / or material hazard symbols. In some embodiments, the computer system 600 interprets multiple symbols individually to provide a single description. In some embodiments, the computer system 600 interprets multiple symbols as groups to provide a single description. In some embodiments, the computer system 600 displays a description of the symbol being interpreted as the basis simultaneously with the descriptions of the symbols being interpreted individually. In some embodiments, in response to detecting input directed to wash symbol 1104d1, the computer system 600 displays a description corresponding to wash symbol 1104d1. In some embodiments, in response to detecting input directed to wash symbol 1104d2, the computer system 600 displays a description corresponding to wash symbol 1104d2 that is different from the description corresponding to wash symbol 1104d1. Fig.11E , the computer system 600 detects a right swipe input 1150e on the enlarged representation 1104d.

[0317] like Fig.11FAs shown, in response to detecting the right swipe input 1150e, the computer system 600 displays the enlarged representation 1104e and stops displaying the enlarged representation 1104d. The enlarged representation 1104e includes a product that includes the material hazard symbol 1104e1 and the packaging symbol 1104e2 but does not include the material hazard symbol 1120f and the packaging symbol 1120g (e.g., as evidenced by the thumbnail representation 1160e that includes the material hazard symbol 1104e1 and the packaging symbol 1104e2 but does not include the material hazard symbol description 1120f and the packaging symbol description 1120g, for reasons similar to those described above with respect to Fig. 11B 1104b and thumbnail representation 1160b in FIG. Fig.11F In the embodiment, the material hazard symbol 1104e1 is determined to have a set of one or more attributes that represent a particular type of material hazard symbol. In addition, the packaging symbol 1104e2 is determined to have a set of one or more attributes that represent a particular type of packaging symbol. Fig.11F In , because it is determined that material hazard symbol 1104e1 has a set of one or more attributes that represent a particular type of material hazard symbol (e.g., a "toxic" symbol), computer system 600 displays material hazard symbol description 1120f ("toxic") on the portion of enlarged representation 1104e. Fig.11F Because it is determined that packaging symbol 1104e2 has a set of one or more attributes that represent a particular type of packaging symbol (e.g., a "Not Recyclable" symbol), computer system 600 displays packaging description 1120g ("Not Recyclable") on the portion of enlarged representation 1104e.

[0318] Fig.11G An exemplary scenario is illustrated in which the computer system 600 detects one or more objects (e.g., one or more types of objects) and the number of the one or more objects in a media representation and overlays representations of the objects and the number of objects on the media representation. Fig.11G As shown, the computer system 600 displays an enlarged representation 1104f of jelly beans 1104f1 in a bowl. Fig.11G In the example, when the enlarged representation 1104f is displayed, it is determined that 128 jelly beans are depicted in the enlarged representation 1104f. Fig.11G As shown, because it is determined that 128 jelly beans are depicted in the enlarged representation 1104f, the computer system 600 displays the description 1120h ("128 jelly beans"). Fig.11G As shown, the computer system 600 displays an enlarged representation 1104g including marble 1104g1. Fig.11G In the example, when the enlarged representation 1104g is displayed, it is determined that 10 marbles are depicted in the enlarged representation 1104g. Fig.11GAs shown, because it is determined that 10 marbles are depicted in the enlarged representation 1104g, the computer system 600 displays the description 1120i ("10 marbles"). Fig.11G As shown, the computer system 600 displays an enlarged representation 1104h including a pencil 1104h1. Fig.11G In the example, when the enlarged representation 1104h is displayed, it is determined that five pencils are depicted in the enlarged representation 1104h. Fig.11G As shown, because it is determined that five pencils are depicted in the enlarged representation 1104h, the computer system 600 displays the description 1120j ("5 pencils"). Fig.11G As shown, the computer system 600 displays an enlarged representation 1104i of a book 1104i1. Fig.11G In the example, when the enlarged representation 1104i is displayed, it is determined that three books are depicted in the enlarged representation 1104i. Fig.11G As shown, because it is determined that three books are depicted in the enlarged representation 1104i, the computer system 600 displays the description 1120k ("3 books").

[0319] Fig.12 1 is a flowchart illustrating a method for providing a description of one or more symbols in a media representation according to some embodiments. Method 1200 is performed at a computer system (e.g., 100, 300, 500, and / or 600) (e.g., a smart phone, a desktop computer, a laptop, a tablet computer) that communicates with a display generation component (e.g., a display controller, a touch-sensitive display system). In some embodiments, the computer system communicates with one or more input devices (e.g., a touch-sensitive surface). Some operations in method 1200 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0320] As described below, method 1200 provides an intuitive way to provide a description of one or more symbols in a media representation. The method reduces the cognitive burden on a user to provide a description of one or more symbols in a media representation, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling a user to provide a description of one or more symbols in a media representation faster and more efficiently saves power and increases the time interval between battery charges.

[0321] Method 1200 is performed at a computer system (e.g., 600) (e.g., a smartphone, a desktop computer, a laptop computer, a tablet computer) in communication with a display generation component (e.g., a display controller, a touch-sensitive display system). In some embodiments, the computer system communicates with one or more input devices (e.g., a touch-sensitive surface).

[0322] The computer system detects ( 1202 ) (eg, receives) a request to display a representation of a media item (eg, 1150 a , 1150 c , 1150 d , 1150 e , 1150 f ).

[0323] In response to detecting a request to display a representation of a media item (e.g., 1150a, 1150c, 1150d, 1150e, 1150f), the computer system displays (1204) via a display generation component a corresponding user interface including a representation of the media item (e.g., 1104b-1104e), wherein displaying the corresponding user interface includes: based on determining that the representation of the media item includes one or more symbols, displaying via the display generation component at least a first symbol of the one or more symbols (e.g., a flag, a washing symbol, a packaging symbol, a material hazard symbol, a road sign symbol, and / or another non-verbal and / or textual symbol) A representation (e.g., 1120a-1120g) of an interpretation (e.g., text) (e.g., text representations and / or text information associated with the symbol and / or text information as an interpretation of the symbol) of a media item (e.g., a graphic image consisting solely of text) (e.g., a symbol that does not include words and / or phrases) is displayed simultaneously with a representation of the media (e.g., 1104b-1104e) (1206), wherein the representation of the interpretation of one or more symbols in the media item is separate from the media item (e.g., not part of the visual content of the media item) (e.g., the representation of the interpretation of the one or more symbols is automatically generated by the device and / or is not part of the media item). In some embodiments, the representation of the interpretation of one or more symbols in the media item is not part of the representation of the media (e.g., before receiving a request to display the representation of the media item). In some embodiments, based on determining that the representation of the media item does not include the one or more symbols, the representation of the media item is displayed but the representation of the interpretation of at least the first symbol is not displayed. Automatically displaying an interpretation of at least a first symbol of one or more symbols when specified conditions are met allows a computer system to automatically display an interpretation of one or more symbols in a media representation without additional user input, performing the operation without further user input when a set of conditions have been met.

[0324] In some embodiments, the interpretation of one or more symbols is an interpretation of one of the one or more symbols (e.g., 1120a, 1120b, 1120d, 1120f, and / or 1120g). In some embodiments, each of the one or more symbols is interpreted separately. In some embodiments, based on determining that a symbol is a first type of symbol (e.g., a symbol that can and / or should be interpreted independently (e.g., a flag and / or road sign)), the computer system displays the interpretation of the one symbol. In some embodiments, based on determining that a symbol is a second type of symbol (e.g., a symbol that cannot and / or should not be interpreted independently (e.g., a laundry, packaging, and / or material hazard symbol)), the computer system does not display the interpretation of the one symbol and / or displays the collective interpretation of the one symbol and another symbol. The representation of automatically displaying the interpretation of a symbol when specified conditions are met allows the computer system to automatically display the interpretation of one of the one or more symbols in the media representation, which performs the operation without further user input when a set of conditions have been met.

[0325] In some embodiments, the interpretation of one or more symbols is a collective interpretation of multiple symbols in the one or more symbols (e.g., 1120e). In some embodiments, one or more symbols are collectively interpreted. The automatic display of the interpretation of a symbol when specified conditions are met allows the computer system to automatically display the collective interpretation of multiple symbols in the media representation, which performs the operation without further user input when a set of conditions have been met.

[0326] In some embodiments, while displaying a representation of media including one or more symbols (e.g., 1104b-1104e), the computer system detects an input (e.g., 1150b) pointing to a first symbol (e.g., 1104b1-1104b2) of the one or more symbols. In some embodiments, in response to detecting the input pointing to the first symbol of the one or more symbols, the computer system displays information associated with the first symbol (e.g., corresponding to and / or about the first symbol) via a display generation component (e.g., 1120c). In some embodiments, in response to detecting the input pointing to a symbol different from the first symbol of the one or more symbols, the computer system displays information associated with the corresponding symbol. In some embodiments, the computer system displays information associated with the corresponding symbol but does not display information associated with the first symbol. In some embodiments, the information associated with the corresponding symbol is different from the information associated with the first symbol. Displaying information associated with the first symbol in response to detecting the input pointing to the first symbol of the one or more symbols provides the user with additional controls for obtaining information associated with the one or more symbols, which provides additional control options without cluttering the user interface.

[0327] In some embodiments, one or more symbols include one or more flags (e.g., 1104b1-1104b2) (e.g., flags for countries, states, provinces, and / or regions, and / or flags for teams (e.g., sports teams and / or another team). In some embodiments, the representation of the interpretation of at least a first symbol (e.g., 1120a-1120b) includes (and / or is) the interpretation of the one or more flags. Automatically displaying the representation of the interpretation of at least a first symbol of the one or more symbols including the one or more flags when specified conditions are met allows the computer system to automatically display the interpretation of the one or more flags without additional user input, which performs the operation without further user input and provides visual feedback when a set of conditions have been met.

[0328] In some embodiments, the one or more symbols include one or more washing symbols (e.g., 1104d1-1104d4) (e.g., one or more wash, bleach, iron, dry clean, dry, normal machine wash, cold machine wash, warm machine wash, hot machine wash, hang dry, dry in the shade, do not iron, and / or do not bleach symbols). In some embodiments, the representation of the interpretation of at least a first symbol (e.g., 1120e) includes (and / or is) the interpretation of the one or more washing symbols. Automatically displaying the representation of the interpretation of at least a first symbol of the one or more symbols including the one or more washing symbols when specified conditions are met allows the computer system to automatically display the interpretation of the one or more washing symbols without additional user input, which performs an operation without further user input and provides visual feedback when a set of conditions have been met.

[0329] In some embodiments, the one or more symbols include one or more packaging symbols (e.g., 1104e2) (e.g., one or more fragile, keep dry, compostable, recyclable, handle with care, this way up, do not open with knife, do not place near magnet, two people lift, do not drop, stacking height / weight, do not stack, food safe, caution, and / or kite mark symbols). In some embodiments, the representation of the interpretation of at least a first symbol (e.g., 1120g) includes (and / or is) the interpretation of one or more packaging symbols. Automatically displaying the representation of the interpretation of at least a first symbol of the one or more symbols including the one or more packaging symbols when specified conditions are met allows a computer system to automatically display the interpretation of the one or more packaging symbols without additional user input, which performs an operation without further user input and provides visual feedback when a set of conditions have been met.

[0330] In some embodiments, the one or more symbols include one or more material hazard symbols (e.g., 1104e1) (e.g., one or more explosive (e.g., symbol: bomb), flammable (e.g., symbol: flame), oxidizing (e.g., symbol: flame on circle), corrosive (e.g., symbol: corrosion), acute toxic (e.g., symbol: skull and crossbone), and / or environmentally hazardous (e.g., symbol: environment) symbols). In some embodiments, the representation of the interpretation of at least a first symbol (e.g., 1120f) includes (and / or is) the interpretation of the one or more material hazard symbols. Automatically displaying the representation of the interpretation of at least a first symbol of the one or more symbols including the one or more material hazard symbols when specified conditions are met allows the computer system to automatically display the interpretation of the one or more material hazard symbols without additional user input, which performs an operation without further user input and provides visual feedback when a set of conditions have been met.

[0331] In some embodiments, the one or more symbols include one or more road signs (e.g., 1104c1) (e.g., one or more traffic signs, red and white regulatory signs, warning signs, highway construction and maintenance signs, service signs, and / or guide signs). In some embodiments, the representation of the interpretation of at least the first symbol (e.g., 1120d) includes (and / or is) the interpretation of the one or more road signs. Automatically displaying the representation of the interpretation of at least the first symbol of the one or more symbols including the one or more road signs when specified conditions are met allows the computer system to automatically display the interpretation of the one or more road signs without additional user input, which performs the operation without further user input and provides visual feedback when a set of conditions have been met.

[0332] ...

Claims

1. A method, comprising: At a computer system in communication with a display generating component: while displaying, via the display generating component, a representation of visual content comprising a first portion and a second portion, detecting an input directed to the representation of visual content, wherein the representation of visual content is a representation of an image or a video; as well as In response to detecting the input directed to the representation of the visual content and based on determining that the first portion includes a body that can be copied, providing an indication that an operation can be performed for copying the body without copying the second portion. The method of claim 1 , wherein the input directed to the representation of the visual content is a press and hold input.

3. The method of any one of claims 1 to 2, wherein displaying the representation of the visual content comprises displaying the body at a first position and displaying the second portion at a second position, the method further comprising: upon detecting the input directed toward the representation of the visual content, detecting movement of the input directed toward the representation of the visual content; as well as In response to detecting movement of the input directed toward the representation of the visual content, display of the body is moved from the first position to a third position without moving display of the second portion from the second position.

4. The method according to claim 3, further comprising: upon detecting the input directed toward the representation of the visual content and while the subject is displayed at the third position, detecting an end of the input directed toward the representation of the visual content; as well as In response to detecting the end of the input directed to the representation of the visual content, displaying the body at the third location without displaying the second portion at the third location. 5 . The method of claim 3 , wherein the representation of the visual content is displayed in a first application, and wherein the third location is in a second application different from the first application.

6. The method of claim 3, wherein the representation of the visual content is displayed in a first area of ​​a third application, and wherein the third location is in a second area of ​​the third application that is different from the first area of ​​the third application.

7. The method according to claim 3, wherein: displaying the representation of the visual content includes displaying the subject in the representation of the visual content at a first size; Moving the display of the body from the first position to the third position comprises moving a first user interface object that includes the first representation of the body but does not include the first representation of the second portion; and The representation of the subject in the first user interface object is displayed at a second size that is smaller than the first size.

8. The method according to claim 3, wherein: displaying the representation of the visual content includes displaying the subject in the representation of the visual content at a third size; and Moving display of the body from the first position to the third position includes moving a second user interface object including a second representation of the body that is emphasized relative to a second representation of the second portion.

9. A method according to any one of claims 1 to 2, wherein detecting the input pointing to the representation of the visual content includes detecting a pointer activation event and detecting that the pointer is hovering over a third user interface object, which, when selected, causes the computer system to copy the body but not the second portion.

10. The method according to claim 9, further comprising: upon detecting that the pointer is hovering over the third user interface object, detecting movement of the pointer away from the third user interface object; as well as In response to detecting movement of the pointer away from the third user interface object, ceasing to display the indication that the operation for copying the body without copying the second portion can be performed.

11. The method according to any one of claims 1 to 2, further comprising: In response to detecting the input directed to the representation of the visual content, providing an indication that an operation can be performed to modify the representation of the visual content such that the representation of the visual content includes the body but does not include the second portion.

12. The method according to any one of claims 1 to 2, wherein: said first portion of said representation of visual content comprises a first body and a second body; and the indication that the operation for copying the body but not the second part can be performed is an indication that the operation for copying the first body but not the second body can be performed based on determining that the input directed to the representation of the visual content is directed to the first body in the first portion; and Based on determining that the input pointing to the representation of the visual content points to the second body in the first part that is different from the first body, the indication that the operation for copying the body but not the second part can be performed is an indication that the operation for copying the second body but not the first body can be performed.

13. The method according to any one of claims 1 to 2, further comprising: In response to detecting the input directed to the representation of the visual content and based on determining that the first portion is not a body that can be copied, forgoing providing the indication that the operation for copying the body but not the second portion of the visual content can be performed.

14. The method according to any one of claims 1 to 2, further comprising: In response to detecting the input directed to the representation of the visual content and based on determining that the first portion of the representation of the visual content includes a third body and a fourth body that can be copied, an indication is provided that an operation can be performed for copying the third body and the fourth body but not copying the second portion of the visual content.

15. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generating component and a touch-sensitive surface, the one or more programs comprising instructions for performing the method according to any one of claims 1 to 14.

16. A computer system configured to communicate with a display generation component and a touch-sensitive surface, the computer system comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 1 to 14.

17. A computer system configured to communicate with a display generation component and a touch-sensitive surface, the computer system comprising: A component for carrying out the method according to any one of claims 1 to 14.

18. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generating component, the one or more programs comprising instructions for performing the method according to any one of claims 1 to 14.

Images