Showing virtual demos for cinema applications

Abstract

Some examples of the present disclosure relate to systems and methods for displaying a virtual presentation associated with a cinema application in an augmented or fully immersive three-dimensional environment. In one or more examples of the present disclosure, the systems and methods include receiving a request to join the virtual presentation, and in response to receiving the request to join the virtual presentation, displaying the virtual presentation in a three-dimensional environment. The cinema presentation is displayed in a manner that facilitates efficient communication between one or more presenters and one or more audience members who are part of the virtual presentation.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 586,699, filed on September 29, 2023, and U.S. Patent Application No. 18 / 893,736, filed on September 23, 2024, the contents of both applications are incorporated herein by reference in their entirety for all purposes. Technical Field

[0003] The present invention generally relates to presentation of cinema applications displayed in a three-dimensional environment. Background Art

[0004] Some electronic devices include applications that facilitate a theater presentation session between a presenter and one or more audience members, each using their own separate device. Summary of the invention

[0005] Some examples of the present disclosure relate to systems and methods for displaying a virtual presentation associated with a cinema application in an enhanced or fully immersive three-dimensional environment. In one or more examples of the present disclosure, the systems and methods include receiving a request to join the virtual presentation, and displaying the virtual presentation in a three-dimensional environment in response to receiving the request to join the virtual presentation. The cinema presentation is displayed in a manner that facilitates efficient communication between one or more presenters and one or more audience members who are part of the virtual presentation. According to some examples, the virtual presentation is displayed to each audience member in an audience viewpoint assuming that the user of the electronic device is an audience member of the presentation, and optionally, each corresponding audience member is able to view the virtual presentation from the same perspective (e.g., in front of the presentation stage and in front center).

[0006] In some examples, one or more additional audience members are displayed to one or more sides of the user's viewpoint. The representation of one or more additional audience members is optionally based on real-world users who are also watching the virtual presentation on their own independent devices. For example, the size of the audience represented in the virtual presentation is somehow related to the number of audience members who join the virtual presentation. In some examples, one or more audience members may participate in a direct communication session with the user of the electronic device before joining the virtual presentation. For example, a three-dimensional environment is presented by multiple devices communicating in a multi-user communication session, and optionally, a representation (e.g., avatar) of each user participating in the multi-user communication session is displayed in the three-dimensional environment of the multi-user communication session. In some examples, users who participate in a direct communication session with the user of the electronic device can be displayed differently by the electronic device compared to other audience members who do not participate in the direct communication session with the user of the electronic device. For example, those participants in the direct communication session with the user are optionally displayed as closer to other audience members and displayed at a higher level of detail than other audience members, and other audience members, although watching the same virtual presentation watched by the user of the electronic device on their own devices, did not participate in the direct communication session with the user of the electronic device before joining the virtual presentation. In some examples, the level of detail at which each audience member is displayed can be based on their distance and / or proximity to the user of the electronic device in the three-dimensional environment. In some examples, a user participating in a direct communication session is represented as an avatar having features unique to the user, while other audience members not participating in the direct communication session are represented as one or more generic type avatars (e.g., without features unique to those users, or with fewer features unique to those users).

[0007] In some examples, the virtual presentation includes an audience reaction user interface that is configured to receive a reaction from a user of the device to the virtual presentation (e.g., via input to the reaction user interface or via gestures or audio, etc.). The virtual presentation optionally displays aggregate reactions from other audience members to the virtual presentation (e.g., optionally using an audience reaction user interface). In one or more examples, the electronic device may play audio that mimics the real-world sounds that the audience would produce based on the aggregate reactions received by the electronic device. In some examples, the user of the electronic device may indicate their reaction by selecting one or more reaction selection buttons (e.g., predefined reaction selection buttons) on the audience reaction user interface. Additionally or alternatively, the user may express a reaction by moving one or more parts of their body (e.g., clapping, raising hands, waving, etc.), and the electronic device may detect and recognize the reaction as corresponding to one of the one or more audience reactions.

[0008] In some examples, one or more audience members may be promoted to roles different from ordinary audience members. In one or more examples, audience members may be promoted to presenters by a presenter or other administrator of a virtual presentation. In one or more examples, in response to receiving an indication that a user of an electronic device has been promoted to a presenter in a virtual presentation, the electronic device modifies the user's viewpoint to a presenter viewpoint. In one or more examples, in response to receiving an indication that another audience member different from the user of the electronic device has been promoted to a presenter in a virtual presentation, the electronic device updates the virtual presentation to display the promoted audience member as a presenter (e.g., including an avatar representation with unique details of the promoted audience member). In some examples, an audience member may be promoted to a questioner. In response to receiving an indication that a user of an electronic device has been promoted to a presenter, the electronic device displays the virtual presentation from a questioner viewpoint. In some examples, in response to receiving an indication that another audience member different from the user of the electronic device has been promoted as a questioner in a virtual presentation, the electronic device updates the virtual presentation to display the promoted audience member as the questioner (e.g., optionally in a predetermined location, such as near the stage, but off-center, optionally including an avatar representation with unique details of the promoted audience member), and optionally including a representation of a microphone or ramped podium or other virtual object). BRIEF DESCRIPTION OF THE DRAWINGS

[0009] For a better understanding of the various examples described herein, reference should be made to the following detailed description and the following drawings. Throughout the drawings, like reference numerals generally refer to corresponding parts.

[0010] Figure 1 An electronic device presenting an extended reality environment according to some examples of the present disclosure is shown.

[0011] Figure 2 A block diagram illustrating an example architecture of a device according to some examples of the present disclosure.

[0012] FIG. 3A to FIG. 3M An exemplary virtual presentation environment associated with a theater application according to examples of the present disclosure is shown.

[0013] Figure 4 An exemplary flow chart is shown illustrating a method of displaying a virtual presentation associated with a theater application according to an example of the present disclosure. DETAILED DESCRIPTION

[0014] Some examples of the present disclosure relate to systems and methods for displaying a virtual presentation associated with a cinema application in an enhanced or fully immersive three-dimensional environment. In one or more examples of the present disclosure, the systems and methods include receiving a request to join the virtual presentation, and displaying the virtual presentation in a three-dimensional environment in response to receiving the request to join the virtual presentation. The cinema presentation is displayed in a manner that facilitates efficient communication between one or more presenters and one or more audience members who are part of the virtual presentation. According to some examples, the virtual presentation is displayed to each audience member in an audience viewpoint assuming that the user of the electronic device is an audience member of the presentation, and optionally, each corresponding audience member is able to view the virtual presentation from the same perspective (e.g., in front of the presentation stage and in front center).

[0015] In some examples, one or more additional audience members are displayed to one or more sides of the user's viewpoint. The representation of one or more additional audience members is optionally based on real-world users who are also watching the virtual presentation on their own independent devices. For example, the size of the audience represented in the virtual presentation is somehow related to the number of audience members who join the virtual presentation. In some examples, one or more audience members may participate in a direct communication session with the user of the electronic device before joining the virtual presentation. For example, a three-dimensional environment is presented by multiple devices communicating in a multi-user communication session, and optionally, a representation (e.g., avatar) of each user participating in the multi-user communication session is displayed in the three-dimensional environment of the multi-user communication session. In some examples, users who participate in a direct communication session with the user of the electronic device can be displayed differently by the electronic device compared to other audience members who do not participate in the direct communication session with the user of the electronic device. For example, those participants in the direct communication session with the user are optionally displayed as closer to other audience members and displayed at a higher level of detail than other audience members, and other audience members, although watching the same virtual presentation watched by the user of the electronic device on their own devices, did not participate in the direct communication session with the user of the electronic device before joining the virtual presentation. In some examples, the level of detail at which each audience member is displayed can be based on their distance and / or proximity to the user of the electronic device in the three-dimensional environment. In some examples, a user participating in a direct communication session is represented as an avatar having features unique to the user, while other audience members not participating in the direct communication session are represented as one or more generic type avatars (e.g., without features unique to those users, or with fewer features unique to those users).

[0016] In some examples, the virtual presentation includes an audience reaction user interface that is configured to receive a reaction from a user of the device to the virtual presentation (e.g., via input to the reaction user interface or via gestures or audio, etc.). The virtual presentation optionally displays aggregate reactions from other audience members to the virtual presentation (e.g., optionally using an audience reaction user interface). In one or more examples, the electronic device may play audio that mimics the real-world sounds that the audience would produce based on the aggregate reactions received by the electronic device. In some examples, the user of the electronic device may indicate their reaction by selecting one or more reaction selection buttons (e.g., predefined reaction selection buttons) on the audience reaction user interface. Additionally or alternatively, the user may express a reaction by moving one or more parts of their body (e.g., clapping, raising hands, waving, etc.), and the electronic device may detect and recognize the reaction as corresponding to one of the one or more audience reactions.

[0017] In some examples, one or more audience members may be promoted to roles different from ordinary audience members. In one or more examples, audience members may be promoted to presenters by a presenter or other administrator of a virtual presentation. In one or more examples, in response to receiving an indication that a user of an electronic device has been promoted to a presenter in a virtual presentation, the electronic device modifies the user's viewpoint to a presenter viewpoint. In one or more examples, in response to receiving an indication that another audience member different from the user of the electronic device has been promoted to a presenter in a virtual presentation, the electronic device updates the virtual presentation to display the promoted audience member as a presenter (e.g., including an avatar representation with unique details of the promoted audience member). In some examples, an audience member may be promoted to a questioner. In response to receiving an indication that a user of an electronic device has been promoted to a presenter, the electronic device displays the virtual presentation from a questioner viewpoint. In some examples, in response to receiving an indication that another audience member different from the user of the electronic device has been promoted as a questioner in a virtual presentation, the electronic device updates the virtual presentation to display the promoted audience member as the questioner (e.g., optionally in a predetermined location, such as near the stage, but off-center, optionally including an avatar representation with unique details of the promoted audience member), and optionally including a representation of a microphone or ramped podium or other virtual object).

[0018] Figure 1 An electronic device 101 is illustrated that presents an extended reality (XR) environment (e.g., a computer-generated environment that optionally includes representations of physical and / or virtual objects) according to some examples of the present disclosure. In some examples, such as Figure 1 As shown, the electronic device 101 is a head mounted display or other head mounted device configured to be worn on the head of the user of the electronic device 101. Figure 2An example of an electronic device 101 is described by using an architectural block diagram of FIG. Figure 1 As shown, electronic device 101 and table 106 are located in a physical environment. The physical environment may include physical features, such as physical surfaces (e.g., floors, walls) or physical objects (e.g., tables, lights, etc.). In some examples, electronic device 101 may be configured to detect and / or capture an image of the physical environment including table 106 (shown in the field of view of electronic device 101).

[0019] In some examples, such as Figure 1 As shown, the electronic device 101 includes one or more internal image sensors 114a (eg, as described below with reference to FIG. 1 ) oriented toward the user's face. Figure 2 101 and 102. In some examples, the internal image sensor 114a is used for eye tracking (e.g., detecting the gaze of the user). The internal image sensor 114a is optionally arranged on the left and right portions of the display 120 to enable eye tracking of the user's left and right eyes. In some examples, the electronic device 101 also includes external image sensors 114b and 114c facing outward from the user to detect and / or capture the physical environment of the electronic device 101 and / or the movement of the user's hands or other body parts.

[0020] In some examples, the display 120 has a field of view visible to the user (e.g., it may or may not correspond to the field of view of the external image sensors 114b and 114c). Because the display 120 is optionally part of the head-mounted device, the field of view of the display 120 is optionally the same as or similar to the field of view of the user's eyes. In other examples, the field of view of the display 120 may be smaller than the field of view of the user's eyes. In some examples, the electronic device 101 may be an optical see-through device, in which the display 120 is a transparent or translucent display through which parts of the physical environment can be directly viewed. In some examples, the display 120 may be included in a transparent lens and may overlap with all or only a portion of the transparent lens. In other examples, the electronic device may be a video pass-through device, in which the display 120 is an opaque display configured to display an image of the physical environment captured by the external image sensors 114b and 114c.

[0021] In some examples, in response to a trigger, the electronic device 101 may be configured to display in the XR environment Figure 1, which does not exist in the physical environment but is displayed in the XR environment on top of the real-world table 106 (or its representation). Optionally, in response to detecting the plane of the table 106 in the physical environment 100, the virtual object 104 can be displayed on the surface of the table 106 in the XR environment displayed via the display 120 of the electronic device 101.

[0022] It should be understood that virtual object 104 is a representative virtual object and may include and render one or more different virtual objects (e.g., virtual objects with various dimensions, such as two-dimensional or other three-dimensional virtual objects) in a three-dimensional XR environment. For example, a virtual object may represent an application or user interface displayed in an XR environment. In some examples, a virtual object may represent content corresponding to an application and / or displayed via a user interface in an XR environment. In some examples, virtual object 104 is optionally configured to be interactive and responsive to user input (e.g., air gestures, such as air pinch gestures, air tap gestures, and / or air touch gestures), so that a user virtually touches, taps, moves, rotates, or otherwise interacts with virtual object 104.

[0023] In some examples, displaying an object in a three-dimensional environment may include interaction with one or more user interface objects in the three-dimensional environment. For example, initiation of display of an object in a three-dimensional environment may include interaction with one or more virtual options / indicators displayed in the three-dimensional environment. In some examples, when display of an object is initiated in a three-dimensional environment, an electronic device may track the user's gaze as an input for identifying one or more virtual options / indicators as targets for selection. For example, gaze may be used to identify one or more virtual options / indicators as targets for selection using another selection input. In some examples, a virtual option / indicator may be selected using hand tracking input detected via an input device that communicates with the electronic device. In some examples, an object displayed in a three-dimensional environment may be moved and / or reoriented in the three-dimensional environment based on movement input detected via an input device.

[0024] In the following discussion, an electronic device that communicates with a display generation component and one or more input devices is described. It should be understood that the electronic device optionally communicates with one or more other physical user interface devices, such as a touch-sensitive surface, a physical keyboard, a mouse, a joystick, a hand tracking device, an eye tracking device, a stylus, etc. In addition, as described above, it should be understood that the described electronic device, display, and touch-sensitive surface are optionally distributed between two or more devices. Therefore, as used in the present disclosure, information displayed on or by an electronic device is optionally used to describe information output by the electronic device to be displayed on an independent display device (touch-sensitive or non-touch-sensitive). Similarly, as used in the present disclosure, input received on an electronic device (e.g., touch input received on a touch-sensitive surface of an electronic device, or touch input received on the surface of a stylus) is optionally used to describe input received on an independent input device, and the electronic device receives input information from the independent input device.

[0025] The device typically supports a variety of applications, such as one or more of the following applications: a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, a television channel browsing application, and / or a digital video player application.

[0026] Figure 2 A block diagram of an exemplary architecture of an electronic device 201 according to some examples of the present disclosure is shown. In some examples, the electronic device 201 includes one or more electronic devices. For example, the electronic device 201 can be a portable device, an auxiliary device for communicating with another device, a head-mounted display, etc. In some examples, the electronic device 201 corresponds to the above reference Figure 1 An electronic device 101 is described.

[0027] like Figure 2 As illustrated, the electronic device 201 optionally includes various sensors, such as one or more hand tracking sensors 202, one or more position sensors 204, one or more image sensors 206 (optionally corresponding to Figure 1114a and / or external image sensors 114b and 114c in the embodiment of the present invention), one or more touch-sensitive surfaces 209, one or more motion and / or orientation sensors 210, one or more eye tracking sensors 212, one or more microphones 213 or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), one or more display generation components 214 (optionally corresponding to Figure 1 The display 120 in the electronic device 201, one or more speakers 216, one or more processors 218, one or more memories 220 and / or communication circuits 222. One or more communication buses 208 are optionally used for communication between the above components of the electronic device 201.

[0028] The communication circuit 222 optionally includes circuits for communicating with electronic devices, networks such as the Internet, intranets, wired networks and / or wireless networks, cellular networks, and wireless local area networks (LANs). The communication circuit 222 optionally includes circuits for using near field communication (NFC) and / or short-range communication such as A circuit for communicating.

[0029] Processor 218 includes one or more general purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, memory 220 is a non-transitory computer-readable storage medium (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage device) storing computer-readable instructions, which are configured to be executed by processor 218 to perform the techniques, processes, and / or methods described below. In some examples, memory 220 may include more than one non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium may be any medium (e.g., excluding signals) that can tangibly contain or store computer-executable instructions for use by or in combination with an instruction execution system, device, and apparatus. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium may include, but is not limited to, a magnetic storage device, an optical storage device, and / or a semiconductor storage device. Examples of such storage devices include magnetic disks, optical disks based on compact disc (CD), digital versatile disc (DVD) or Blu-ray technology, and persistent solid-state memory (such as flash memory, solid-state drives, etc.).

[0030] In some examples, display generation component 214 includes a single display (e.g., a liquid crystal display (LCD), an organic light emitting diode (OLED), or other type of display). In some examples, display generation component 214 includes multiple displays. In some examples, display generation component 214 may include a display with touch capabilities (e.g., a touch screen), a projector, a holographic projector, a retinal projector, a transparent or translucent display, etc. In some examples, electronic device 201 includes touch-sensitive surfaces 209 for receiving user inputs (such as tap inputs and swipe inputs or other gestures). In some examples, display generation component 214 and touch-sensitive surface 209 form a touch-sensitive display (e.g., a touch screen integrated with electronic device 201 or a touch screen that communicates with electronic device 201 outside electronic device 201).

[0031] The electronic device 201 optionally includes an image sensor 206. The image sensor 206 optionally includes one or more visible light image sensors (such as a charge coupled device (CCD) sensor) and / or a complementary metal oxide semiconductor (CMOS) sensor operable to obtain an image of a physical object from a real-world environment. The image sensor 206 also optionally includes one or more infrared (IR) sensors, such as a passive IR sensor or an active IR sensor, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. The image sensor 206 also optionally includes one or more cameras configured to capture the movement of physical objects in the real-world environment. The image sensor 206 also optionally includes one or more depth sensors configured to detect the distance of the physical object from the electronic device 201. In some examples, information from the one or more depth sensors may allow the device to identify an object in the real-world environment and distinguish it from other objects in the real-world environment. In some examples, the one or more depth sensors may allow the device to determine the texture and / or topography of an object in the real-world environment.

[0032] In some examples, the electronic device 201 uses a combination of a CCD sensor, an event camera, and a depth sensor to detect the physical environment around the electronic device 201. In some examples, the image sensor 206 includes a first image sensor and a second image sensor. The first image sensor and the second image sensor work in tandem and are optionally configured to capture different information of physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor and the second image sensor is a depth sensor. In some examples, the electronic device 201 uses the image sensor 206 to detect the positioning and orientation of the electronic device 201 and / or the display generation component 214 in the real-world environment. For example, the electronic device 201 uses the image sensor 206 to track the positioning and orientation of the display generation component 214 relative to one or more fixed objects in the real-world environment.

[0033] In some examples, the electronic device 201 includes a microphone 213 or other audio sensor. The electronic device 201 optionally uses the microphone 213 to detect sounds from the user and / or the user's real-world environment. In some examples, the microphone 213 includes a microphone array (multiple microphones) that optionally operate in conjunction to identify ambient noise or locate a sound source in the space of the real-world environment.

[0034] The electronic device 201 includes a location sensor 204 for detecting the location of the electronic device 201 and / or the display generating component 214. For example, the location sensor 204 may include a global positioning system (GPS) receiver that receives data from one or more satellites and allows the electronic device 201 to determine the absolute location of the device in the physical world.

[0035] The electronic device 201 includes an orientation sensor 210 for detecting the orientation and / or movement of the electronic device 201 and / or the display generation component 214. For example, the electronic device 201 uses the orientation sensor 210 to track changes in the position and / or orientation of the electronic device 201 and / or the display generation component 214, such as relative to physical objects in the real world environment. The orientation sensor 210 optionally includes one or more gyroscopes and / or one or more accelerometers.

[0036] In some examples, the electronic device 201 includes a hand tracking sensor 202 and / or an eye tracking sensor 212 and / or other body tracking sensors, such as a leg tracking sensor, a torso tracking sensor, and / or a head tracking sensor. The hand tracking sensor 202 is configured to track the position / location of one or more parts of the user's hand, and / or the movement of one or more parts of the user's hand relative to the extended reality environment, relative to the display generation component 214, and / or relative to another defined coordinate system. The eye tracking sensor 212 is configured to track the position and movement of the user's gaze (more generally, eyes, face, or head) relative to the real world or extended reality environment and / or relative to the display generation component 214. In some examples, the hand tracking sensor 202 and / or the eye tracking sensor 212 are implemented together with the display generation component 214. In some examples, the hand tracking sensor 202 and / or the eye tracking sensor 212 are implemented separately from the display generation component 214.

[0037] In some examples, the hand tracking sensor 202 (and / or other body tracking sensors, such as leg, torso, and / or head tracking sensors) may use an image sensor 206 (e.g., one or more IR cameras, three-dimensional (3D) cameras, depth cameras, etc.) that captures three-dimensional information from the real world including one or more body parts (e.g., the hand, leg, torso, or head of a human user). In some examples, the hand may be resolved with sufficient resolution to distinguish fingers and their corresponding positioning. In some examples, one or more image sensors 206 are positioned relative to the user to define a field of view and interaction space of the image sensor 206, in which the finger / hand position, orientation, and / or movement captured by the image sensor is used as input (e.g., to distinguish from the user's resting hand or other hands of other people in the real-world environment). Tracking fingers / hands for input (e.g., gestures, touches, taps, etc.) may be advantageous because it does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.

[0038] In some examples, eye tracking sensor 212 includes at least one eye tracking camera (e.g., an infrared (IR) camera) and / or an illumination source (e.g., an IR light source such as an LED) that emits light toward the user's eyes. The eye tracking camera may be pointed toward the user's eyes to receive reflected IR light from the light source directly or indirectly from the eyes. In some examples, both eyes are tracked separately by corresponding eye tracking cameras and illumination sources, and focus / gaze may be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more corresponding eye tracking cameras / illumination sources.

[0039] The electronic device 201 is not limited to Figure 2Rather than components and configurations of the electronic device 201, it may include fewer components, other components, or additional components in a variety of configurations. In some examples, the electronic device 201 may be implemented between two electronic devices (e.g., as a system). In some such examples, each (or more) electronic device may each include one or more of the same components discussed above, such as various sensors, one or more display generating components, one or more speakers, one or more processors, one or more memories, and / or communication circuits. One or more people using the electronic device 201 are optionally referred to herein as one or more users of the device.

[0040] Focus is now directed to virtual presentations and interaction with one or more virtual objects displayed in a three-dimensional environment presented at an electronic device (e.g., corresponding to electronic device 201), and specifically, to interaction with a virtual presentation displayed in a three-dimensional environment and associated with a theater application.

[0041] FIG. 3A to FIG. 3M An exemplary virtual presentation environment associated with a theater application according to examples of the present disclosure is shown. Figure 3A An exemplary virtual presentation 304a (shown as 304b in a top-down view) displayed by the electronic device 101 within the three-dimensional environment 302 is shown. In one or more examples, the virtual presentation 304a includes a video clip displayed prior to joining and / or starting the virtual presentation. Figure 3A The introductory view is optionally displayed in an XR environment, where portions of the real-world environment are visible around the user of the electronic device and around the introductory view. For example, Figure 3A Walls, lights, and windows are shown at the perimeter of an introductory view of the virtual presentation. The introductory view optionally provides a title for the presentation (e.g., "Aquatic Friends") and one or more images or virtual objects associated with the presentation to convey the topic and / or theme of the virtual presentation to a user of the computer device. In one or more examples, the virtual objects include objects associated with the virtual presentation that are presented within the boundaries of the introductory view (e.g., within the boundaries of virtual presentation 304b) and, optionally, outside of the introductory view, within a real-world environment. For example, Figure 3A Aquatic related virtual objects such as rocks or sea floor, corals, sea grass, and octopus are shown within the confines of the introductory view, but the rocks, sea grass, and corals are also partially rendered on the real world floor.

[0042] In one or more examples, as part of the virtual presentation 304a Figure 3A The introductory view shown in FIG. 1 includes a launch user interface 306 for accessing the virtual demonstration. In one or more examples, the launch user interface 306 can be interacted with by a user (described in detail below) and optionally displays a launch affordance (e.g., Figure 3A ) allows the user to be admitted to the virtual presentation and further interact with the virtual presentation (also described in detail below).

[0043] In one or more examples, and as Figure 3A As shown in FIG. 3 , a user may join a virtual presentation 304a by directing his gaze 310 toward a launch user interface 306 while using his hand 312 to perform an air gesture (such as an air pinch) to indicate to the electronic device 101 that the user desires to join the virtual presentation and / or further interact with the virtual presentation. In one or more examples, and in response to receiving a selection of a selectable option of the launch user interface 306, the electronic device 101 displays the virtual presentation in the viewer's viewpoint, such as Figure 3B As shown in .

[0044] exist Figure 3B In the example of , the virtual presentation 304a is now displayed by the electronic device 101 in the audience viewpoint mode (in response to the selection to launch the user interface 306). In one or more examples, Figure 3B The audience viewpoints shown in are configured to convey to the user that they are part of the audience of the virtual presentation 304a. For example, in one or more examples, the virtual presentation 304b is displayed in the three-dimensional environment 304 in front of the perspective of the user 308, as shown in the top-down view. In one or more examples, the virtual presentation 304a includes a virtual stage 320 on which the presenter 314 is displayed. In one or more examples, the virtual stage 320 and other features of the virtual presentation 304a are superimposed on the three-dimensional environment. For example, in one or more examples, if the three-dimensional environment is an XR environment, where the three-dimensional environment includes some real-world elements, the virtual presentation is superimposed on the real-world environment so that the user will be able to view the virtual presentation while still being able to view the portion of the physical real-world environment displayed in the three-dimensional environment. In one or more examples, when viewed from Figure 3A The intro view is moved to Figure 3B For example, optionally, the size of the border of the virtual presentation is increased, and less of the real world is visible (e.g., Figure 3A The lights and windows shown in Figure 3B304a, the real-world surroundings of the user of the computing system may still be visible, such as if the user's head is turned 45 to 60 degrees (a side view of the real-world environment), parts of the real world are dimmer, the ambient lighting is changed to dim the real-world lighting and apply lighting associated with the theater application, etc. In some examples, the presenter 314 is displayed using an avatar or other three-dimensional representation, which can be based on the appearance of a user of an external electronic device associated with the presenter. In one or more examples, the presenter 314, and in particular the representation of the presenter 314 displayed in the virtual presentation 304a, can move according to the movement of the real-world user associated with the presenter 314. For example, the electronic device 101 can move the hands of the presenter 314 according to the real-world movement of the user associated with the hands of the presenter 314. As another example, movement from a first position to a second position in the real world can cause the presenter to be repositioned to a different position on the stage 320.

[0045] Although in Figure 3B 314 and stage 320 until the presenter initiates the presentation. In one or more examples, the modified version of the introductory view is shown with Figure 3A The modified version of the introductory view optionally includes a representation of the time until the presentation begins (e.g., a countdown).

[0046] In one or more examples, the electronic device 101 can emit audio captured by an electronic device associated with the presenter 314. For example, the electronic device associated with the presenter 314 can use one or more microphones to collect the audio of the presenter 314 and send the audio to the electronic device 101 (optionally via one or more intermediate electronic devices, such as a server). In response to receiving the audio from the presenter 314, the electronic device 101 emits audio that can be heard by the user 308 of the electronic device 101, thereby allowing the user to hear the real-time audio from the presenter 314.

[0047] In one or more examples, such as Figure 3C As shown in FIG. 1 , electronic device 101 displays virtual presentation 304 a and one or more representations of audience members 322 a. In some examples, a subset of audience members are in a communication session with a user of electronic device 101. For example, in Figure 3BThe audience member 322b shown in the top-down view of corresponds to a user of another electronic device who is also participating in the virtual presentation 304a and has previously participated in a communication session with the user of the electronic device 101. It should be understood that although the audience member 322b shows a single audience member participating in a communication session with the user of the electronic device 101, multiple audience members are optionally participating in a communication session with the user of the electronic device 101 and can be arranged to the side of the user 308. The audience member 322b is included in Figure 3B In the top-down view of , audience member 322b has a spatial relationship with user 308 because the audience member is based on the communication session. The arrangement and positioning of additional users (such as audience member 322b) relative to user 308 are optionally defined by a spatial template for the communication session regarding shared content (such as virtual presentation 304b).

[0048] In some examples, and as Figure 3C , electronic device 101 places audience member 322 b to the side of user 308 within three-dimensional environment 302. Thus, in one or more examples, if the user changes their perspective (e.g., turns their head and / or electronic device 101) within three-dimensional environment 302 so that they are facing to their side and toward the location of audience member 322 b, as shown in FIG. Figure 3C As shown in FIG. 3 , user 308 can view other audience members 322 b. Figure 3C In the example of , user 308 has changed their perspective (e.g., by turning their head or body to the left) so that they are now facing audience member 322b, as shown in the top-down view. In one or more examples, each audience member can be placed in a center front row seat in the audience so that each individual audience member will have the same perspective of the presentation.

[0049] In one or more examples, Figure 3C322a shown in the figure may be displayed at different levels of detail based on one or more factors as discussed below. For example, in one or more examples, one or more audience members participating in a communication session with user 308 (e.g., communicating with user 308 in front of and outside the context of a virtual presentation and / or a theater application associated with the virtual presentation) may be represented as audience member 324 in audience member 322a according to a high-fidelity level (e.g., an avatar with distinctive features). In some examples, the high-fidelity level of detail may include visible features of the face of the audience member corresponding to the real-world appearance of the user associated with audience member 324 (e.g., eye color, eye shape, nose, hair, hair color, skin color). In some examples, the high-fidelity level of detail may include movement based on the physical movement of the represented user. In some examples, the movement may include facial gestures, movement of body parts, etc. that are also represented in the avatar representation of the audience member. In some examples, the high-fidelity level of detail may not include translational movement (e.g., walking around the room). In one or more examples, audience members 322a who are not in a communication session with user 308 are represented as one or more generic type avatars (e.g., without or with fewer features unique to those users). In some examples, the generic type avatars may exhibit movement as described above, except that the movement may not be based on real-world movement of the user that the generic avatar is intended to represent.

[0050] In some examples, the level of detail displayed for each of audience members 322a may be based on the proximity of the audience member to user 308 within three-dimensional environment 302. For example, audience member 326 may be displayed according to a medium-fidelity level of detail, where audience member 326 is shown as a silhouette (e.g., in the shape of a human avatar) without any features displayed by audience member 324 (such as eyes, noises, a face, etc.). In some examples, the appearance of audience member 326 may not be based on any real-world image data of a user associated with audience member 326. In some examples, audience members that are farther away than audience member 326, such as audience member 328, may be displayed according to a low-fidelity level of detail. For example, audience member 328 is represented by an abstract shape or outline rather than a silhouette in human form like audience member 326. In some examples, audience member 328 may be animated to move based on aggregate responses of the users that audience member 328 is intended to represent. In some examples, placement of audience members (excluding audience members participating in a communication session with user 308, such as audience member 324 corresponding to audience member 322b) within three-dimensional environment 302 may be randomized or based on one or more criteria, such as geographic proximity to the user or other factors.

[0051] In some examples, user 308 can hear audio from audience members. For example, if an audience member claps or speaks during a presentation, the audio can be recorded by a separate device of the audience member, sent to the electronic device 101, and replayed to user 308. In some examples, and in order to maintain privacy and / or avoid user 308 being drowned or distracted by too much noise, the electronic device 101 can emit simulated crowd noise (e.g., synthetic crowd noise) at a predefined volume, rather than capturing and playing the direct audio of each audience member from the audience members, so that the user cannot hear what the audience members say and will not be distracted by the noise from other audience members, but will understand that the audience is speaking. In some examples, after converting the audience noise into a synthetic sound, the electronic device 101 can set the volume of the audience noise according to the number of audience members who are making sounds and / or the volume of the audio recorded for each audience member. In some examples, each corresponding device (e.g., the device where the audience member speaks) can generate a synthetic sound and send the generated sound to a server, which can then send the synthetic sound to each electronic device associated with the virtual presentation. Additionally or alternatively, each corresponding device can send the recorded audio to the server that processes the sound to generate the synthetic sound, and after processing the sound, the server sends the synthetic audio to each device associated with the virtual demonstration. Although the example of dialogue is used above, the same technology for processing the audience sound can be applied to other types of audience audio, such as applause, laughter, booing, etc. In some examples, the audio from other audience members can be selectively sent to the user (rather than having synthetic sound). For example, in the example where the audience member participates in the direct communication session with the user of the electronic device 101, the electronic device can send the actual audio (rather than synthetic sound) recorded from the device of other users. In one or more examples, the volume of the synthetic sound can be adjusted according to the current state of the virtual demonstration. For example, if the presenter 314 is speaking, the synthetic sound can be played with a lower volume than when the presenter 314 is not speaking.

[0052] Additionally, as described below, audio is optionally generated based on input to an audience reaction user interface by audience members of the virtual presentation. Figure 3B In some examples, virtual presentation 304a may include an audience reaction user interface 316 for receiving reactions from user 308 to the virtual presentation. The same audience reaction user interface is optionally presented to other audience members using their respective electronic devices. Figure 3B, the audience reaction user interface 316 can be placed in front of the stage 320 (relative to the user's perspective) so that the interface is within the user's physical reach. Optionally, the audience reaction user interface 316 can be placed in a position within the three-dimensional environment so that it does not hinder the user 308 from viewing the presenter 314 or other aspects of the virtual presentation 304a. In some examples, the audience reaction user interface provides a visual indication of the reactions of other audience members (e.g., aggregated from audience members) to the virtual presentation 304a. In some examples, the audience reaction user interface 316 includes selectable options 318a to 318e, each of which corresponds to a predefined reaction. For example, selectable option 318a corresponds to a "favorite" or "like" reaction, which, when selected by the user, conveys that the user "favorites" or "favorites" the current content of the presentation, such as what the presenter 314 is saying or what visual content is currently being presented as part of the virtual presentation 304a. Optional option 318b corresponds to a "laughing" reaction, which, when selected by the user, conveys that the user "laughs" or thinks that the current content of the presentation is funny. Selectable option 318c corresponds to an "applause" reaction, which, when selected by the user, communicates that the user "applauds" or appreciates the content of the presentation. Selectable options 318d and 318e correspond to a "thumbs up" reaction and a "thumbs down" reaction, respectively, which, when selected by the user, communicate that the user "approves" or "disapproves" (or "likes" or "dislikes") the content of the presentation. It should be understood that the reactions shown are representative, and fewer, more, or different reactions may be implemented.

[0053] In one or more examples, and as Figure 3B , user 308 selects selectable option 318d corresponding to a “thumbs up” reaction by directing his gaze 310 toward selectable option 318d and performing an air gesture (such as an air pinch) with his hand 312 (or by tapping selectable option 318d with a finger). In one or more examples, and in response to receiving input corresponding to a reaction from user 308 or from other audience members who are also attending virtual presentation 304a, electronic device 101 may display one or more visual indicators on or near audience reaction user interface 316 that indicate a user reaction or aggregate audience reaction at a given time during the virtual presentation, such as Figure 3D As shown in .

[0054] exist Figure 3DIn the example of , visual indications 330a to 330c are displayed by electronic device 101 based on aggregate audience reaction determinations. For example, visual indication 330a indicates an aggregation of "love" reactions to virtual presentation 304a by audience members from virtual presentation 304a. In some examples, visual indication 330a may take the form of a waveform whose height is proportional to the number of audience members who have also applied a "love" reaction to virtual presentation 304a. Similarly, visual indication 330b corresponds to an "applause" reaction, while visual indication 330c corresponds to a "thumbs up" reaction. Figure 3D , the height of the wave of visual indication 330c (e.g., thumbs up reaction) is greater than visual indications 330a and 330b, thus indicating that more audience members than other predefined reactions have indicated thumbs up reactions. In some examples, the theater presentation application running on the electronic device 101 can receive a count of how many audience members have applied a specific predefined reaction to the virtual presentation 304a, and cause the visual indication to be displayed based on the received count. In some examples, the electronic device 101 can play a synthetic audio based on the recorded aggregate reaction. For example, if the audience member is applying an "applause" reaction to the presentation, the electronic device 101 can generate a synthetic applause sound that can be heard by the user 308. In some examples, the volume of the synthetic reaction sound can be proportional to the number of audience members who have applied a reaction to the virtual presentation. In some examples, and in response to receiving input from the user 308, one or more audience reactions 318a to 318e can change their appearance (e.g., make them visually different) to indicate that the user has selected the reaction. In some examples, once the aggregate number of a particular reaction exceeds a minimum predefined threshold, the visual indication may be applied. In one or more examples, the visual indication may be displayed for a predefined amount of time, and once the predefined amount of time has been exceeded, the electronic device 101 may update the visual indication to reflect the current aggregate reaction to the virtual presentation 304a.

[0055] In some examples, and as described above, a reaction may be selected from the audience reaction user interface 316. Additionally or alternatively, the electronic device 101 may detect a user's hand engagement such as Figure 3E to express the reaction using the predefined mid-air gestures shown in Figure 3E In the example of , instead of interacting with audience reaction user interface 316, user 308 may express a reaction using one or more predefined gestures that may be recognized by electronic device 101 as being related to one of the predefined reactions included as part of audience reaction user interface 316. For example, Figure 3E, a user 308 using his hand 312 may make a thumbs-up gesture. In some examples, the electronic device 101 may use one or more of the cameras 114a to 114c to detect a thumbs-up gesture made by the hand 312 and associate it with a predefined thumbs-up reaction corresponding to the selectable option 318d of the audience reaction user interface 316. In one or more examples, the electronic device 101 may process the thumbs-up gesture made by the hand 312 in the same manner as if the user 308 had selected the selectable option 318d as described above. The thumbs-up gesture described above is for illustrative purposes only and should not be considered limiting. The above examples may also be applied to other reactions, such as a "love" reaction, a thumbs-down reaction, and the like. In some examples, the selected reaction may be made visually different from the unselected reactions, for example by causing the reaction to attract attention (e.g., using interface 316).

[0056] In one or more examples of the present disclosure, the virtual presentation 304a may include displaying virtual objects that a user may interact with and manipulate, such as Figure 3F As shown in Figure 3F In the example of , virtual presentation 304a includes a three-dimensional virtual object 332 (a three-dimensional octopus in this example) displayed by electronic device 101 as part of virtual presentation 304a. In one or more examples, presenter 314 may initiate the display of virtual object 332 while presenting. In one or more examples, each individual audience member views their own independent copy of virtual object 332 on their own separate electronic device. In some examples, virtual object 332 is placed in a three-dimensional environment so that it does not hinder user 308 from viewing presenter 314. As discussed in further detail below, each audience member can interact with virtual object 332 and manipulate the virtual object independently of each other. For example, audience member 322b may not be able to see how user 308 interacts with virtual object 332 on electronic device 101 and manipulates the virtual object, yet audience member 322b is able to interact with virtual object 332 independently on their own electronic device.

[0057] In some examples, virtual object 332 may include one or more virtual object user interface elements 334a to 334c, which, when selected by the user, cause electronic device 101 to display additional information about virtual object 322. For example, in response to detecting user gaze 310 directed to virtual object user interface element 334a when the user performs an air pinch with his hand 312, electronic device 101 displays an information user interface, such as Figure 3G As shown in .

[0058] exist Figure 3GIn the example of , in response to selecting virtual object user interface 334a, electronic device 101 displays information interface 336, which displays information about virtual object 332. In one or more examples, the user can close information interface 336 by "reselecting" virtual object user interface element 334a (e.g., by performing an air pinch with hand 312 while pointing gaze 310 at virtual object user interface element 334a). In addition, element 334a can be closed in response to the user opening elements 334b ​​to 334c. In one or more examples, virtual object 332 can be manipulated by user 308, such as Figure 3H In one or more examples, electronic device 101 facilitates changing the orientation of virtual object 332 displayed via user interaction with the three-dimensional representation. For example, in response to user input (e.g., a mid-air pinch gesture while the user's attention (e.g., gaze 310) is directed toward virtual object 332, and movement of the user's hand 312 (while engaged in mid-air pinching), the electronic device changes the orientation of virtual object 332, such as Figure 3H As shown in Figure 3H As shown in FIG. 3 , the orientation of the three-dimensional representation 332 has been changed by the electronic device 101 to be commensurate with the movement of the user's hand 312. For example, as shown in FIG. Figure 3H As shown in , the virtual object 332 is now shown from a bottom perspective.

[0059] In one or more examples, the virtual presentation 304a may include: Fig. 3I The virtual survey shown in Fig. 3I In the example of , presenter 314 has initiated a virtual survey in virtual presentation 304a. In some examples, a virtual survey refers to a question that optionally includes one or more predefined answers that audience members can select. In some examples, a theater application implementing virtual presentation 304a can record responses to the survey from each audience member and display a visual indication to show the aggregated responses to the survey, optionally upon request by presenter 314.

[0060] In one or more examples, as part of implementing the virtual survey, the electronic device 101 displays two separate user interfaces: a question user interface 338 and an answer user interface 340. Each of the question user interface 338 and the answer user interface 340 can be considered to be part of the same audience survey user interface (or a different corresponding user interface). In one or more examples, the audience survey user interface can provide the user with one or more selectable options set by the presenter 314 of the virtual presentation 304a. In one or more examples, the question user interface 338 displays the question that the survey seeks to answer. In addition, in some examples, and as Fig. 3I, question user interface 338 may also include one or more visual indications 344 that show the current aggregate responses to the survey question (e.g., a running count of how many people in the audience have answered the question with a particular answer). In one or more examples, the virtual survey includes an answer user interface 340 that is configured to record answers to the survey questions provided by user 308. In some examples, the answer user interface may provide a visual representation of the answer options to the survey questions. In one or more examples, user 308 may select an answer by performing an air pinch with hand 312 while simultaneously directing their gaze 310 to the answer they wish to select (or by tapping the answer with a finger in the user interface or through an audio command). In some examples, in response to receiving a selection of an answer from user 308, electronic device 101 may display visual indication 342 to provide a visual indication of which answer user 308 has selected, such as Fig. 3I In one or more examples, and as shown in Fig. 3I As shown in FIG. 3 , the presenter 314 can be repositioned within the virtual presentation 304 a so that the presenter does not obstruct the user from viewing the virtual survey.

[0061] In one or more examples, such as Figure 3J As shown in , audience members (including user 308 of electronic device 101) can be promoted to become presenters along with presenter 314. For example, returning to Figure 3C For example, audience member 324 may be selected by presenter 314 to be promoted to the presenter role. Figure 3J As shown in the example of , once the presenter 314 has selected the audience member 324 as the presenter, the virtual presentation 304a is displayed to the audience member 324 from the presenter viewpoint (not shown) instead of the audience viewpoint. In one or more examples, the audience viewpoint seen by the user 308 shows the elevated audience member 324 placed on the virtual stage 320, where the audience member 324 faces the audience. In one or more examples, the presenter viewpoint for the elevated audience member 324 is from the perspective of the elevated audience member 324 placed on the virtual stage 320, where the audience member 324 faces the audience. In one or more examples, when in the presenter viewpoint, the audience member 324 may also have one or more control interfaces that allow them to effectively present. For example, when in the presenter viewpoint, the audience member may have one or more sticky notes or may control crowd noise, etc. In one or more examples, the presenter viewpoint may be the same viewpoint that the user associated with the presenter 314 views when participating in the virtual presentation. Additionally or alternatively, because audience members 324 are invited presenters rather than the primary presenter, the presenter viewpoint they experience may include a subset of the features available to presenter 314. In one or more examples, in addition to the features described above with respect to Figure 3J In addition to the discussed transition from audience member to presenter, e.g. Figure 3K As shown in , an audience member may be selected as a questioner by the presenter of the virtual presentation 304a. Additionally or alternatively, a user may be automatically promoted to questioner in response to "raising their hand" as described above. Figure 3K In the example of , one of the audience members 322a has been promoted to a questioner by the presenter. In some examples, the presenter 314 may promote the audience member to a questioner in response to receiving an indication that the audience member has a question (e.g., because the audience member has selected the selectable option 346 of the question user interface as described above). In some examples, the user may also indicate that they have a question by raising their hand (which is detected by the electronic device). Figure 3K , when an audience member (such as audience member 352) is promoted from being audience member 322a to being a questioner, their appearance in the three-dimensional environment can be made different from other audience members by displaying microphone 350a or some other visual indication (e.g., a sloped podium or microphone stand) showing that audience member 352 has been promoted to the role of questioner. In some examples, the position of the audience member promoted to the role of questioner can be changed so that it is closer to both user 308 and stage 320. In one or more examples, whether via a hand-raising gesture or selection of selectable option 346, the electronic device optionally provides a visual indication that the input has been accepted (e.g., changing the appearance of selectable option 346). In one or more examples, the visual indication stops being displayed after a threshold time period, after the input is cancelled (e.g., putting down the hand, selecting selectable option 346 again, etc.), and / or after the user is promoted to being a questioner.

[0062] In one or more examples, and in addition to the above description of FIG. 3F to FIG. 3H In addition to presenting virtual objects to audience members as part of a presentation as discussed above, the presenter 314 of the virtual presentation may also send the virtual object to one or more audience members of the virtual presentation, such as Figure 3L As shown in Figure 3LIn the example of , the presenter 314 of the virtual presentation 304a has sent the virtual object 354 to the user 308 of the electronic device 101. In one or more examples, and in response to receiving the virtual object 354 from the virtual presentation, the electronic device 101 displays a virtual object download user interface 356, which is configured to receive input from the user of the electronic device regarding whether they wish to accept the virtual object and download the virtual object 354 to the memory of the electronic device 101 or reject the virtual object 354, thereby abandoning the download of the virtual object. In some examples, the virtual object download user interface 356 may include text information identifying the identity of the individual shared virtual objects 354 and information about the content of the virtual objects 354.

[0063] In one or more examples, such as Figure 3M As shown in , the theater application can present the virtual presentation to the presenter from a presenter viewpoint. In one or more examples, upon detecting that a user associated with the electronic device is the presenter of the virtual presentation and / or upon detecting that the user of the electronic device has been promoted to presenter by another presenter of the virtual presentation (as discussed above), the electronic device 101 displays the virtual presentation in the presenter viewpoint. In one or more examples, the presenter viewpoint includes displaying the three-dimensional environment 302 from the perspective of the presenter on the stage of the virtual presentation (as described above) looking out at the audience. Thus, in one or more examples, when in the presentation viewpoint, the device displays audience members at different levels of detail. For example, in one or more examples, audience members closest to the user's perspective may be displayed according to the high-fidelity detail level described above. In some examples, audience members farther away may be displayed according to the medium-fidelity detail level described above. In some examples, the farthest audience members may be displayed according to the low-fidelity detail level described above. In one or more examples, the high-fidelity, medium-fidelity, and low-fidelity detail levels are related to the details of the presentation. Figure 3C The levels of detail described share one or more characteristics. In one or more examples, the placement of audience members can be based on one or more factors, including, but not limited to: the order in which audience members join the virtual presentation (e.g., the first user to join is placed in front of the audience), whether the audience member is known to the presenter (e.g., within their personal contacts, or in a communication session with the presenter), and / or any criteria that distinguishes one or more audience members from one another.

[0064] In one or more examples, the presenter viewpoint may include a presenter control user interface 356 for controlling one or more aspects of the virtual presentation. For example, the presenter control user interface 356 may include one or more visual aids 362 configured to present a visual representation of what the user in the audience viewpoint is seeing (e.g., virtual objects and other parts of the presentation). In some examples, the presenter control user interface 356 also includes one or more selectable options for configuring parameters associated with the virtual presentation. For example, selection of one or more selectable options 358 allows the user to adjust the volume of audience noise in the presentation, adjust brightness, color or other visual settings, and / or adjust any parameters associated with the virtual presentation.

[0065] In one or more examples, the presenter viewpoint includes a presenter reaction user interface 360 ​​for receiving reactions from the presenter and for displaying aggregate reactions from audience members. In one or more examples, the presenter reaction user interface 360 ​​shares one or more features with the audience reaction user interface 316 described above, including but not limited to the above-described visual indications for indicating aggregate audience member reactions to the virtual presentation.

[0066] Figure 4 An exemplary flow chart is shown, which illustrates a method of displaying a virtual presentation associated with a cinema application according to an example of the present disclosure. In some examples, when a virtual presentation launch user interface (e.g., such a launch user interface 306) for receiving an input to join the virtual presentation is displayed in a three-dimensional environment via a display generation component, the electronic device 101 receives (402) a first input to join the virtual presentation associated with the cinema application at the virtual presentation launch user interface. In some examples, the cinema application facilitates interaction between a presenter of the virtual presentation and one or more audience members of the virtual presentation. In some examples, a user of the electronic device 101 can access multiple virtual presentations through the cinema application, and can select one of the multiple virtual presentations to watch at any given time. In some examples, after selecting a virtual presentation to watch, a virtual presentation launch user interface is presented to the user of the electronic device 101, which, when selected, will allow the user to participate in the virtual presentation as an audience member (as described above, and in further detail below).

[0067] In one or more examples, and in response to receiving the first input, the electronic device 101 displays (404) a virtual presentation in a three-dimensional environment and according to an audience viewpoint associated with a theater application. In one or more examples, the virtual presentation is displayed in front of the user in the three-dimensional environment and superimposed on a background of the three-dimensional environment. For example, if the three-dimensional environment is a mixed reality environment, where the three-dimensional environment includes at least a portion of a physical real-world environment surrounding the electronic device 101, the virtual presentation is superimposed on the mixed reality environment, enabling the user of the device to see at least a portion of its physical real-world environment while watching the virtual presentation. In one or more examples, and in accordance with displaying the virtual presentation in an audience viewpoint, the electronic device 101 displays the virtual presentation in the center in front of the user's perspective. Thus, when watching the virtual presentation, the user sees the virtual presentation and other audience members from the perspective of an audience member sitting in the front row center of the presentation auditorium.

[0068] It should be understood that process 400 is an example and more, fewer or different operations may be performed in the same or different order. In addition, the operations in process 400 described above are optionally performed by running an information processing device such as a general-purpose processor (e.g., as described in relation to Figure 2 or one or more functional modules in a dedicated chip and / or through Figure 2 to be implemented by other components.

[0069] Therefore, according to the above, some examples of the present invention relate to a method comprising: at an electronic device that communicates with one or more displays and one or more input devices: when a virtual presentation launch user interface for receiving input for joining a virtual presentation associated with a cinema application is displayed within a three-dimensional environment via a display generation component, receiving a first input for joining the virtual presentation associated with the cinema application at the virtual presentation launch user interface; and in response to receiving the first input, displaying the virtual presentation in the three-dimensional environment, wherein the virtual presentation is displayed according to an audience viewpoint associated with the cinema application.

[0070] Optionally, displaying the virtual presentation according to an audience viewpoint associated with a theater application includes: displaying a virtual stage in a three-dimensional environment, wherein the virtual stage is displayed in front of the perspective of a user of the electronic device; and displaying multiple representations of audience members of the virtual presentation in the displayed three-dimensional environment, wherein one or more of the multiple representations of the audience members correspond to one or more participants of the virtual presentation, and wherein the multiple representations of the audience members are placed to one or more sides of the perspective of the user of the electronic device within the three-dimensional environment.

[0071] Optionally, a first representation of the multiple representations of the audience member corresponds to a first participant of the virtual presentation, wherein the user of the electronic device participated in a communication session with the first participant prior to the first input, wherein a second representation of the multiple representations of the audience member corresponds to a second participant of the virtual presentation, wherein the user of the electronic device did not participate in a communication session with the second participant prior to the first input, and wherein the first representation is displayed with a higher visual prominence than the second representation.

[0072] Optionally, the visual prominence of the one or more of the plurality of representations is based on a proximity of the one or more representations to a position of a user of the electronic device within the three-dimensional environment.

[0073] Optionally, the method further comprises presenting synthesized audience audio when displaying the virtual presentation according to an audience viewpoint associated with the cinema application, wherein the synthesized audience audio is based on real-world audience sounds.

[0074] Optionally, the method further comprises displaying an audience reaction user interface for selecting one or more reactions associated with the cinema application when the virtual presentation is displayed according to an audience viewpoint associated with the cinema application.

[0075] Optionally, the method further comprises: while displaying the audience reaction user interface, receiving via the one or more input devices a first input corresponding to a selection of a reaction from the one or more reactions associated with the theater application; and in response to receiving the first input, applying the selected reaction to the virtual presentation.

[0076] Optionally, the audience reaction user interface includes one or more visual indications, each visual indication corresponding to one of the one or more reactions associated with the theater application, and wherein each of the one or more visual indications is configured to indicate an aggregate audience reaction to one of the one or more reactions to the virtual presentation.

[0077] Optionally, the method further comprises presenting audience reaction audio, wherein the audience reaction audio is based on aggregated audience reactions to the virtual presentation.

[0078] Optionally, the method further includes: receiving a second input, wherein the second input includes input from the first part of the user; determining that the second input corresponds to a reaction among one or more reactions associated with the theater application; and in response to determining that the second input corresponds to a reaction among the one or more reactions associated with the theater application, applying a reaction to the virtual presentation corresponding to the second input.

[0079] Optionally, the method further comprises: when displaying the virtual presentation, displaying a three-dimensional virtual object associated with the virtual presentation at a position in front of a perspective of the user's perspective within the three-dimensional environment.

[0080] Optionally, the method also includes: when displaying a virtual presentation including a three-dimensional virtual object, receiving a third input from a second part of the user, the third input including a first air gesture pointing to the three-dimensional virtual object followed by movement of the second part of the user; and in response to receiving the third input, rotating the three-dimensional virtual object relative to the three-dimensional environment according to the detected movement of the second part of the user.

[0081] Optionally, the method further includes: when the virtual presentation is displayed according to an audience viewpoint associated with the theater application, displaying an audience survey user interface for selecting one or more answers associated with a survey question displayed as part of the virtual presentation; when the audience survey user interface is displayed, receiving a first input corresponding to a selection of an answer from the one or more answers associated with the survey question via the one or more input devices; and in response to receiving the first input, sending an indication of the selected answer to the theater application.

[0082] Optionally, the method further includes: when the virtual presentation is displayed according to an audience viewpoint associated with a cinema application, receiving an instruction to display the virtual presentation according to a presenter viewpoint associated with the cinema application; and in response to receiving an instruction to display the virtual presentation according to the presenter viewpoint, stopping displaying the virtual presentation according to the audience viewpoint and displaying the virtual presentation according to the presenter viewpoint.

[0083] Optionally, the method further includes: when the virtual presentation is displayed according to the audience viewpoint associated with the cinema application, receiving an instruction to display the virtual presentation according to the questioner viewpoint associated with the cinema application; and in response to receiving the instruction to display the virtual presentation according to the questioner viewpoint, stopping displaying the virtual presentation according to the audience viewpoint and displaying the virtual presentation according to the questioner viewpoint.

[0084] Optionally, the method also includes: receiving a virtual object from a theater application when the virtual presentation is displayed according to an audience viewpoint associated with the theater application; in response to receiving the virtual object from the theater application, displaying a virtual object download user interface for downloading the virtual object to a memory of the electronic device; while displaying the virtual object download user interface, receiving a first input corresponding to a request to download the received virtual object to a memory of the electronic device via the one or more input devices; and in response to receiving the first input, storing the received virtual object to a memory of the electronic device.

[0085] Optionally, the displayed three-dimensional environment includes one or more virtual elements based on the real world environment in the computer system.

[0086] Some examples of the present disclosure relate to an electronic device comprising: one or more processors; a memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for executing any of the above methods.

[0087] Some examples of the present disclosure relate to a non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the above methods.

[0088] Some examples of the present disclosure relate to an electronic device comprising one or more processors, a memory, and a component for performing any of the above methods.

[0089] Some examples of the present disclosure relate to an information processing apparatus used in an electronic device, the information processing apparatus including a component for executing any one of the above methods.

[0090] For the purpose of explanation, the foregoing description is described by reference to specific examples. However, the above illustrative discussion is not intended to be exhaustive or to limit the present disclosure to the precise form disclosed. Based on the above teachings, many modifications and variations are possible. The examples are selected and described in order to best illustrate the principles of the present disclosure and its practical application, so as to enable other technical personnel in the field to best use the present disclosure and the various described examples with various modifications suitable for the specific purpose contemplated.

Claims

1. A method, comprising: At an electronic device in communication with one or more displays and one or more input devices: When displaying a virtual presentation launch user interface for receiving input to join a virtual presentation associated with a cinema application within a three-dimensional environment via a display generation component, receiving a first input to join the virtual presentation associated with the cinema application at the virtual presentation launch user interface; as well as In response to receiving the first input, the virtual presentation is displayed in the three-dimensional environment, wherein the virtual presentation is displayed according to a viewer viewpoint associated with the cinema application.

2. The method of claim 1 , wherein displaying the virtual presentation according to the audience viewpoint associated with the cinema application comprises: displaying a virtual stage in the three-dimensional environment, wherein the virtual stage is displayed in front of a viewing angle of a user of the electronic device; as well as Multiple representations of audience members of the virtual presentation are displayed in the displayed three-dimensional environment, wherein one or more of the multiple representations of the audience members correspond to one or more participants of the virtual presentation, and wherein the multiple representations of the audience members are placed within the three-dimensional environment to one or more sides of the viewing angle of the user of the electronic device.

3. A method according to claim 2, wherein a first representation of the multiple representations of the audience member corresponds to a first participant of the virtual presentation, wherein the user of the electronic device has participated in a communication session with the first participant prior to the first input, wherein a second representation of the multiple representations of the audience member corresponds to a second participant of the virtual presentation, wherein the user of the electronic device has not participated in the communication session with the second participant prior to the first input, and wherein the first representation is displayed with a higher visual prominence than the second representation.

4. A method according to claim 2, wherein the visual significance of the one or more of the multiple representations is based on the proximity of the one or more representations to the position of the user of the electronic device within the three-dimensional environment.

5. The method according to claim 1, wherein the method further comprises: When the virtual presentation is displayed according to the audience viewpoint associated with the cinema application, synthetic audience audio is presented, wherein the synthetic audience audio is based on real-world audience sounds.

6. The method according to claim 1, wherein the method further comprises: When the virtual presentation is displayed according to the audience viewpoint associated with the cinema application, an audience reaction user interface is displayed for selecting one or more reactions associated with the cinema application.

7. The method according to claim 6, wherein the method further comprises: receiving, via the one or more input devices, a first input corresponding to a selection of a reaction from among the one or more reactions associated with the theater application while displaying the audience reaction user interface; and In response to receiving the first input, a selected reaction is applied to the virtual presentation.

8. The method of claim 6, wherein the audience reaction user interface comprises one or more visual indications, each visual indication corresponding to one of the one or more reactions associated with the theater application, and wherein each of the one or more visual indications is configured to indicate an aggregate audience reaction to one of the one or more reactions to the virtual presentation.

9. The method of claim 8, wherein the method further comprises presenting audience reaction audio, wherein the audience reaction audio is based on the aggregate audience reaction to the virtual presentation.

10. The method according to claim 1, wherein the method further comprises: receiving a second input, wherein the second input comprises an input from a first part of the user; determining that the second input corresponds to a reaction from one or more reactions associated with the theater application; as well as In response to determining that the second input corresponds to the reaction of the one or more reactions associated with the theater application, the reaction corresponding to the second input is applied to the virtual presentation.

11. The method according to claim 1, wherein the method further comprises: When the virtual presentation is displayed, a three-dimensional virtual object associated with the virtual presentation is displayed at a position in front of a user's perspective within the three-dimensional environment.

12. The method according to claim 11, wherein the method further comprises: while displaying the virtual representation including the three-dimensional virtual object, receiving a third input from a second part of the user, the third input comprising a first mid-air gesture directed toward the three-dimensional virtual object followed by movement of the second part of the user; as well as In response to receiving the third input, the three-dimensional virtual object is rotated relative to the three-dimensional environment according to the detected movement of the second part of the user.

13. The method according to claim 1, wherein the method further comprises: while the virtual presentation is displayed according to the audience viewpoint associated with the theater application, displaying an audience survey user interface for selecting one or more answers associated with a survey question displayed as part of the virtual presentation; while displaying the audience survey user interface, receiving, via the one or more input devices, a first input corresponding to a selection of an answer from the one or more answers associated with the survey question; as well as In response to receiving the first input, an indication of the selected answer is sent to the theater application.

14. The method according to claim 1, wherein the method further comprises: receiving an instruction to display the virtual presentation according to a presenter viewpoint associated with the cinema application while the virtual presentation is displayed according to the audience viewpoint associated with the cinema application; as well as In response to receiving the indication to display the virtual presentation according to the presenter viewpoint, displaying the virtual presentation according to the audience viewpoint is stopped and the virtual presentation is displayed according to the presenter viewpoint.

15. The method according to claim 1, wherein the method further comprises: receiving an instruction to display the virtual presentation according to a questioner's viewpoint associated with the cinema application while the virtual presentation is displayed according to the audience's viewpoint associated with the cinema application; as well as In response to receiving the instruction to display the virtual presentation according to the questioner's viewpoint, displaying the virtual presentation according to the audience's viewpoint is stopped and the virtual presentation is displayed according to the questioner's viewpoint.

16. The method according to claim 1, wherein the method further comprises: receiving a virtual object from the cinema application while displaying the virtual presentation according to the viewer viewpoint associated with the cinema application; In response to receiving the virtual object from the theater application, displaying a virtual object download user interface for downloading the virtual object to a memory of the electronic device; while displaying the virtual object download user interface, receiving, via the one or more input devices, a first input corresponding to a request to download the received virtual object to the memory of the electronic device; as well as In response to receiving the first input, the received virtual object is stored in the memory of the electronic device.

17. The method of claim 1, wherein the displayed three-dimensional environment includes one or more virtual elements based on a real-world environment in the computer system.

18. An electronic device in communication with a display generation component and one or more input devices, the electronic device comprising: one or more processors; Memory; Apparatus for carrying out any of the methods according to claims 1 to 17.

19. An electronic device, comprising: one or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for executing any one of the methods according to claims 1 to 17.

20. A non-transitory computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions, which, when executed by one or more processors of an electronic device, cause the electronic device to perform any one of the methods according to claims 1 to 17.

Images