Multi-player extended reality

Abstract

An apparatus comprising components for the following operations: an apparatus for joining a joining participant in an extended reality to at least an existing participant in the extended reality at a location in a virtual space to achieve a shared extended reality, wherein the joining participants in the shared extended reality are at least co-located in the virtual space and can at least visually share the virtual space; wherein at least a portion of a content configuration is inherited by the joining participant from an existing participant, wherein the content configuration controls what the participant hears, sees, and interacts with the virtual space; wherein at least a portion of a joining configuration is inherited between an existing participant and the joining participant, wherein the joining configuration controls the joining of other joining participants in the shared extended reality.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to multi-player extended reality. Background Art

[0002] "Extended reality" or "mediated reality" allows a user to experience a fully or partially artificial environment (virtual space), for example visually, as a virtual scene at least partially rendered to the user by a device. The virtual scene is determined by a virtual point of view within the virtual space.

[0003] Three degrees of freedom (3DoF) describes an extended reality where the virtual viewpoint is determined only by the user's orientation (eg, three degrees of three-dimensional orientation).

[0004] Six degrees of freedom (6DoF) describes a mediated reality in which a virtual viewpoint is determined by both orientation (eg, three degrees of three-dimensional orientation) and position / movement (eg, three degrees of three-dimensional position).

[0005] A subcategory of six degrees of freedom (6DoF) is 3DoF+, where the virtual position is determined by both orientation (eg, three degrees of three-dimensional orientation) and constrained position / movement. Summary of the invention

[0006] According to various but not necessarily all embodiments, there is provided an apparatus comprising means for:

[0007] joining the joining participant in the extended reality to at least an existing participant in the extended reality at the location in the virtual space to achieve a shared extended reality,

[0008] wherein the joined participants in the shared extended reality are at least co-located in a virtual space and can at least visually share the virtual space;

[0009] wherein at least a portion of the content configuration is inherited by the joining participant from an existing participant, wherein the content configuration controls for the participant what to hear, see, and interact with the virtual space;

[0010] Wherein at least a portion of a join configuration is inherited between existing participants and a joining participant, wherein the join configuration controls joining of other joining participants in the shared extended reality.

[0011] In some but not all examples, inheritance of content configuration is hierarchical and has a direction from an existing participant to a joining participant joining the extended reality, and wherein inheritance of joining configuration is hierarchical and depends on one or more parameters of the join configuration for the existing participant and one or more parameters of the join configuration for the joining participant.

[0012] In some but not all examples, an existing participant is dominant with respect to inheritance of content configuration, such that a joining participant has, at least initially, substantially the same content experience as an existing participant, wherein the joining participant inherits control over one or more parameters of:

[0013] What you hear in extended reality, what you see in extended reality,

[0014] What interactions are possible with objects in the virtual space.

[0015] In some but not all examples, with respect to inheritance of a join configuration, a joining participant and / or an existing participant inherits at least one or more parameters that control:

[0016] whether and / or from whom the user has explicit consent to join XR,

[0017] whether and / or to whom notification of the request to join XR is given, and

[0018] Whether and / or providing notification of joining participants joining the extended reality.

[0019] In some but not all examples, for inheritance of join configuration, there is inheritance equality such that, at least initially, existing participants and joining participants share the same join controls, wherein at least one of the joining participant and / or existing participants inherits at least one or more parameters that control the join, wherein the at least one or more parameters are more restrictive than current parameters that control the join.

[0020] In some but not all examples, when a participant has an open voice communication channel, a join configuration for the participant is adapted to require explicit authorization to join from the participant and one or more other users communicating in the voice communication channel.

[0021] In some but not all examples, the joining of a joining participant is dependent upon the content of the extended reality experienced by existing participants.

[0022] In some but not all examples, the joining participant joins the existing participant in the extended reality in response to an acceptance of a join request made by the joining participant, where the joining configuration of the existing participant determines whether acceptance of the join request made by the joining participant is automatic or contingent on confirmation by the existing participant.

[0023] In some but not all examples, when a joining participant makes a request to join an existing participant in an extended reality at a location that was not accepted by an existing participant, a contention resolution process then determines the location in the virtual space where the requesting user experiences the extended reality, and whether the requesting participant experiences the extended reality shared with another participant.

[0024] In some but not all examples, when a joining participant requests to join an existing participant in an extended reality at the location of the existing participant, a response to the request may be:

[0025] Join; subject to rejection by an existing user; subject to rejection of content for shared XR rendering; request to join at a different location; timeout; or alternative join option.

[0026] In some but not all examples, after joining,

[0027] Existing participants participate in the extended reality and are able to control their viewpoint within the virtual space;

[0028] New participants participate in the extended reality and can control their viewpoint within the virtual space.

[0029] The viewpoint associated with the existing participant and the viewpoint associated with the joining participant may be independently controlled by the corresponding existing participant and the corresponding joining participant.

[0030] In some but not all examples, the apparatus includes means for providing a preview of the shared extended reality to a joining participant prior to the joining participant requesting to join the shared extended reality, wherein the preview includes existing participants at the location.

[0031] In some but not all examples, the content configuration controls at least visual and / or audio interactions between participants of a shared extended reality.

[0032] According to various but not necessarily all embodiments, there is provided a computer program which, when executed on one or more processors, causes:

[0033] joining the joining participant in the extended reality to at least an existing participant in the extended reality at the location in the virtual space to achieve a shared extended reality,

[0034] wherein the joined participants in the shared extended reality are at least co-located in the virtual space and are able to at least visually share the virtual space;

[0035] wherein at least a portion of the content configuration is inherited by the joining participant from an existing participant, wherein the content configuration controls for the participant what to hear, see, and interact with the virtual space;

[0036] Wherein at least a portion of a join configuration is inherited between existing participants and a joining participant, wherein the join configuration controls joining of other joining participants in the shared extended reality.

[0037] According to various but not necessarily all embodiments, there is provided a method comprising:

[0038] initiating joining of a joining participant in the extended reality to at least an existing participant in the extended reality at the location in the virtual space to achieve a shared extended reality;

[0039] causing a content configuration to be inherited by a joining participant from the existing participant, wherein the content configuration controls for the participant what to hear, see, and interact with the virtual space;

[0040] causing at least a portion of a join configuration to be inherited between an existing participant and a joining participant, wherein the join configuration controls joining of other joining participants in the shared extended reality;

[0041] completing joining the joining participant in the extended reality to at least an existing participant in the extended reality, wherein the existing participant and the joining participant, collectively referred to as the joining participant, are initially at least co-located in a virtual space and can at least visually share the virtual space;

[0042] Joining a joining participant in an extended reality to at least an existing participant in the extended reality is accomplished, wherein the existing participant and the joining participant, collectively referred to as the joining participant, are initially at least co-located in a virtual space and are able to at least visually share the virtual space.

[0043] Examples are provided as claimed in the appended claims according to various, but not necessarily all, embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Some examples will now be described with reference to the accompanying drawings, in which:

[0045] Figure 1A , Figure 1B ; Figure 2A , Figure 2B ; Figure 3A , Figure 3B An example of the subject matter described herein is shown;

[0046] Figure 4A , Figure 4B , Figure 4C Another example of the subject matter described herein is shown;

[0047] Figure 5 Another example of the subject matter described herein is shown;

[0048] Figure 6 Another example of the subject matter described herein is shown;

[0049] Figure 7 Another example of the subject matter described herein is shown;

[0050] Figure 8 Another example of the subject matter described herein is shown;

[0051] Fig. 9 Another example of the subject matter described herein is shown;

[0052] Fig.10 , Fig.11 , Fig.12 , Fig.13 , Fig.14 , Fig.15 , Fig.16A and Fig. 16B , Fig.17A and Fig. 17B , Fig.18A and Fig.18B , Figures 19A to 19D as well as Figures 20A to 20D Other examples of the subject matter described herein are shown.

[0053] definition

[0054] An "artificial environment" may be something that has been recorded or generated.

[0055] A "virtual visual space" is a fully or partially artificial environment that can be viewed, which may be three-dimensional.

[0056] A "virtual visual scene" refers to a representation of a virtual visual space as viewed from a particular viewpoint (position) within the virtual visual space.

[0057] A "virtual visual object" is a visible virtual object within a virtual visual scene.

[0058] "Sound space" (or "virtual sound space") refers to the arrangement of sound sources in three-dimensional space. Sound space can be defined with respect to recorded sound (recorded sound space) and with respect to reproduced sound (reproduced sound space).

[0059] A "sound scene" (or "virtual sound scene") refers to a representation of a sound space as heard from a particular viewpoint (position) within the sound space.

[0060] A "sound object" refers to a sound source that can be located within a sound space. A source sound object represents a sound source within the sound space, rather than a sound source associated with an object in the virtual visual space. A recorded sound object represents a sound recorded at a specific microphone or location. A reproduced sound object represents a sound reproduced from a specific location.

[0061] "Virtual space" may refer to a virtual visual space, a sound space, or a combination of a virtual visual space and a corresponding sound space. In some examples, the virtual space may extend up to 360° horizontally and up to 180° vertically.

[0062] “Virtual scene” may mean a virtual visual scene, mean a sound scene, or mean a combination of a virtual visual scene and a corresponding sound scene.

[0063] A "virtual object" is an object within a virtual scene, which can be an artificial virtual object (e.g., a computer-generated virtual object), or it can be an image of a real object in real space, which image is live or recorded. It can be a sound object and / or a virtual visual object.

[0064] A "virtual position" is a position within a virtual space. It can be defined using a virtual position and / or a virtual orientation. It can be thought of as a movable "viewpoint".

[0065] "Correspondence" or "corresponding" when used with respect to an acoustic space and a virtual visual space means that the acoustic space and the virtual visual space are aligned in time and space, ie, they are the same space at the same time.

[0066] When used in relation to an acoustic space and a virtual visual space, "correspondence" or "corresponding" means that the acoustic space and the virtual visual space (or visual scene) are corresponding, with the conceptual (virtual) listener whose viewpoint defines the acoustic scene and the conceptual (virtual) viewer whose viewpoint defines the virtual visual scene (or visual scene) being in the same position and orientation, i.e. they have the same viewpoint (same virtual position).

[0067] "Real space" (or "physical space") refers to a real environment that may be three-dimensional.

[0068] A "real scene" refers to a representation of the real space from a particular viewpoint (position) within the real space.

[0069] A "real visual scene" refers to a visual representation of real space as viewed from a particular real viewpoint (position) within the real space.

[0070] "Extended reality" or "mediated reality" in this article refers to a user experiencing a completely or partially artificial environment (virtual space) as a virtual scene at least partially presented to the user by a device, for example, visually. The virtual scene is determined by a viewpoint (virtual position) within the virtual space. Displaying the virtual scene means providing a virtual visual scene in a form perceptible to the user.

[0071] "Augmented reality" in this article refers to a form of mediated reality in which a user experiences an artificial environment (virtual space) as part of a virtual scene that includes a realistic scene of a physical real environment (real space) supplemented by one or more visual or audio elements presented to the user by a device, such as a real visual scene. The term augmented reality means mixed reality or hybrid reality, and does not necessarily mean the degree of virtuality (relative to reality) or the degree of intermediateness;

[0072] "Virtual reality" in this document means a form of mediated reality in which users experience a completely artificial environment (virtual visual space) as a virtual scene displayed to the user by a device;

[0073] "Virtual content" is content other than real content from the real scene (if any), which enables an extended (mediated) reality by, for example, providing one or more artificial virtual objects.

[0074] "Extended reality content" or "mediated reality content" is virtual content that enables users to visually experience a fully or partially artificial environment (virtual space) as a virtual scene, for example. Mediated reality content can include interactive content such as video games or non-interactive content such as sports videos.

[0075] "Augmented reality content" is a form of mediated reality content that enables a user to, for example, visually experience an artificial environment (virtual space) as part of a virtual scene. Augmented reality content may include interactive content such as video games or non-interactive content such as sports videos.

[0076] "Virtual reality content" is a form of mediated reality content that enables users to experience a completely artificial environment (virtual space) visually as a virtual scene, for example. Virtual reality content may include interactive content such as video games or non-interactive content such as sports videos.

[0077] "Perspective mediation" as applied to mediated reality, augmented reality, or virtual reality means that user actions determine the viewpoint (virtual position) in the virtual space, changing the virtual scene;

[0078] "First-person perspective" as applied to mediated reality, augmented reality or virtual reality refers to perspective mediated using the user's real viewpoint (position and / or orientation) to determine the additional constraints of the virtual user's viewpoint (virtual position) within the virtual space;

[0079] "Third-person perspective mediation" as applied to mediated reality, augmented reality or virtual reality refers to perspective mediation using the additional constraint that the user's real viewpoint does not determine the viewpoint (virtual position) in the virtual space;

[0080] "User interaction" as applied to mediated reality, augmented reality, or virtual reality means that user actions at least partially determine what happens in the virtual space;

[0081] "Display" means providing in a form that is visually perceived (viewed) by a user.

[0082] "Presentation" means providing in a form that is perceived by the user.

[0083] A "virtual user" defines a viewpoint (virtual position - location and / or orientation) in a virtual space used to generate a perspective-mediated sound scene and / or visual scene. A virtual user may be a symbolic listener and / or a symbolic viewer.

[0084] A "conceptual listener" defines a viewpoint (virtual position - location and / or direction) in a virtual space used to generate a perspective-mediated sound scene, regardless of whether a user is actually listening.

[0085] A "nominal viewer" defines a viewpoint (virtual position - location and / or orientation) in a virtual space used to generate a perspective-mediated visual scene, regardless of whether a user is actually looking.

[0086] Three degrees of freedom (3DoF) describes a mediated reality in which the virtual position is determined only by orientation (eg, three degrees of three-dimensional orientation). With respect to first-person perspective mediated reality, only the user's orientation determines the virtual position.

[0087] Six degrees of freedom (6DoF) describes a mediated reality in which the virtual position is determined by both orientation (e.g., three degrees of three-dimensional orientation) and position / movement (e.g., three degrees of three-dimensional position / movement). With respect to first-person perspective mediated reality, the user's orientation and the user's position / movement in real space determine the virtual position.

[0088] Three degrees of freedom plus (3DoF+) describes a mediated reality in which the virtual position is determined by the user's orientation (e.g., three degrees of orientation in three dimensions) and constrained position / movement (e.g., three degrees of position / movement in three dimensions). With respect to first-person perspective mediated reality, the user's orientation and the user's position / movement in real space determine the virtual position. DETAILED DESCRIPTION

[0089] The following figures illustrate the presentation of an extended (mediated) reality using virtual content. In this article, extended (mediated) reality refers to rendering an extended (mediated) reality for the purpose of implementing an extended (mediated) reality (such as augmented reality or virtual reality). In these examples, the extended (mediated) reality is a first-person perspective mediated reality. It may or may not be user interactive. For example, it may be 3DoF, 3DoF+, or 6DoF.

[0090] Figure 1A , Figure 2A , Figure 3A The first diagram shows a real space 50, a virtual sound space 20 and a virtual visual space 60. There is a correspondence between the virtual sound space 20 and the virtual visual space 60. A user 51 in the real space 50 has a position (viewpoint) 57 defined by a position 52 and an orientation 53. The position is a three-dimensional position and the orientation is a three-dimensional orientation.

[0091] In the extended (mediated) reality, there is a correspondence between the position (viewpoint) 57 of the user 51 and the virtual position (viewpoint) 77 of the virtual user 71. The position (viewpoint) 57 of the user 51 has an associated position 52 and orientation 53. The virtual position (viewpoint) 77 of the virtual user 71 has an associated virtual position 72 (corresponding to the position 52) and an associated virtual orientation 73 (corresponding to the orientation 53).

[0092] In 3DoF extended (mediated) reality, the orientation 53 of the user 51 controls the virtual direction 73 of the virtual user 71. There is a correspondence between the direction 53 and the virtual direction 73, so that a change in the direction 53 produces the same change in the virtual orientation 73. The virtual orientation 73 of the virtual user 71, in combination with the virtual field of view 74, defines a virtual visual scene 75 within the virtual visual space 60. In some examples, it may also define a virtual sound scene 76. The virtual visual scene 75 is part of the virtual visual space 60 displayed to the user. The virtual sound scene 76 is part of the virtual sound space 20 presented to the user. The correspondence of the virtual sound space 20 with the virtual visual space 60 is that a position within the virtual sound space 20 has an equivalent position within the virtual visual space 60. In 3DOF mediated reality, a change in the position 52 of the user 51 does not change the virtual position 72 or virtual orientation 73 of the virtual user 71.

[0093] In the example of 6DoF mediated reality, the situation is as described for 3DoF, and in addition, the presented virtual sound scene 76 and the displayed virtual visual scene 75 can be changed by the movement of the position 52 of the user 51. For example, there can be a mapping between the position 52 of the user 51 and the virtual position 72 of the virtual user 71. The change of the position 52 of the user 51 produces a corresponding change of the virtual position 72 of the virtual user 71. The change of the virtual position 72 of the virtual user 71 changes the presented virtual sound scene 76 and also changes the presented virtual visual scene 75.

[0094] This can be obtained from Figure 1B , Figure 2B and Figure 3B In understanding, Figure 1B , Figure 2B and Figure 3B The changes in the position 52 and orientation 53 of the user 51 are shown in the rendered virtual sound scene 76 ( Figure 2B ) and the rendered virtual visual scene 75 ( Figure 3B ) on the corresponding results.

[0095] In the examples below, reference will be made to the virtual space 60, which includes the virtual visual space. If a virtual sound space 20 exists, it also includes the corresponding virtual sound space 20.

[0096] In the following embodiments, reference will be made to one or more participants. A participant is a (virtual) user who participates in an extended reality. In the context of a real space 50, a participant is a user 51. In the context of a virtual space 60, a participant is a virtual user 71. Thus, depending on the context, the term "participant" refers to a user 51 and / or a virtual user 71.

[0097] Figure 4A , Figure 4B , Figure 4C The examples respectively show before, during and after adding a joining participant 712 to at least existing participants 711 to achieve a shared extended reality.

[0098] Joining the joining participant 712 to the existing participant 711 to achieve a shared extended reality means that the existing participant 711 and the joining participant 712 are co-located 42 in the virtual space 60 and at least visually share the virtual space 60 .

[0099] Figure 4A An existing participant 711 in augmented reality in virtual space 601 is shown. Existing participant 711 is at position 721 and has viewpoint 771.

[0100] Figure 4BThe figure shows that a joining participant 712 in the extended reality is joined to at least an existing participant 711 in the extended reality (who is at a position 721 in the virtual space 601) to achieve a shared extended reality. The joining participants 711, 712 in the shared extended reality are at least co-located in the virtual space 60 and can at least visually share the virtual space 60. i . Shared Virtual Space 60 i It may be the original virtual space 601 or some other portion of the virtual space 60 .

[0101] Participants 711, 712 are co-located in a shared virtual space 60 i in that they can at least visually share a virtual space 60 in a shared extended reality.

[0102] Existing participants 711 in the shared virtual space 60 i has a location 721 and joins a participant 712 in the same shared virtual space 60 i 721 and 722 are within a threshold distance of each other. Thus, in at least some examples, the joining participant 712 is in the shared virtual space 60 i Located in the shared virtual space 60 i within a threshold distance of location 721 of existing participant 711.

[0103] If we have a 3DoF experience (such as a multi-view 3DoF experience), then two or more participants do not have to see each other, because they will occupy the same position in space (with different degrees of freedom for viewing directions). But they can have visual indications of each other's presence, and they will usually hear each other. If we have a 6DoF experience, then users can usually see each other and hear each other.

[0104] Participants 51 (71) may have the same or different viewpoints 57 (77). In this example, existing participant 711 has viewpoint 771, and joining participant 712 has viewpoint 772, and viewpoint 771 and viewpoint 772 may be co-related. For example, in this example, viewpoint 771 is oriented toward joining participant 772, while viewpoint 722 is oriented toward existing participant 771. In other examples, viewpoint 771 and viewpoint 772 are oriented toward virtual space 60. i a specific part of a component, such as a virtual object.

[0105] In at least some examples, when joining participant 712 and existing participant 711 are joined to share virtual space 60 ( Figure 4C), the orientation of the viewpoint 772 of the joining participant 712 in the virtual space 60 makes the existing participant 711 immediately visible to the joining participant 712. This can be achieved by orienting the viewpoint 772 of the joining participant 712 to be substantially aligned with the position 721 of the existing participant 711 in the virtual space 60 (with the edge of the field of view).

[0106] In at least some examples, when the joining participant 712 and the existing participant 711 are joined to share the virtual space 60 ( Figure 4C ), select the position 722 of the joining participant 712 in the virtual space 60 so that the joining participant 712 is immediately visible to the existing participant 711 within the virtual visual scene 75. This can be achieved by selecting the position 722 of the joining participant 712 in the virtual space 60 to be substantially aligned with the direction of the viewpoint 771 of the existing participant 711 (with the edge of the field of view).

[0107] Figure 4C Participants 711, 712 are shown sharing an extended reality within the shared virtual space 601. In this example, but not necessarily all examples, the participants 711, 712 can independently experience the extended reality within the shared virtual space 60i by changing their respective viewpoints 771, 772.

[0108] In at least some examples, the participants 51 (71) have different viewpoints 57 (77). For example, the first virtual user 711 has a first viewpoint 771 that corresponds to the first viewpoint 571 of the first real user 511, and the second virtual user 712 has a second viewpoint 772 that corresponds to the second viewpoint 572 of the second real user 512. The first viewpoint 771 is controlled independently of the second viewpoint 772. In the example shown, the first viewpoint 571 of the first real user 511 is tracked using the head mounted device 101 worn by the first real user 511, and the second viewpoint 572 of the second real user 512 is tracked using the head mounted device 102 worn by the second real user 512.

[0109] After joining, the existing participant 711 participates in the extended reality and can control the viewpoint 771 within the virtual space 601, and the new participant 712 participates in the extended reality and can control the viewpoint 772 within the virtual space 601. The viewpoint 771 associated with the existing participant 711 and the viewpoint 772 associated with the joining participant 712 can be independently controlled by the respective existing participant 711 and the respective joining participant 712.

[0110] although Figure 4B and 4CThe example shown in illustrates 6DoF with different positions for viewpoints 771 , 772 , but it is also related to 3DoF where the positions of viewpoints 771 , 772 may be the same and fixed.

[0111] The extended reality rendered to the participant 71 is determined at least in part by the extended reality content. The extended reality content has visual elements and may also have audio elements. It may also have interactive elements. The audio elements may be input channels (if and how the participant is heard) and / or output channels (if and how the participant is heard). The visual elements may be input channels (if and how the participant is seen) and / or output channels (how the participant is seen).

[0112] The interactive element can control whether the participant is an observer (passive) or an interactor (active). When the participant 71 is an interactor, the participant can interact with objects within the virtual space 60.

[0113] The extended reality content rendered to the participant 51, 71 depends on the viewpoint 57, 77 of the participant 51, 71. At least the visual element of the extended reality content rendered to the participant 51, 71 (virtual visual scene) depends on the viewpoint 57, 77 of the participant 51, 71. Changing the viewpoint 57, 77 changes the virtual visual scene. In some examples, the audio element of the extended reality content rendered to the participant 51, 71 (virtual sound scene) may depend on the viewpoint 57, 77 of the participant 51, 71. Changing the viewpoint 57, 77 changes the virtual sound scene. In some examples, the interactive element of the extended reality content rendered to the participant 51, 71 (virtual interactive scene) may depend on the viewpoint 57, 77 of the participant 51, 71. Changing the viewpoint 57, 77 changes the availability of virtual objects for interaction in the virtual visual scene.

[0114] The content configuration is used to control at least the visual and / or audio interactions between participants sharing the extended reality. The content configuration controls what is heard, what is seen, and interactivity with the virtual space 60 for the participants 511, 512 (711, 712) in the extended reality.

[0115] For participants in extended reality71 i , content configuration 30 i Can control what is heard, what is seen, and interactivity with the virtual space 60 (optional), including participants 71 i Whether it is another participant71 j or other participants71 j See, Participant 71 i Whether it is another participant71 j or other participants71 j Heard, Participant 71i Did you see another participant? j or other participants71 j , Participants 71 i Did you hear the other participant? j or other participants71 j The content configuration 30 controls visual and / or audio communications between the participants 71 .

[0116] Figure 5 The example of 24 shows that at least a portion of the content configuration 301 is inherited 24 by the joining participant 512 ( 712 ) from the existing participant 511 ( 711 ).

[0117] Thus, the content configuration 301 controls what the existing participants 711 see and / or hear. It can also control how the existing participants 711 see and / or hear the joining participants 712.

[0118] The content configuration 301 is inherited by the joining participant 712. It controls what the joining participant 712 sees and / or hears. It can control how the joining participant 712 sees and / or hears the existing participants 711.

[0119] In some examples, the content configuration 301 of the existing participant 711 inherited by the joining participant 712 can depend on the content rendered in the virtual visual scene and / or the settings for the existing participant 711 or the device 101 associated with the existing participant 711 and / or the capabilities of the device 101 associated with the existing participant 711.

[0120] Figure 5 It is also illustrated that at least a portion of the join configuration 32 is inherited 24 between the existing participant 511 (711) and the joining participant 512 (712). The join configuration 32 controls the joining of participants in the shared extended reality to the participant 51 (71) associated with the join configuration.

[0121] The join configuration 32 controls when one participant 71 is joined to another participant 71 in a shared extended reality experience. The join configuration 32 may, for example, define a set of conditions for a connection. The join configuration 32 may, for example, define when to deny a join, when to allow a join unconditionally, and when to allow a join conditionally.

[0122] Joining participant 712 may join existing participant 711 in the extended reality in response to accepting a join request made by joining participant 712. The joining configuration of existing participant 711 determines whether acceptance of the join request by joining participant 712 is automatic or contingent upon confirmation by existing participant 711.

[0123] The join configuration applied to a join to a particular existing participant 711 may, for example, depend on whether the particular existing participant 711 is alone or in a group of existing participants 711. For example, the join configuration may be modified by inheritance from other participants. The join configuration may, for example, depend on the privacy settings of the existing participant(s) 711.

[0124] The joining configuration may depend, for example, on whether a communication channel exists between existing participants 711 .

[0125] Inheritance means that the parameters of the content configuration 30 and the join configuration 32 are transferred from one (source) configuration to another (target) configuration that uses them. New parameters are added to the configuration, or existing parameters can be replaced or removed. After inheritance, the configuration group including the source and target configurations will have at least some common parameters.

[0126] The inheritance hierarchy determines the direction of inheritance. You can define the hierarchy for all inherited parameters or individually for parameters or parameter groups.

[0127] In some examples, the direction of inheritance may be unidirectional between the joining participant 712 and the existing participant 711. In some examples, the direction of inheritance may be bidirectional between the joining participant 712 and the existing participant 711.

[0128] The inheritance 24 of the content configuration 30 is different from the inheritance 24 of the join configuration 32 .

[0129] The inheritance 24 of the content configuration 30 is hierarchical, with the direction of inheritance 24 from existing participants 711 to joining participants 712 .

[0130] The inheritance 24 of the join configuration 32 is hierarchical with the direction of the inheritance 24 from the existing participant 711 to the join participant 712 based on the respective content configurations 20 of the existing participant 711 and the join participant 712. Inheritance by whom and from whom is based on the respective content configurations 20 of the existing participant 711 and the join participant 712. The inheritance 24 of the join configuration 32 depends on one or more parameters of the join configuration 321 of the existing participant 711 and one or more parameters of the join configuration 322 of the join participant 712.

[0131] In at least some examples, audio and / or visual feedback is provided to participant 71 that is a destination of inheritance of content configuration 30 , and / or feedback is provided to participant 71 that is a source of inheritance of content configuration 30 .

[0132] In at least some examples, audio and / or visual feedback is provided to a participant that is a destination of an inheritance of a join configuration 32 and / or feedback is provided to a participant that is a source of an inheritance of a join configuration.

[0133] For inheritance of content configuration 30, existing participant 711 is dominant and inheritance is unidirectional.

[0134] Some or all parameters of the source content configuration 301 (the content configuration of the existing participant 711) are transferred to the target configuration (the content configuration of the joining participant 712).

[0135] For inheritance of content configuration, existing participant 711 is dominant, so that joining participant 712 has substantially the same content experience as existing participant 711, at least initially. Joining participant 712 inherits at least one or more audio parameters that control what is heard in the extended reality. The audio parameters of the content configuration may, for example, define auditory focus, volume level, etc. Joining participant 712 inherits at least one or more visual parameters that control what is seen in the extended reality. Visual parameters may, for example, define visual focus. Optionally, joining participant 712 inherits at least one or more interaction parameters that control what interactions are possible with objects within virtual space 60.

[0136] After inheriting the content configuration 30, there is an identical content configuration - each participant 71 at least initially has the same common content configuration 30. Each participant 71 thus has the same shared experience of the extended reality content in the shared extended reality.

[0137] In at least some examples, commonality between content configurations 30 of participants 71 in a shared extended reality may be enforced. For example, participant modification of content configurations 30 may not be allowed or only allowed within defined limits to enhance commonality of experience and prevent significant differences in content experience. In at least some examples, if a participant attempts to modify or significantly modify their content configuration 30, they are instead provided with the option to unjoin from the shared extended reality.

[0138] For inheritance of join configuration, existing participant 711 is not necessarily dominant, and inheritance is not necessarily one-way.

[0139] Some or all of the parameters of the source connection configuration 32 are transferred to the target connection configuration 32. The source join configuration 32 may be the join configuration 321 of the existing participant 711 and the target join configuration 32 may be the join configuration 322 of the joining participant 712, and / or the source join configuration 32 may be the join configuration 322 of the joining participant 712 and the target join configuration 32 may be the join configuration 321 of the existing participant 711.

[0140] The inheritance of the join configuration 322 depends on one or more parameters of the join configuration 321 of the existing participant 711 and one or more parameters of the join configuration 322 for the joining participant 712. The most restrictive parameters are dominant.

[0141] In some examples, existing participant 711 is a leader acting as a host, and joining participant 712 is a guest.

[0142] In some examples, existing participant 711 is not a primary participant as a member, and joining participant 712 is a peer member.

[0143] For the inheritance of the join configuration 32, the existing participant 711 and the joining participant 712 provide substantially the same joining experience to another joining participant. The joining participant 712 and / or the existing participant 711 inherits at least one or more control parameters controlling the following items:

[0144] Whether and / or from whom the user has explicit consent to join XR

[0145] Whether and / or to whom notification of a request to join XR is given

[0146] Whether and / or to whom notification of a joining participant joining the extended reality is given.

[0147] For inheritance of the join configuration 32, there may be an inheritance equation such that at least initially the existing participant 711 and the joining participant 712 share the same join controls. At least one of the joining participant 712 and / or the existing participant 711 inherits at least one or more parameters that control the join that are more restricted than its current parameters. The more restrictive parameters are primary and are inherited.

[0148] In at least some examples, when existing participant 711 has an open audio communication channel, the joining configuration of existing participant 711 is adapted to require explicit authorization to join from existing participant 711 and one or more other users communicating in the communication channel.

[0149] In at least some examples, before the joining participant 712 requests to join the shared extended reality, a preview of the shared extended reality is provided to the joining participant 712, where the preview includes the existing participant 711 at the joining location. The preview can give a visual indication of the joining configuration 321 of the existing participant(s) 711.

[0150] In at least some examples, joining of the join configuration 32 is dependent on the content of the extended reality experienced by the existing participants 711. For example, joining may be automatically denied based on the extended reality content.

[0151] The extended reality content may, for example, have associated metadata defining allowed / disallowed join points.

[0152] For example, the narrative of the extended reality content may be protected for the existing participant 711 and / or the joining participant 712. For example, access to the content is allowed / disallowed based on the content history of the joining participant 712. For example, access to the content is allowed / disallowed based on the importance of the current content to the narrative of the existing participant 711. For example, access to the content is allowed / disallowed based on the importance of the content to the narrative of the joining participant 712.

[0153] Figure 6 An example of a controller 80 suitable for use with the device 10 is shown. The controller 80 may be implemented as a controller circuit. The controller 80 may be implemented solely in hardware, with certain aspects in software including firmware alone, or may be a combination of hardware and software (including firmware).

[0154] like Figure 6 As shown, the controller 80 may be implemented using instructions to enable hardware functionality, for example, by using executable instructions of a computer program 86 in a general or special purpose processor 92 .

[0155] The processor 92 is configured to read from and write to the memory 84. The processor 92 may also include an output interface via which data and / or commands are output by the processor 92 and an input interface via which data and / or commands are input to the processor 92.

[0156] The memory 84 stores a computer program 86 including computer program instructions (computer program code) that controls the operation of the device 10 when loaded into the processor 92. The computer program instructions of the computer program 86 provide the logic and routines that enable the device to perform the methods shown in the various figures. By reading the memory 84, the processor 92 can load and execute the computer program 86.

[0157] Thus, the device 10 comprises:

[0158] at least one processor 92; and

[0159] At least one memory 84 including computer program code

[0160] The at least one memory 84 and the computer program code are configured to, together with the at least one processor 92, cause the device 10 to at least perform:

[0161] initiating joining of a joining participant in the extended reality to at least an existing participant in the extended reality at the location in the virtual space to achieve a shared extended reality;

[0162] causing a content configuration to be inherited by a joining participant from the existing participant, wherein the content configuration controls for the participant what to hear, see, and interact with the virtual space;

[0163] causing at least a portion of a join configuration to be inherited between an existing participant and a joining participant, wherein the join configuration controls joining of other joining participants in the shared extended reality;

[0164] Joining a joining participant in an extended reality to at least an existing participant in the extended reality is accomplished, wherein the existing participant and the joining participant, collectively referred to as the joining participant, are initially at least co-located in the virtual space and are able to at least visually share the virtual space.

[0165] like Figure 7 As shown in the example of , the computer program 86 may arrive at the apparatus 10 via any suitable delivery mechanism 88. The delivery mechanism 88 may be, for example, a machine-readable medium, a computer-readable medium, a non-transitory computer-readable storage medium, a computer program product, a memory device, a recording medium such as a compact disk read-only memory (CD-ROM) or a digital versatile disk (DVD) or a solid-state memory, an article of manufacture including or tangibly embodying the computer program 86. The delivery mechanism may be a signal configured to reliably deliver the computer program 86. The apparatus 10 may propagate or send the computer program 86 as a computer data signal.

[0166] Computer program instructions for causing an apparatus to perform at least the following or for performing at least the following:

[0167] joining the joining participant in the extended reality to at least an existing participant in the extended reality at the location in the virtual space to achieve a shared extended reality,

[0168] wherein the joined participants in the shared extended reality are at least co-located in a virtual space and can at least visually share the virtual space;

[0169] wherein the joining participant inherits at least a portion of a content configuration from an existing participant, wherein the content configuration is for the participant to control what the participant hears, sees, and interacts with the virtual space;

[0170] Wherein at least a portion of a join configuration is inherited between existing participants and a joining participant, wherein the join configuration controls joining of other joining participants in the shared extended reality.

[0171] The computer program instructions may be included in a computer program, a non-transitory computer readable medium, a computer program product, a machine readable medium. In some but not necessarily all examples, the computer program instructions may be distributed over more than one computer program.

[0172] Although memory 84 is shown as a single component / circuit, it may be implemented as one or more separate components / circuits, some or all of which may be integrated / removable and / or may provide persistent / semi-persistent / dynamic / cached storage.

[0173] Although processor 92 is shown as a single component / circuit, it may be implemented as one or more separate components / circuit, some or all of which may be integrated / removable.Processor 92 may be a single-core or multi-core processor.

[0174] References to "computer-readable storage medium," "computer program product," "tangibly embodied computer program," etc. or "controller," "computer," "processor," etc. should be understood to include not only computers having different architectures such as single / multi-processor architectures and sequential (vonneumann) / parallel architectures, but also special purpose circuits such as field programmable gate arrays (FPGAs), application specific circuits (ASICs), signal processing devices, and other processing circuits. References to computer programs, instructions, code, etc. should be understood to include software or firmware for a programmable processor, such as the programmable content of a hardware device, whether instructions for a processor, or configuration settings for a fixed function device, gate array, or programmable logic device, etc.

[0175] As used in this application, the term "circuitry" may refer to one, more than one, or all of the following:

[0176] (a) only hardware circuit implementation (e.g., only implementation in analog and / or digital circuits) and

[0177] (b) a combination of hardware circuitry and software, such as (where applicable):

[0178] (i) a combination of analog and / or digital hardware circuits and software / firmware, and

[0179] (ii) any portion of a hardware processor(s) with software (including digital signal processor(s), software and memory that work together to enable a device such as a mobile phone or server to perform various functions, and

[0180] (c) Hardware circuits and / or processors, such as a microprocessor or portion of a microprocessor, that require software (e.g., firmware) to operate, but which may not be present when the software is not needed for operation.

[0181] This definition of circuitry applies to all uses of this term in this application, including in any claims. As another example, as used in this application, the term circuitry also covers implementations of hardware-only circuits or processors and (or) their accompanying software and / or firmware. The term "circuitry" also covers baseband integrated circuits for mobile devices or similar integrated circuits in servers, cellular network device integrated circuits or similar integrated circuits in servers, cellular network devices, or other computing or network devices.

[0182] The blocks shown in the figure may represent steps in the method and / or code sections in the computer program 86. The description of a particular order of blocks does not necessarily imply that there is a required or preferred order for the blocks, and the order and arrangement of the blocks may vary. In addition, some blocks may be omitted.

[0183] The apparatus 10 may be, for example, a head mounted device of a participant.

[0184] The device 10 may be, for example, a head-mounted device of a joining participant. The device 10 may be, for example, a head-mounted device of an existing participant. For example, the head-mounted device may include a head-up display and headphones.

[0185] The apparatus 10 may be, for example, a control device or system for communicating with a participant's head mounted device.

[0186] The apparatus 10 includes components 80 for:

[0187] adding 40 a joining participant 712 in the extended reality to at least an existing participant 711 in the extended reality at the location in the virtual space 60 to achieve a shared extended reality,

[0188] wherein the joined participants 711 , 712 in the shared extended reality are at least co-located 42 in the virtual space 60 and can at least visually share the virtual space 60 ;

[0189] wherein the joining participant 712 inherits 24 at least a portion of the content configuration 30 from the existing participant 711 , wherein the content configuration 30 controls what the participant 71 hears, sees, and interacts with the virtual space 60 ;

[0190] At least a portion of the join configuration 32 is inherited 24 between the existing participant 711 and the joining participant 712 , wherein the join configuration 32 controls joining of other joining participants in the shared extended reality.

[0191] Figure 8 An example of method 100 is shown.

[0192] The method includes, at block 102 , joining a participant in an extended reality to at least an existing participant in the extended reality at a location in a virtual space to achieve a shared extended reality.

[0193] The method includes, at block 104, enabling a joining participant to inherit a content configuration from an existing participant, wherein the content configuration controls for the participant what to hear, see, and interact with the virtual space;

[0194] The method includes causing at least a portion of a join configuration to be inherited between an existing participant and a joining participant at block 106 , wherein the join configuration controls joining of other joining participants in the shared extended reality.

[0195] The method includes, at box 108, completing joining a joining participant in the extended reality to the at least existing participant in the extended reality, wherein the existing participant and the joining participant, collectively referred to as the joining participant, are initially at least co-located in the virtual space and are able to at least visually share the virtual space.

[0196] Use Cases

[0197] In some examples, the extended reality content may be 3DoF (three degrees of freedom) content. Participants 51, 71 in an extended reality enabled by the extended reality content may rotate their heads to change their viewpoints 57, 77 (only orientation changes) and experience different virtual visual scenes (and in some instances different sound scenes). 3DoF extended reality content may define different and distinct virtual visual scenes (and optionally associated sound scenes) that are not adjacent in the virtual space 60, but which may be accessed by changing the viewpoints 57, 77 by changing the orientation. For example, this may be referred to as multi-viewpoint 3DoF content. Although the transition from a first viewpoint to an adjacent second viewpoint is continuous, the transition in the virtual space 60 is a discontinuous jump in space or space and time, i.e., a teleport.

[0198] In some examples, the extended reality content may be 6DoF (six degrees of freedom) or 3DoF+ content (e.g., multi-view 3DoF+ content). Participants 51, 71 in an extended reality enabled by the extended reality content may rotate to change their viewpoint 57, 77 and change their position to change their viewpoint 57, 77 (change of orientation and / or position). Changing the viewpoint 57, 77 changes the virtual visual scene (and in some examples the sound scene). The 6DoF extended reality content may define different and distinct virtual visual scenes (and optionally associated sound scenes) that are not adjacent in the virtual space 60, but which may be accessed when the viewpoint 57, 77 is changed by changing position and / or orientation. While the transition from a first viewpoint to an adjacent second viewpoint is continuous, the transition in the virtual space 60 may be a discontinuous jump in space or a discontinuous jump in space and time, i.e., a teleport.

[0199] The extended reality content may also be consumed by more than one participant 71 simultaneously, so that users may share a common extended reality. In at least some examples, such participants 71 may observe and communicate with each other in the virtual space 60. This type of use case may be referred to as "social" extended reality. The participants 71 may be physically close to or far away from each other in the real space 50.

[0200] Participants 71 in the extended reality are typically equipped with means to enter and leave the extended reality in their own time, join one or more other participants 71 already in the extended reality, and invite participants 71 to enter the extended reality.

[0201] In at least some examples, the participant 71 may also control privacy. For example, an 'open door' mode may allow an existing participant 711 to join the extended reality without confirmation from the existing participant 711. For example, a 'closed door' mode may allow an existing participant 711 to join the extended reality, but only after they are confirmed by the existing participant 711. For example, a 'private' mode may prevent an existing participant 711 from joining the extended reality. Privacy may be a parameter in the join configuration 32.

[0202] In the following examples, joining a participant (or user) means that the user moves / is moved into proximity with another user in the virtual space 60 via the phone port, and the two users become audible and visible to each other. These examples are relevant to any type of extended reality including 3DoF, 3DoF+, 6DoF or some other variation.

[0203] In the following example, user A is in augmented reality and wants to change to a different part of virtual space 60. This can be done by teleportation. User A is a joining participant 712.

[0204] The participant 712 (user A) in the extended reality is in a virtual space 602 different from another virtual space 601 , so that the participant 712 (user A) in the extended reality requires a teleport to transfer from the virtual space 602 to participate in the extended reality at the virtual space 601 .

[0205] For example, teleportation can be implemented so that user A moves the teleportation target to where they wish to go and upon confirmation, it is immediately teleported there. Typically, this is done using a controller, and possible and disallowed targets are shown in different colors.

[0206] exist Fig. 9 In the example shown, the joining participant 712 (user A) points to different teleport areas 82, which can indicate, for example, by color whether it is possible to transmit there. In this example, the teleport areas include available teleport areas 82', conditionally available teleport areas 82'" and unavailable teleport areas 82".

[0207] refer to Fig.10 In the example of, a participant 712 (user A) in extended reality wants to teleport from virtual space 602 to virtual space 601 to experience a multi-user extended reality. His friends Jussi and Arto are participants 711 in extended reality in the same virtual space 601, and experience the same content in different nearby locations. Jussi 711 and Arto 711 have a join configuration 22 [not shown] that allows other users to join them. For example, Jussi 711 has an associated connection configuration 32 that allows direct connection without confirmation. Arto 711 has an associated connection configuration 32 that conditionally allows connection. In this example, it requires the joining participant 712 (user A) to send a join request to Arto 711, and also requires Arto 711 to reply to the request to confirm the join before the join occurs.

[0208] The fact that Arto 711 and Jussi 711 have different connection configurations 22 is shown in this example via the telecom port area 82. Jussi 711 is shown as being located within the available telecom port area 82' and Arto 711 is shown as being located within the conditionally available telecom port area 82'".

[0209] exist Fig.10 Afterwards, in Fig.11In the example of FIG. 7 , a joining participant 712 (user A) previews Jussi's 711 phone port area 82'. The preview triggers a first audio indication to Jussi 711, which can be characterized as a phone port ring tone for immersive media. In this way, Jussi 711 knows that a user is considering joining him. In various embodiments, this can allow Jussi 711 to communicate back or simply prepare that another user (user A) 712 may soon appear in his virtual space 601.

[0210] In 3DoF, the appearance of user A 712 may be limited to a new audio communication channel opened between Jussi 711 and user A 712 and / or a change in the viewport visualization, e.g., indicating that user A 712 has the same viewpoint 771 as Jussi 711. In 6DoF, the appearance of user A 712 may appear in the rendered content within the virtual visual scene (and corresponding sound scene). For a joined participant, user A 712 may, for example, become visible in front of existing participants 711, and may move virtual objects that are mutually visible to Jussi 711 and user A 712.

[0211] The telephone port ring tone for immersive media can be, for example, one of the following:

[0212] Modifying audio objects in the virtual space 601 within the virtual visual scene of the existing participant 711 (Jussi);

[0213] Presenting audio objects from the sound scene of the joining participant 712 (User A) to the existing participant 711 (Jussi);

[0214] The system generates audio objects;

[0215] an audio object that the joining participant 712 (User A) has created for this purpose, such as their personalized greeting message;

[0216] For example, an existing participant 711 (e.g., Jussi) has created audio objects for each of his friends. Jussi may have a specific audio track that starts playing for one or a group of contacts.

[0217] In some cases, the phone port ringing for immersive media may be accompanied by a visual indication or visual content. For example, such visual content may become visible only when the existing participant 711 (Jussi) reacts to the ringing that occurs in his area, for example by performing an activation gesture.

[0218] After previewing virtual space 601, joining participant 712 (User A) may indicate an intent to teleport and join virtual space 602 to share an augmented reality with existing participant 711 (Jussi).

[0219] If the existing participant 711 (Jussi) himself is experiencing the extended reality in the virtual space 602, the joining configuration 321 of the existing participant 711 (Jussi) enables the existing participant 711 (Jussi) to join without the confirmation of the existing participant 711 (Jussi).

[0220] However, if existing participant 711 (Jussi) is experiencing the extended reality of existing participant 711 (Arto) with a more restrictive join configuration 321, then Jussi's 711 join configuration inherits from Arto 711 and only supports joining to Jussi 711 with confirmation.

[0221] exist Fig.10 Afterwards, in Fig.12 In the example of , a joining participant 712 (User A) previews the phone port area 82'' of an existing participant 711 (Arto). The join configuration 321 associated with Arto 711 means that Arto 711 accepts join requests from other users, but does not allow direct joins.

[0222] The preview triggers a first audio indication to Arto 711, which can be characterized as a telephone port ringing tone for immersive media. In this way, Arto 711 knows that the second user is considering joining him. ARTO 711 is required to respond so that the remote port appears. Joining participant 712 (user A) now needs "permission" from existing participant 711 (Arto) to join existing participant 711 (Arto). However, permission from existing participant 711 (Arto) may not directly trigger remote transmission because the joining participant 712 (user A) only previews the content. Therefore, if Arto 711 accepts the request, in this example, Arto 711 will continue to hear audio indications of the preview action from user A 712. This can be a different audio indication from what Arto 711 heard before it heard the response.

[0223] When the joining participant 712 (user A) is previewing the content for which they need permission to join, the second audio indication may itself be provided to the joining participant 712 (user A). This may use a similar selection mechanism as the first audio indication. Waiting for a response and the response itself may be indicated to the joining participant 712 (user A) by the second and third immersive audio indicators.

[0224] A further audio indication to the joining participant 712 (user A) may also be used to indicate that the existing participant 711 (Arto) is aware of the request and is considering whether to accept. This audio may similarly be selected as the first telephone port ring tone.

[0225] The joining participant 712 (user A) joins the existing participant 711 (Arto) in the extended reality in response to accepting the joining request made by the joining participant 712 (user A). The joining configuration 321 of the existing participant 711 (Arto) determines whether the acceptance of the joining request by the joining participant 712 (user A) is automatic or dependent on confirmation by the existing participant 711 (Arto).

[0226] refer to Fig.13 , joining participant 712 (user A) has previewed the area of ​​existing participant 711 (Arto), and existing participant 711 (Arto) has not responded to the request. Joining participant 712 (user A) hears a second audio indication. Joining participant 712 (user A) does not know that Jussi 711 will be available, and it takes Arto 711 a long time to provide a response.

[0227] After time threshold T1, the system begins to offer the joining participant 712 (user A) an alternative, less restrictive teleport area 82. In particular, the existing participant 711 (Jussi) is presented as being directly available to join. An audio indication to the joining participant 712 (user A) begins to move in the direction of Jussi's 711, introducing audio elements from Jussi's 711 portion of the scene.

[0228] The joined participant 712 (User A) can now preview the Jussi711 scene based on the "preview" provided by the audio modification (introducing audio elements from the Jussi711 part of the scene) or join it directly.

[0229] Thus, joining participant 712 (user A) may initiate a multi-user extended reality by indicating that they wish to teleport near existing participant 711. Existing participant 711 has the ability to accept or decline based on existing participant's 711 preferences.

[0230] refer to Fig.14 In the example of , joining participant 712 (user A) has requested to join the extended reality of existing participant 711 (Arto), i.e., to be teleported from virtual space 602 to co-locate and share the extended reality with existing participant 711 (Arto) in virtual space 601.

[0231] exist Fig.14 , the existing participant 711 (Arto) has accepted the request, and the joining participant 712 (user A) has confirmed the teleportation (or automatically teleported). The two participants 711, 712 are now experiencing a shared extended reality at the virtual space 601.

[0232] Fig.14 An existing participant 711 in extended reality is shown joining 40 at a location in virtual space 601, and a participant 712 joining in extended reality to achieve a shared extended reality. The joined participants 711, 712 in the shared extended reality are co-located 42 in virtual space 601, and share virtual space 601 at least visually.

[0233] Joining participant 712 inherits 24 at least a portion (not shown) of content configuration 301 from existing participant 711. Content configuration 301 controls what participant 712 hears, sees, and interacts with virtual space 601 in the shared extended reality.

[0234] At least a portion of the join configuration 32 is inherited 24 between the existing participants 711 and the joining participants 712. The join configuration 32 controls the joining of other joining participants in the shared extended reality at the virtual space 601.

[0235] In this example, the inherited content configuration 301 enables the participants 711 , 712 to see each other and to communicate with each other using audio.

[0236] In some examples, joining 40 may be accompanied by the initiation of a common audio-visual communication channel that existing participants 711 may accept or decline.

[0237] Reference Fig.15 , joining participant 712 (user A) wishes to join existing participant 711 (Arto) at virtual space 601. Existing participant 711 (Arto) rejects the request.

[0238] After the existing participant 711 (Arto) rejects the request, the joining participant 712 (User A) still has the opportunity to transfer the call to the virtual space 601.

[0239] The joining participant 712 (User A) selects the phone port. The teletransmission is performed according to the private mode of the teletransmission.

[0240] Joined participant 712 (user A) is teleported to virtual space 601 , but the instance of virtual space 601 has no existing participant 711 .

[0241] The joined participant 712 (user A) does not join to the shared extended reality, but (only) joins to the remote port of the virtual space 601.

[0242] Participants 711, 712 are now in different separate instances of virtual space 601. Participant 712 is now in new instance 60'1 of virtual space 601.

[0243] Two participants 711, 712 experience extended reality content at different independent instances of the same virtual space 601. The participants 711, 712 cannot see or hear each other. In some implementations, interactive elements in a virtual space may be common to instances of the virtual space.

[0244] The system may allow existing participants 711 to select whether they wish to experience the extended reality content together as shared extended reality content (e.g., social VR) or remain private.

[0245] refer to Fig.16A and 16B In the example of , a joining participant 712 (user A) wishes to remotely share an extended reality with an existing participant 711 (Arto) at the virtual space 601 .

[0246] exist Fig.16A , a joining participant 712 (user A) is previewing the virtual space 601 of an existing participant 711 (Arto). Request to join the existing participant 711 (Arto)

[0247] Denied, at least temporarily, based on content attributes of the augmented reality content associated with the virtual space 601 .

[0248] In this example, existing participant 711 (Arto) has previously interacted with the extended reality content in a manner that joins a shared extended reality experience between participant 712 (user A) and existing participant 711 (Arto).

[0249] If joining participant 712 (user A) is allowed to join existing participant 711 (Arto) in the shared extended reality experience at virtual space 601, joining participant 712 (user A) will be substantially harmed.

[0250] In this example, existing participant 711 (Arto) only interacts with virtual objects defined by the extended reality content and produces results.

[0251] In some cases, the interaction may be saved as the state of virtual space 601. Thus, virtual space 601 has a pre-interaction state and a post-interaction state. If joined participant 712 (user A) were to teleport into virtual space 601, after the interaction, joined participant 712 (user A) would enter virtual space 601 in the post-interaction state. This may be undesirable. The system may prevent teleportation in such a case based on the state of virtual space 601, which in turn depends on the content.

[0252] Another example where content-based teleportation is not allowed is if there is something later in the content that requires that the two users did not see that thing together (e.g., because they saw it differently). For example, let's consider movie immersive media content where one participant's user-selected narrative is a narrative where the protagonist gets the job in an interview, while the other participant's user-selected narrative is a narrative where the protagonist does not get the job). In this case, the two participants 711, 712 cannot see the same interview in close proximity to each other.

[0253] Another example of movie content is if there is a basic cut scene or animation going on, then teleportation is temporarily disabled. During this time, it may seem unnatural and disconcerting for the user to receive incoming teleported participants 712 in their extended reality experience.

[0254] According to this embodiment, there may be, for example, a temporary denial of the teleportation request based on the content consumption state of the existing participants and / or the requesting participant 712. After a subsequent trigger within the content, the two users may, for example, automatically join the same shared extended reality (upon a request to do so).

[0255] Thus, the joining of the joining participant 712 may be dependent on the content of the extended reality experienced by the existing participant 711. For example, joining may be automatically denied based on the content.

[0256] refer to Fig.17A and 17B For example, in various embodiments of multi-user extended reality, participants 71 may have means to privately communicate with each other in parallel with the shared extended reality. This may be considered, for example, in the MPEG-16 DoFSocial VR use case. Thus, for example, a voice communication channel 90 may be made available to users when they are users of the same multi-user extended reality system, regardless of being joined to the same audio-visual extended reality.

[0257] exist Fig.17A , requesting participant 712 (user A) wishes to teleport to an extended reality shared with existing participant 711 (Arto or Jussi), who is located in a different part of virtual space 601 but shares a voice communication channel 90 of which requesting participant 712 (user A) is not a part.

[0258] The join configuration of the existing participant 711 (eg, Arto) allows the existing participant 711 to accept or decline the join request, and if accepted to join or not, the joining participant 712 enters the voice communication channel 90 .

[0259] In the absence of a shared extended reality between Arto and Jussi, another existing participant 711 (eg, Jussi) has a less restrictive join configuration 32 than Arto and automatically accepts the join request when participant 712 is added to the voice communication channel 90 .

[0260] However, the presence of the voice communication channel 90 causes Jussi's join configuration 32 to inherit the more restrictive aspects of Arto's join configuration 32 .

[0261] If the requesting participant 712 (user A) wishes to join an existing participant 711 (e.g., Arto) in the shared extended reality, the permission of the existing participant 711 (e.g., Arto) is sufficient. This is because Arto's response can keep the voice communication channel 90 private. Because the joining configuration 32 of the existing participant 711 (e.g., Arto) allows the existing participant 711 (e.g., Arto) to accept or reject the joining request, and if accepting to join or not to join, whether the joining participant 712 joins the voice communication channel 90, the voice communication channel 90 can remain private.

[0262] exist Fig. 17B In the example of FIG. 7 , a requesting participant 712 (user A) wishes to join an existing participant 711 (e.g., Jussi). The permission level of the existing participant 711 (e.g., Jussi) in the associated join configuration 32 is modified based on the existence of the voice communication channel 90, and at least the permission of Arto 711 is required. The system may also require the requesting participant 712 (user A) to receive permission from Jussi 711.

[0263] The voice communication channel 90 may have a privacy setting, or at least a minimum level of privacy may be implied by inheritance between join configurations 32 of existing participants 711 in the voice communication channel 90 .

[0264] refer to Fig.18A , Fig.18B In the example of FIG. 6 , a joining participant 712 (user A) wishes to teleport into a joint experience with existing participants 711 (Arto and Jussi) who are sharing an extended reality in virtual space 601. Arto and Jussi are in a common location where they can see and hear each other.

[0265] exist Fig.18A, if the existing participants 711 (Arto and Jussi) do not have a private voice communication channel 90, the transfer is direct. In this case, the highest permission level is inherited between the join configurations 32 of the existing participants 711 (Arto and Jussi) and is applied to control the joining. Therefore, the joining participant 712 (user A) will require the existing participant 711 (Arto) to approve the remote transfer. The highest permission level is inherited between the join configurations 32 of the participants 711, 712. That is, permission from Arto 711 is required regardless of whether the join request is made to Arto 711 or to Jussi 711.

[0266] After joining, three participants 711, 712 (Arto and Jussi, user A) share the extended reality at the virtual space 601. The highest permission level is inherited between the joining configurations 32 of the participants 711, 712 (Arto and Jussi, user A). For example, permission may be requested from Arto 711, regardless of whether a new joining request for a new participant is issued to user A 712, Arto 711, or Jussi 711.

[0267] exist Fig.18A , Arto 711 and Jussi 711 have an activated private voice communication channel 90, which temporarily modifies the highest permission level of the join configuration shared by the existing participants 711 (Arto and Jussi). All participants in the voice communication channel 90 need to be allowed. That is, permission is required from both Arto 711 and Jussi 711, regardless of whether the join request is made to Arto 711 or to Jussi 711, to enable teleportation.

[0268] Thus, when an existing participant 711 has an open voice communication channel 90 , the join configuration 32 for the existing participant 711 is adapted to require explicit authorization to join from the existing participant 711 and one or more other users communicating in the voice communication channel 90 .

[0269] exist Fig.19A In the example of , a joining participant 712 (user A) can preview the virtual space 601 used by existing participants 711 (Arto and Jussi) in the shared extended reality.

[0270] The permissions of the connection configuration 32 are as described above. Jussi's 711's join configuration (without inheritance) allows joining from Jussi 711 without confirmation. Arto's 711's join configuration allows joining from Arto 711 but only with confirmation. Jussi's 711's join configuration (after inheriting from Arto 711 in the extended reality of the shared virtual space 601) allows joining from Arto 711 but only with confirmation.

[0271] Therefore, a request from user A712 to join Arto711's shared extended reality requires permission from Arto711, and a request to join Jussi711's shared extended reality requires permission from Arto711 (because the more restrictive permission requirements of Jussi711's join configuration are inherited).

[0272] exist Fig.19D In the example of FIG. 7 , a request from user A 712 is made to Arto 711 or Jussi 711 to join the extended reality shared by Arto 711 and Jussi 711. When permission from Arto 711 is required, an audio indication is issued to Arto 711. Permission is received from Arto 711, and there is a successful join, e.g., as described in reference Fig.18A Described. Users A 712, Arto 711, and Jussi 711 share an extended reality.

[0273] If permission to join is terminated by Arto711, no remote transfer occurs in some examples, such as Fig.19C as shown in the example.

[0274] However, in some examples, if a request to join is made to Jussi711, then if Arto711 refuses to allow user A712 to join the shared extended reality that includes user A712, Arto711, and Jussi711, a new instance of the shared extended reality that includes user A712 and Jussi711 but does not include Arto711 may be created. Fig.19B is shown in the example.

[0275] There may be a first audio indication to Jussi 711, indicating a preview of user A 711 before joining them.

[0276] Jussi 711 sees users A712 and Arto711 in his environment, while users A712 and Arto711 only see Jussi711.

[0277] After teleporting to an instance of shared extended reality that includes Jussi711 but not Arto711, Arto711's modified audio instructions can be played to let him know that user A712 is in the same location (only in a parallel instance), and similarly, user A712 can be provided with modified audio instructions.

[0278] Thus, different instances of the same virtual space 601 are created for users A 712 and Arto 711, for example, as previously described with reference to Fig.15 as described.

[0279] refer to Fig. 20A In the example of FIG. 6 , a joining participant 712 (user A) at the virtual space 602 wishes to teleport to share the extended reality at the virtual space 601 with an existing participant 711 (Arto).

[0280] In this example, the requested existing participant 711 (e.g., Arto) does not want another participant 712 (e.g., user A) to join him at his current location (virtual space 601). However, the requested existing participant 711 (Arto) wants the remote port to share the extended reality with the requesting joining participant 712 (user A) at the virtual space 602. Therefore, arto 711 responds with a "call back" action. When user A 712 is ready, user A 712 is indicated that Arto 711 will join user A 712.

[0281] like Fig. 20B As illustrated in the example of , user A 712 may receive periodic audio indications that Arto 711 still wishes to join. User A 712 or Arto 711 can terminate the call back at any time, for example, user A 711 may change their permission level.

[0282] exist Fig. 20C In the example shown in FIG. 7 , user A 712 has rejected the callback request, which is indicated to Arto 711.

[0283] If user A712 does not reject the callback request, then when Arto711 is available, Arto711 adds the remote port to user A712 at virtual space 601, such as Fig.20D as shown in the example.

[0284] As can be appreciated from the above, in at least some examples, the joining participant 712 joins the existing participant 711 in the extended reality in response to accepting the joining request made by the joining participant 712. The joining configuration 321 of the existing participant 711 determines whether the acceptance of the joining request by the joining participant 712 is automatic or dependent on confirmation by the existing participant 711.

[0285] When a request by a joining participant 712 to join an existing participant 711 in an extended reality at the location of the existing participant 711 is not accepted, a contention resolution process may determine the location in the virtual space 60 where the requesting participant 712 experiences the extended reality and whether the requesting participant 712 experiences the extended reality shared with another participant 71.

[0286] For example, depending on contention resolution, the request to join participant 712 may be:

[0287] i) At the location of the requested existing participant, there is no existing participant [ Fig.15 ]

[0288] ii) co-located with a different existing participant at the location of the requested existing participant [ Fig.13 ]

[0289] iii) co-located with the requested existing participant at the location of the requesting participant [ Fig.20D ]

[0290] iv) co-located in the virtual space with the requested existing participants but not all existing participants [ Fig.19B ]

[0291] In instances i) and iv), there are separate worlds, i.e., different instances of extended realities. It is possible that one participant has an extended reality for a specific portion of the virtual space, and another participant has an extended reality for the same specific portion of the virtual space, but the two participants are unaware of each other. One participant occupies one instance of the virtual space, and the other participant occupies another independent instance of the virtual space. The two instances are fully or partially separate.

[0292] In examples i) and ii), the teleport is prioritized to the location. This process enables the teleport of the location only, requesting to join the participant 712, to not join the existing participant 711 in the extended reality at the location in the virtual space 601, and enables the extended reality of the requesting to join the participant 712 to share the extended reality in the virtual space 601, so that the requesting to join the participant 712 can experience the extended reality at the location in the virtual space 601, which is not shared with the existing participant 711.

[0293] In example iii), the remote port prioritizes the requested existing participant over the location.

[0294] In example iv), the remote port prioritizes the requested existing participant over other nearby participants.

[0295] The join request may hint at a priority for helping contention, such as whether joining the location is critical, joining the user is critical, or joining multiple users is critical. If location is critical, then outcomes i) and ii) are more likely. If joining a specific user is critical, then outcomes ii) and iv) are more likely.

[0296] When a joining participant 712 requests to join an existing participant 711 in the extended reality at the location of the existing participant, the response to the request may be, among other things:

[0297] Join the requested existing participant at the requested location[ Fig.14 ];

[0298] Join an existing participant that is being requested, but not at the requested location [Figure 20];

[0299] No existing participant has been requested to join at the requested position. Fig.15 , Figure 20];

[0300] Depending on existing users, at least partially deny the request[ Fig.15 ];

[0301] Depending on the content of the shared XR rendering, at least some requests may be denied. Fig.16A , 16B];

[0302] time out[ Fig.13 ];

[0303] Alternative connection options[ Fig.13 , 20].

[0304] Where a structural feature has been described, it may be replaced by a means for performing one or more of the functions of the structural feature, whether that function or functions are explicitly or implicitly described.

[0305] The above examples can be applied to the following components:

[0306] Automotive systems; telecommunications systems; electronic systems including consumer electronics; distributed computing systems; media systems for generating or presenting media content, including audio, visual and audiovisual content and mixed, mediated, virtual and / or augmented reality; personal systems, including personal health systems or personal fitness systems; navigation systems; user interfaces, also known as human-machine interfaces; networks, including cellular, non-cellular and optical networks; ad-hoc networks; the Internet; the Internet of Things; virtualized networks; and related software and services.

[0307] The term "comprising" is used herein in an inclusive rather than exclusive sense. That is, any reference to X comprising Y means that X may comprise only one Y or may comprise more than one Y. If the exclusive meaning of 'comprising' is intended to be used, it will become clear from the context by reference to "comprising only one" or by use of "consisting of".

[0308] In this specification, reference is made to various embodiments. Descriptions of features or functions of an example indicate that those features or functions are present in that example. Whether explicitly stated or not, the use of the term "example" or "for example" or "may" or "can" in the text indicates that such features or functions are present in at least the described example, whether or not described as an example, and they may, but not necessarily, be present in some or all other examples. Therefore, "instance", "for example", "may" or "can" refers to a specific instance in a class of instances. The attributes of an instance may be attributes of only that instance, or attributes of a class, or attributes of a subclass of a class that includes some but not all instances in the class. Therefore, it is implicitly disclosed that features described with reference to one example rather than with reference to another example may be used in the other example as part of a working combination where possible, but not necessarily in the other example.

[0309] Although the examples have been described in the preceding paragraphs with reference to various examples, it should be appreciated that modifications to the examples given can be made without departing from the scope of the claims.

[0310] Features described in the preceding description may be used in combinations other than the combinations explicitly described above.

[0311] Although functions have been described with reference to certain features, those functions may be performable by other features whether described or not.

[0312] Although features have been described with reference to certain examples, those features may also be present in other examples whether described or not.

[0313] The terms "a", "an" or "the" are used herein in an inclusive rather than exclusive sense. That is, unless the context clearly indicates otherwise, any reference to X that includes one Y means that X may include only one Y or may include more than one Y. If it is intended to use 'a' or 'the' in an exclusive sense, it will become clear from the context. In some cases, the use of 'at least one' or 'one or more' may be used to emphasize the inclusive meaning, but the absence of these terms should not be understood to imply any exclusive meaning.

[0314] The presence of a feature (or combination of features) in a claim is a reference to that feature or feature (combination of features) itself and to features that achieve substantially the same technical effect (equivalent features). Equivalent features include, for example, features that are varied and achieve substantially the same result in substantially the same way. Equivalent features include, for example, features that perform substantially the same function in substantially the same way to achieve substantially the same result.

[0315] In this specification, features of the examples have been described with reference to various examples using adjectives or adjective phrases. Such description of a characteristic associated with an example indicates that the characteristic exists in some examples exactly as described, and in other examples substantially as described.

[0316] While efforts have been made in the foregoing description to draw attention to those features regarded as important, it should be understood that the applicant may seek protection by way of claims for any patentable feature or combination of features mentioned above and / or shown in the accompanying drawings whether or not emphasis has been placed thereon.

Claims

1. An apparatus comprising components for: joining the joining participant in the extended reality to at least an existing participant in the extended reality at the location in the virtual space to achieve a shared extended reality, wherein the joining participant and the existing participant in the shared extended reality are at least initially co-located in the virtual space and are capable of at least visually sharing the virtual space; wherein at least a portion of a content configuration is inherited by the joining participant from the existing participant, wherein the content configuration controls audio elements of the virtual space, visual elements of the virtual space, and interactions with the virtual space for the existing participant and the joining participant; wherein at least a portion of a join configuration is inherited between the existing participant and the joining participant, wherein the join configuration controls joining of one or more joining participants in the shared extended reality, Wherein in response to the existing participant having an open voice communication channel, the join configuration for the participant is adapted to require explicit authorization from the existing participant and one or more other users communicating in the voice communication channel to join the shared extended reality.

2. An apparatus according to claim 1, wherein the inheritance of the content configuration is hierarchical and has a direction from the existing participant to the joining participant joining the extended reality, and wherein the inheritance of the joining configuration is hierarchical and depends on one or more parameters of the joining configuration for the existing participant and one or more parameters of the joining configuration for the joining participant.

3. The apparatus of claim 1 , wherein the existing participant is dominant for the inheritance of the content configuration such that the joining participant at least initially has substantially the same content experience as the existing participant, wherein the joining participant inheritance controls at least one or more parameters of: what to hear in the extended reality, what to see in the extended reality, What interactions are possible with objects within the virtual space.

4. The apparatus according to claim 1, wherein for the inheritance of the joining configuration, the joining participant and / or the existing participant inherits at least one or more parameters controlling one or more of the following: Whether and / or from whom explicit consent to participate in XR was obtained, whether and / or to whom notification of the request to join XR is given, and Whether and / or to whom notification of joining participants joining the extended reality is given.

5. An apparatus according to claim 1, wherein for the inheritance of the joining configuration, there is inheritance equality, so that at least initially the existing participants and the joining participant share the same joining control, wherein the joining participant and / or at least one of the existing participants inherits at least one or more parameters that control joining, and the at least one or more parameters are more restrictive than the current parameters that control joining. 6 . The apparatus of claim 1 , wherein the joining of the joining participant is dependent on content of the extended reality experienced by the existing participant.

7. An apparatus according to claim 1, wherein the joining participant joins the existing participant in the extended reality in response to an acceptance of a joining request made by the joining participant, wherein the joining configuration of the existing participant determines whether the acceptance of the joining request made by the joining participant is automatic or dependent on confirmation by the existing participant.

8. An apparatus according to claim 1, wherein when a joining participant makes a request to join an existing participant in an extended reality at the location of the existing participant that is not accepted, a contention resolution process subsequently determines the location in the virtual space where the joining participant experiences the extended reality, and whether the joining participant experiences the extended reality shared with another participant.

9. The apparatus of claim 1 , wherein when a joining participant requests to join an existing participant in the extended reality at the location of the existing participant, a response to the request can be: allowing the joining participant to join the existing participant; denying said request for reasons determined by existing participants; denying the request depending on a reason for the shared extended reality rendered content; Requests to join at different locations; timeout; or Alternative join options.

10. The apparatus of claim 1, wherein after joining, the existing participant participates in the extended reality and is able to control a viewpoint within the virtual space; New participants join the extended reality and can control their viewpoint in the virtual space; The viewpoint associated with the existing participant and the viewpoint associated with the joining participant can be independently controlled by the respective existing participant and the respective joining participant.

11. The apparatus of claim 1, comprising means for providing a preview of the shared extended reality to the joining participant before the joining participant requests to join the shared extended reality, wherein the preview includes existing participants at the location.

12. The apparatus according to any of the preceding claims, wherein the content configuration controls at least visual and / or audio interaction between at least the joining participant and the existing participants of the shared extended reality.

13. A computer program product comprising a computer program which, when executed by a processor of an apparatus, causes the apparatus to: joining the joining participant in the extended reality to at least an existing participant in the extended reality at the location in the virtual space to achieve a shared extended reality, wherein the joining participant and the existing participant in the shared extended reality are at least initially co-located in the virtual space and are capable of at least visually sharing the virtual space; wherein at least a portion of a content configuration is inherited by the joining participant from the existing participant, wherein the content configuration controls audio elements of the virtual space, visual elements of the virtual space, and interactions with the virtual space for the existing participant and the joining participant; wherein at least a portion of a join configuration is inherited between the existing participant and the joining participant, wherein the join configuration controls joining of one or more joining participants in the shared extended reality, Wherein in response to the existing participant having an open voice communication channel, the join configuration for the participant is adapted to require explicit authorization from the existing participant and one or more other users communicating in the voice communication channel to join the shared extended reality.

14. A method comprising: initiating joining of a joining participant in the extended reality to at least an existing participant in the extended reality at the location in the virtual space to achieve a shared extended reality; causing a content configuration to be inherited by the joining participant from the existing participant, wherein the content configuration controls audio elements of the virtual space, visual elements of the virtual space, and interactions with the virtual space for the existing participant and the joining participant; causing inheritance of at least a portion of a join configuration between the existing participant and the joining participant, wherein the join configuration controls joining of one or more joining participants in the shared extended reality, and wherein in response to the existing participant having an open voice communication channel, the join configuration for the participant is adapted to require explicit authorization from the existing participant and one or more other users communicating in the voice communication channel to join the shared extended reality; Joining the joining participant in the extended reality to the at least existing participant in the extended reality is completed to achieve the shared extended reality, wherein the existing participant and the joining participant are initially at least co-located in the virtual space and can at least visually share the virtual space.

Images