Extended reality context texture on an outward facing display

Abstract

An extended reality, XR, rendering device including an XR application rendering an XR environment for viewing by a viewed user through an inward facing display of an XR head mounted display, HMD. The inward facing display arranged on the XR HMD facing 5 toward the viewed user when wearing the XR HMD. Operations acquire a texture that has been sampled from a scan of the viewed user's body and / or that has been generated for the viewed user by the XR application. Operations determine an XR application context that is indicative of the viewed user's interaction with the XR application rendering of at least a part of the XR environment. Operations modify the texture based on the XR application context, 0 and display the modified texture on an outward facing display worn by the viewed user for viewing by a viewing user.

Description

EXTENDED REALITY CONTEXT TEXTURE ON AN OUTWARD FACING DISPLAYTECHNICAL FIELD

[0001] The present disclosure relates to displaying extended reality (XR) context textures on an outward facing display based on a user’s experience with an XR environment.BACKGROUND

[0002] Recent disclosures of XR head mounted displays (HMDs) (e.g., Apple Vision Pro) indicate the use of an outward directed screen that provides an outside spectator with an avatar imagery of user’s “real” eyes that would otherwise be concealed due to the nontransparent design of the XR HMD.

[0003] Humans often want their unique body and clothing to be seen, but sometimes may not want to stand out. For example, expressing oneself by wearing certain brands and / or using certain types of smartphone. Additionally, one may tailor the device(s) they use by adding accessories like cases, etc., to represent who they are or who they want to be. Another related but digital example is adding “skins” or modify appearance of one’s avatars and / or game characters in an XR environment.SUMMARY

[0004] Some embodiments disclosed herein are directed to a method by an extended reality, XR, rendering device including an XR application rendering an XR environment for viewing by a viewed user through an inward facing display of an XR head mounted display, HMD, the inward facing display arranged on the XR HMD facing toward the viewed user when wearing the XR HMD. The method includes acquiring a texture that has been sampled from a scan of the viewed user's body and / or that has been generated for the viewed user by the XR application. The method further includes determining an XR application context that is indicative of the viewed user's interaction with the XR application rendering of at least a part of the XR environment. The method further includes modifying the texture based on the XR application context, and displaying the modified texture on an outward facing display worn by the viewed user for viewing by a viewing user.

[0005] Some other related embodiments are directed to an XR rendering device including an XR HMD that includes an inward facing display arranged on the XR HMDfacing toward a viewed user when wearing the XR HMD, at least one processor circuit, and at least one memory circuit storing an XR application executable by the at least one processor circuit to render an XR environment for viewing by the viewed user through the XR HMD and instructions executable by the at least one processor circuit to perform operations. The operations include to acquire a texture that has been sampled from a scan of the viewed user's body and / or that has been generated for the viewed user by the XR application. The operations determine an XR application context that is indicative of the viewed user's interaction with the XR application rendering of at least a part of the XR environment. The operations modify the texture based on the XR application context, and display the modified texture on an outward facing display worn by the viewed user for viewing by a viewing user.

[0006] Some other related embodiments are directed to a computer program product including a non-transitory computer readable medium storing instructions executable by at least one processing circuit of an XR rendering device including an XR application rendering an XR environment for viewing by a viewed user through an inward facing display of an XR HMD. The inward facing display is arranged on the XR HMD facing toward the viewed user when wearing the XR HMD. The instructions executable by the at least one processing circuit to perform operations. The operations include to acquire a texture that has been sampled from a scan of the viewed user's body and / or that has been generated for the viewed user by the XR application. The operations determine an XR application context that is indicative of the viewed user's interaction with the XR application rendering of at least a part of the XR environment. The operations modify the texture based on the XR application context, and display the modified texture on an outward facing display worn by the viewed user for viewing by a viewing user.

[0007] Potential advantages that may be provided by these and further embodiments disclosed herein include systems / devices for a XR HMD carrying user (viewed user) to disclose an in-application texture associated with the user (e.g., sweating, emotions, gaming context, etc.) towards external viewing user(s). The viewing user can thereby better understand the environment which the viewed user is within and other context of the user's interaction with that environment. Further advantages may include controlling when and / or what texture is displayed towards the viewing user depending on characteristics of the viewing user, such as age or identity. The displayed quality may be improved by considering the viewing user’s view-sight (direction, locality) to the viewed user, e.g., so that an as-if- was-in-game field of view (FOV) of the displayed texture may be accomplished.

[0008] Other methods and related XR systems and devices according to embodiments will be or become apparent to one with skill in the art upon review of the following drawings and detailed description. It is intended that all such additional methods and related XR systems and devices be included within this description and protected by the accompanying claims.BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Aspects of the present disclosure are illustrated by way of example and are not limited by the accompanying drawings. In the drawings:

[0010] Figure 1 illustrates a viewed user wearing an XR HMD and a smart-fabric shirt, where the XR HMD and smart-fabric shirt each include an outward facing display, in accordance with some embodiments of the present disclosure;

[0011] Figure 2 illustrates a top, bottom, rear, left side, and right side view of the XR HMD, in accordance with some embodiments of the present disclosure;

[0012] Figure 3A illustrates an example operation for determining a distance between the viewing user and the viewed user, in accordance with some embodiments of the present disclosure;

[0013] Figure 3B illustrates an example operation for determining an offset angle between the viewing user and an outward facing display of the XR HMD, in accordance with some embodiments of the present disclosure;

[0014] Figure 4 illustrates an XR system that includes an XR server and a XR HMD capable of performing operations separately or in combination with each other, in accordance with some embodiments of the present disclosure;

[0015] Figure 5 illustrates a flowchart of operations by an XR rendering device for displaying a modified texture on an outward facing display worn by a viewed user for viewing by a viewing user, in accordance with some embodiments of the present disclosure; and

[0016] Figure 6 illustrates another flowchart of operations by an XR rendering device for displaying a modified texture on an outward facing display worn by a viewed user for viewing by a viewing user, in accordance with some embodiments of the present disclosure.DETAILED DESCRIPTION

[0017] Inventive concepts will now be described more fully hereinafter with reference to the accompanying drawings, in which examples of embodiments of inventive concepts areshown. Inventive concepts may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of various present inventive concepts to those skilled in the art. It should also be noted that these embodiments are not mutually exclusive. Components from one embodiment may be tacitly assumed to be present / used in another embodiment.

[0018] Potential problems that can arise with prior approaches are explained. In a typical setup operation for an XR HMD (HMD), in an initializing step, a user scans their face attributes using a HMD’s outward directed camera(s), inward directed camera(s), or a combination thereof (e.g., to scan the facial region associated with eyes, eyebrows, eyelids, etc.). The scan may be used as a template for rendering the user’s avatar on a display of the HMD. In a later operation, while the user is wearing the HMD, the eye-tracking functionality of the HMD detects and determines user’s current eye gazing direction, status of eyelids, eyebrows, iris dilation, etc., and correspondingly renders the avatar on the outwards facing screen according to user’s current eye-state(s). Hence, if the user physically blinks with e.g., her left eye, the avatar will be rendered accordingly towards an external viewing user (spectator). This has been denoted by Apple as EyeSight functionality.

[0019] Furthermore, it is also described that with that functionality, the HMD may further detect the approaching external viewing user and in response to such detection start rendering through the HMD a graphical representation of the viewed user’s eyes on an external display of the HMD.

[0020] However, the viewing user (i.e., who is not wearing the HMD) cannot, from the disclosed appearance of viewed user’s “avatarish” eyes, understand what context the viewed user currently is engaged in within an in-HMD XR environment. This may result in the viewed user’s eyes looking synthetical (e.g., well behaved, nice, ideal, etc.) as always. The viewed user’s eyes may look the same as provided from the initial scanning procedure irrespective of what tasks or doings first user is engaged with in the digital domain.

[0021] Displaying synthetic eyes on outwards-facing screen(s) do not typically reveal any further details about the user’s current doings, and there may be a risk of uncanny disconnect in what is conveyed through the display. Additionally, the viewed user may feel awkward if there is an uncertainty related to how the viewing user may perceive the displayed appearance of the viewed user.

[0022] Individuals express who they are by the brand, look, and appearance of clothes, accessories, etc., that they wear. This may similarly apply when wearing an XR HMD. Inaccordance with some embodiments, a selected in-XR avatar application “skin” (i.e., a texture generated for the first user by the XR application) may be also (selectively) disclosed outwards through an outward facing display on the XR HMD. Additionally, no solutions are known to handle outwards disclosure texture with respect to age of an approaching person (e.g. kid vs. adult) in respect to disclosed content (kids-friendly / PG rated vs. explicit or possibly offensive textures). A HMD wearing viewed user may define, based upon a determined social relation between said first user and an approaching viewing user, an avatar eye-gazing (re-) directing policy for the viewed user’s device to apply in rendering the viewed user’s avatar towards the viewing user (e.g., the person in certain cultures or certain business relations should not meet a superior person's gaze, and / or not divert own gaze upwards but instead downwards in order to show appropriate resects, etc.).

[0023] Some embodiments of the present disclosure are directed to improving the above problems and to providing texture rendering on an outward facing display based on an XR application context. Further embodiments are directed to policies for when and at what level the texture is rendered.

[0024] Figure 1 illustrates a viewed user 100 who is wearing an extended reality (XR) head mounted display (HMD) 110 and a smart-fabric shirt 112, where the XR HMD 110 and smart-fabric shirt 112 each include an outward facing display 120a-b, in accordance with some embodiments of the present disclosure.

[0025] The viewed user 100 can be an individual who is wearing an XR HMD 110, smart-fabric clothing (e.g., smart-fabric shirt 112), or is transporting any other display device. The XR HMD 110 may include an augmented reality (AR), virtual reality (VR), and / or mixed reality device.

[0026] In some embodiments, the XR HMD 110 may be capable of one or more of the following: reverse-passthrough displaying of the viewed user’s eyes / eye-area towards a surrounding / nearby viewing user (i.e., individual who is within a XR HMD detectable distance from the viewed user wearing the XR HMD); running an XR application associated with a certain context in which the viewing user participates / interacts with; external sensors, such as LIDAR, cameras that may detect approaching / adjacent viewing user(s); facial recognition (either individually or in conjunction with an XR server) that may determine an identity of at least one detected viewing user; and social relation information determination (either individually or in conjunction with the XR server) where a social relation (i.e., a relationship) between the viewed user and at least one viewing user. The social relation information may be determined by the XR HMD 110, or in conjunction with the XR server,with the use of text messages, social platforms, media objects, etc. of the viewed user and / or viewing user (discussed in more detail below).

[0027] The XR HMD 110 may include an outward facing display 120a. The outward facing display 120a may be capable of displaying content for viewing by a viewing user. The outward facing display 120a may be on (e.g., incorporated into or attached to) the XR HMD 110 and is facing away from the viewed user when the viewed user is wearing the XR HMD 110.

[0028] Additionally, the XR HMD 110 may be communicatively coupled to an outward facing display 120b that is physically separate from the XR HMD 110. The outward facing display 120b may be attached to or incorporated in clothing and / or accessory worn by the viewed user. For example, the outward facing display 120b of Figure 1 is incorporated in a smart-fabric shirt 112 worn by the viewed user. The smart-fabric shirt 112 may include any item of clothing that has electronics incorporated into the fabric of the shirt that allows the shirt to display modified textures, etc.

[0029] The outward facing display 120b may be attached to or incorporated in other types of clothing such as pants, socks, hats, shoes, etc. Additionally, or alternatively, the outward facing display 120b may be attached to or incorporated in an accessory device capable of displaying content and being worn by the viewed user, for example, jewelry (e.g., a ring with an electronic display attached / incorporated to the necklace, a necklace with an electronic display attached / incorporated to the necklace), watches (e.g., smart watches capable of displaying content), mobile device (e.g., a cell phone attached to a band that allows the cell phone to be worn by the viewed user, a computer tablet attached to a band that allows the computer tablet to be worn by the viewed user), etc.

[0030] Figure 2 illustrates a top, bottom, rear, left-side, and right-side view of the XR HMD 110, in accordance with some embodiments of the present disclosure.

[0031] The XR HMD 110 includes camera(s) 130a-f operative to provide video stream(s) capturing observed objects in an environment, one of more microphone(s) operative to provide audio streams from audio sensed in the environment, inward facing display(s) 122a-b operative to display video stream(s) of an XR environment, speaker(s) 132a-b operative to play out audio stream(s), and processing circuitry. The processing circuitry is operative to process audio and video streams, user interface input (e.g., via touch interface selections, camera sensed and recognized hand gestures for commands, and / or microphone sensed voice commands), and to provide communication connectivity with an XR server.

[0032] In some embodiments, the camera(s) 130a-f of the XR HMD 110 can capture images for use by the XR HMD 110 to provide an XR experience for the viewed user wearing the XR HMD and / or capture images for use in detecting the presence, distance to, and offset angle of a viewing user. Additionally, the camera(s) may capture images for use in determining a viewing user’s age or identity.

[0033] Cameras 130e-f may be arranged to point downward while the viewed user is wearing the XR HMD 110 in order to capture images of the viewed user’s body below the viewed user’s head. Cameras 130a-d may be arranged to point outward away from the viewed user that is wearing the XR HMD 110 and may capture images of the physical environment around the viewed user, along with any viewing user(s) that may be in the physical environment around the viewed user.

[0034] In some embodiments, the camera(s) include one or more of LiDAR camera, RGB camera, black and white camera, or some other type of camera capable of detecting an environment around the XR HMD 110 and / or presence of viewing users around the XR HMD 110.

[0035] Figure 4 illustrates an XR system that includes an XR server 450 and the XR HMD 110 capable of performing operations separately or in combination with each other, in accordance with some embodiments of the present disclosure.

[0036] The XR HMD 110 may include the inward facing display (s) 122 (e.g., inward facing displays 122a-b of Figure 2), an outward facing display 120 (e.g., outward facing display 120 of Figure 2), speaker(s) 132 (e.g., speakers 132a-b of Figure 2), and eye tracking camera 440 operative to capture images of the viewed user’s eyes while the viewed user wears the XR HMD 110. However, in some embodiments, the outward facing display 120 may be communicatively coupled but physically separate from the XR HMD 110. For example, the outward facing display 120 (e.g., outward facing display 120b of Figure 1) may be integrated into clothing worn by the viewed user.

[0037] Additionally, the XR HMD 110 may include one or more sensor(s) 434 operative to detect presence of viewing users around the viewed user. The sensor(s) 434 may include a camera (e.g., one or more of cameras 130a-f of Figure 2), a motion detector (e.g., IR sensor, ultrasonic sensor, etc.), or another type of sensor capable of detecting an environment around the XR HMD 110 and / or presence of viewing users around the XR HMD 110.

[0038] In some embodiments, the sensor(s) 434 may further include devices capable of detecting a physiological condition of the viewed user. For example, the sensor(s) 434 may include a heart rate monitor, a breathing monitor, an accelerometer, etc. In someembodiments, the sensor(s) 434 are capable of detecting the physiological condition of the viewed user and may be physically attached to or incorporated into the XR HMD 110. In other embodiments, the sensor(s) 434 are capable of detecting the physiological condition of the viewed user and may be physically separate but communicatively coupled to the XR HMD 110.

[0039] Additionally, the XR HMD 110 includes at least one processing circuity 410 ("processor") and at least one memory circuitry 430 ("memory"). The memory stores an XR application and may store instructions executable by the processor 410 to perform operations in accordance with embodiments disclosed herein.

[0040] The XR HMD 110 may include a communication interface 422 operative to perform communications between the XR HMD 110 and a physically separate outward facing display 120 and / or communications between the XR HMD 110 and an XR server 450 through one or more wired or wireless communication networks 420.

[0041] The XR server 450 includes a network interface 424 operative to communicate with the XR HMD 110 via the networks 420, and at least one processing circuity 460 ("processor") and at least one memory circuitry 480 ("memory"). The memory 480 stores an XR application 482 and instructions executable by the processor to perform operations in accordance with embodiments disclosed herein.

[0042] It should be understood, herein, that the XR rendering device includes a combination of component devices that may be integrated within a single housing or may be physically separate but communicatively connected through one or more networks. For example, the XR rendering device may correspond to an XR HMD or XR server that performs all of the operations or may perform some of the operations with other operations being performed by a cloud computing server and / or by a smartphone, tablet computer, desktop computer, or other computing device that is communicatively connected to the XR HMD or XR server.

[0043] Figure 5 illustrates a flowchart of operations by an XR rendering device including an XR application rendering an XR environment for viewing by a viewed user through an inward facing display of an XR HMD the inward facing display arranged on the XR HMD facing toward the viewed user when wearing the XR HMD, in accordance with some embodiments of the present disclosure.

[0044] The method by the XR rendering device includes, in operation 500, acquiring a texture that has been sampled from a scan of the viewed user's body and / or that has been generated for the viewed user by the XR application. In some embodiments, the textureincludes a digital representation of at least a portion of the viewed user’s body that is covered by an outward facing display. For example, in Figure 1, the outward facing display 120a is physically attached to the XR HMD 110 and covers a part of the viewed user’s face. In this instance, the digital representation of the viewed user’s body may include the portion of the face that is covered by the outward facing display 120a including the viewed user’s eyes, eyebrows, part of a nose, and parts of the face surrounding these parts of the viewed user’s body. The texture may characterize features of the viewed user’s body, e.g., wrinkles, muscular shape, outward manifested expressions, etc. In another example, in Figure 1, the outward facing display 120b is physically separate but communicatively coupled to the XR HMD 110 and covers a part of the viewed user’s neck, chest, shoulders, and parts of the viewed user’s arms. In this instance, the digital representation of the viewed user’s body may include the viewed user’s neck, chest, shoulders, and the parts of the viewed user’s arms that are covered by the outward facing display 120b.

[0045] The scan of the viewed user’s body may include the viewed user using the camera(s) on the XR HMD 110 to take images of the viewed user’s body (e.g., the viewed user’s face) in order for the XR HMD 110 or XR server 450 to render a texture of the viewed user, which can be displayed on an outward facing display to present a digital representation of the covered (hidden) part of the viewed user’s body. The images used to render the texture may be captured by cameras that are physically separate from the XR HMD 110 such as a viewed user’s phone, digital camera, etc. The scan of the viewed user’s body may include a portion of the viewed user’s body that is covered by the outward facing display. The XR rendering device may acquire the texture that has been sampled from the scan of the viewed user’s body.

[0046] The images or other data that are sampled to acquire the texture may be stored on the XR HMD or on the XR server and made accessible to the XR rendering device.

[0047] Additionally, or alternatively, the XR application may generate a texture representing a portion of the viewed user. For example, when the viewed user is interacting with the XR application on the XR HMD, the XR application may generate a digital avatar based on a character in the XR application or based on the viewed user. The generated digital avatar may be based on a character or role that the viewed user is serving as in the XR application (e.g., game). Alternatively, the digital avatar may be based on a character generated by the XR application to represent a digital avatar of the viewed user in the XR application. The XR rendering device may acquire the texture, that is to be generated for the viewed user by the XR application, from the XR application and / or the XR server.

[0048] The images or other data that are used to acquire the texture may be stored on the memory of the XR HMD or the XR server and made accessible to the XR rendering device.

[0049] The method by the XR rendering device further includes, in operation 502, determining an XR application context that is indicative of the viewed user's interaction with the XR application rendering of at least a part of the XR environment. In some embodiments, the XR application context may include a current snapshot of ongoing activity of the viewed user with the XR application. The XR application context may be determined through ingame mirroring, where an output of the XR application (e.g., a type of environment) is determined. Alternatively, the XR application context may be determined by requesting a database in the XR rendering device, or physically separate from the XR rendering device, for one or more XR application contexts.

[0050] In some embodiments, the XR application context is determined based on output of the XR application that indicates at least one of: an achievement of the viewed user through interaction with the XR application, a feature of an avatar of the viewed user in the XR application, an indication of a type of XR environment the viewed user is interacting with through the XR application, an indication of an activity of the viewed user within the XR environment, an indication of a physiological condition of the viewed user which is sensed by at least one sensor and provided to the XR application, and an indication of a lighting characteristic experienced by the viewed user in the XR environment through the XR application.

[0051] In other embodiments, the XR application context is determined from a received response from a database that includes one or more XR application contexts, in response to a request for one or more XR application contexts, that indicates at least one of: an achievement of the viewed user through interaction with the XR application, a feature of an avatar of the viewed user in the XR application, an indication of a type of XR environment the viewed user is interacting with through the XR application, an indication of an activity of the viewed user within the XR environment, an indication of a physiological condition of the viewed user which is sensed by at least one sensor and provided to the XR application, and an indication of a lighting characteristic experienced by the viewed user in the XR environment through the XR application.

[0052] The achievement of the viewed user through interaction with the XR application may include a level, emblem, crown, etc., that indicates a feature in the game that is earned from interacting with the XR application. For example, after a viewed user wins a match inthe XR application, the determined XR application context may include a crown that indicates the viewed user’s match win in the XR application.

[0053] The feature of the avatar of the viewed user in the XR application may include an outfit or a physical feature of the avatar. For example, if the avatar in the XR application is wearing a superhero outfit, the XR application context may include at least a part of the superhero outfit.

[0054] The indication of a type of XR environment the viewed user is interacting with through the XR application may include an indication of an area that is surrounding the viewed user in the XR application. For example, if the viewed user is interacting with a jungle in the XR application, the XR application context may indicate a jungle. In another example, if the viewed user is interacting with a sports arena, the XR application context may include an indication of the arena, sports team, or type of sport that the viewed user is interacting with.

[0055] The indication of an activity of the viewed user within the XR environment may include the viewed user walking, running, jumping, flying, driving, etc. in the XR environment. In some embodiments, this may be irrespective of what the viewed user is doing in the physical environment. For example, the viewed user may be sitting or standing stationary in the physical environment but is running in the XR environment. In this example, the XR application context may include an indication that the viewed user is running within the XR environment. In other embodiments, the viewed user may be doing the same activity in the physical environment as that in the XR environment. For example, the viewed user is walking in the physical environment (e.g., a room in the viewed user’s house) and is walking in the XR environment in response to the viewed user walking in the physical environment. In this example, the XR application context may include an indication that the viewed user is walking in the XR environment.

[0056] The indication of the physiological condition of the viewed user which is sensed by at least one sensor and provided to the XR application may include a level of exertion, movement, heart rate, etc. For example, if a sensor (e.g., a heart rate monitor) senses that the viewed user is exercising, then the XR application context may include sweat and / or a red tint that indicates that the viewed user is exercising.

[0057] The indication of the lighting characteristic experienced by the viewed user in the XR environment through the XR application may include a light color scheme, light brightness, light color temperature, transparency, light reflections, etc. For example, if the viewed user is in an XR environment where there is bright white light to the right of theviewed user but it is darker light to the left of the viewed user, then the XR application context may include bright white light on the right side of the viewed user and darker light on the left side of the user.

[0058] The method by the XR rendering device further includes, in operation 504, modifying the texture based on the XR application context.

[0059] In some embodiments, this may include the XR rendering device taking the acquired texture from operation 500 and modifying the texture using the XR application context determined in operation 502. For example, in Figure 1, the viewed user 100 is wearing an XR HMD 110 that includes an outward facing display 120a that is covering (blocking from view) part of the viewed user’s face. In operation 500, the acquired texture may be a texture that has been sampled from a scan of the viewed user’s body. For example, the part of the viewed user’s face that is covered (blocked) by the outward facing display 120a may have been scanned and the XR rendering device may acquire the texture that has been sampled from said scan of the viewed user’s face. This acquired texture may include the part of the viewed user’s face that is covered (blocked) by the outward facing display 120a. Then, while the viewed user is interacting with an XR application rendering at least a part of the XR environment, a determination of an XR application context is performed. In Figure 1, the viewed user may be walking through a grass field on a sunny afternoon in the XR environment. In this example, the XR application context may be determined based on an output of the XR application that indicates a lighting characteristic (e.g., a green reflection of sunlight off the grass field) experienced by the viewed user in the XR environment through the XR application. The XR rending device may modify the texture from operation 500 with the XR application context of operation 502. In this example, this may result in the texture that includes part of the viewed user’s face being modified with a slight green glow on some or all of the texture.

[0060] The method by the XR rendering device further includes, in operation 506, displaying the modified texture on an outward facing display worn by the viewed user for viewing by a viewing user. In the above example, with reference to Figure 1, the displayed modified texture may include the part of the viewed user’s face that is blocked by the outward facing display 120a with a slight green glow.

[0061] This may provide the benefit of giving a viewing user, who is looking at the viewed user, some in-application context of what the viewed user is currently doing or where the viewed user is currently interacting with the XR application.

[0062] Figure 6 illustrates another flowchart of operations by an XR rendering device for displaying a modified texture on an outward facing display worn by a viewed user for viewing by a viewing user, in accordance with some embodiments of the present disclosure.

[0063] In operation 600, the XR rendering device may acquire a texture that has been sampled from a scan of the viewed user's body and / or that has been generated for the viewed user by the XR application. This operation may be performed in the same or similar manner as operation 500 of Figure 5.

[0064] In operation 602, the XR rendering device may detect a presence of a viewing user. The presence of the viewing user may be detected by the XR rendering device by a sensor (e.g., a camera or motion detector) that is attached to the XR HMD and / or by a sensor that is physically separate from, but communicatively coupled to, the XR HMD or XR server. In some embodiments, the presence of the viewing user may be detected by the XR HMD receiving wireless communications from a device (e.g., a cell phone, smartwatch, another XR HMD, etc.) that is worn or otherwise carried by the viewing user.

[0065] In operation 604, the XR rendering device may determine a distance between the viewing user and the viewed user and / or an offset angle between the viewing user and a front face of the XR HMD. Examples of operation 604 is described in more detail below with reference to Figures 3A-B.

[0066] Figure 3A illustrates an example of determining a distance (d) between the viewing user 300 and the viewed user 100, in accordance with some embodiments of the present disclosure. The distance (d) between the viewing user 300 and the viewed user 100 may be determined by the XR rendering device acquiring images that are captured from the XR HMD 110 (e.g., a camera attached to the XR HMD 110) and calculating a distance (d) from the XR HMD 110 to the viewing user 300. Alternatively, if the viewing user is carrying a device, a distance (d) between the viewing user 300 and the viewed user 100 may be determined by receiving signals that indicate a communication quality (e.g., signal strength) and calculating an estimated distance away the device is from the XR HMD 110.

[0067] Figure 3B illustrates an example of determining an offset angle (a) between the viewing user 300 and an outward facing display of the XR HMD 110, in accordance with some embodiments of the present disclosure. In this example, the outward facing display is located on a front face of the XR HMD 110. However, in some embodiments, the determination of the offset angle (a) is between the viewing user 300 and an outward facing display of the XR HMD where the outward facing display is located anywhere on the viewed user 100 (e.g., on the back and / or side of the head).

[0068] In the example of Figure 3B, the offset angle (a) may be determined by the XR rendering device acquiring images or other data that is captured from the XR HMD 110 (e.g., a camera attached to the XR HMD 110) that indicates a location a viewing user 300 is positioned, determining what direction the XR HMD 110 is facing, and calculating the offset angle (a) based on a difference between the direction the XR HMD 110 is facing and the location the viewing user 300 is positioned.

[0069] In some embodiments, where the outward facing display is not a front facing display on the XR HMD, the offset angle (a) may be determined by the XR rendering device acquiring images or other data that is captured from the XR HMD 110 (e.g., a camera attached to the XR HMD 110) that indicates a location a viewing user 300 is positioned, determining what direction the outward facing display is facing (i.e., the direction the outward facing display is pointing toward), and calculating the offset angle (a) based on a difference between the direction the XR HMD 110 is facing and the location the viewing user 300 is positioned.

[0070] The direction the outward facing display is facing may be determined by a camera attached to the XR HMD 110 or a predetermined relationship between the XR HMD 110 and the outward facing display. For example, if the outward facing display is attached to the back of the head of the viewing user 300, then the predetermined relationship between the XR HMD 110 may be defined as being opposite directions from each other. In this example, when the XR HMD 110 is facing at 0°, the outward facing display is facing at 180°.

[0071] In another example, when the outward facing display is on a front of a shirt worn by the viewing user 300, then the XR HMD 110 may capture images (e.g., via downward facing cameras 130e-f of Figure 2) of a direction the outward facing display is facing.

[0072] Referring back to Figure 6, in operation 606, the XR rendering device compares the determined distance between the viewing user and the viewed user and / or the determined offset angle between the viewing user and an outward facing display to a threshold. When comparing the threshold to the distance, the threshold is a distance threshold. When comparing the threshold to the offset angle, the threshold may be an offset threshold. If the distance and / or the offset angle is greater than the threshold, then the XR rendering device may return to operation 604.

[0073] However, in some embodiments, responsive to determining that the distance is within a distance threshold and / or the offset angle is within an offset threshold, the XR rendering device may initiate the display of the modified texture on the outward facing display and / or controlling a level of detail of the modified texture displayed on the outwardfacing display. For example, in Figure 3A, if the viewing user 300 is within a distance threshold of the viewing user 100, the XR rendering device may initiate the display of the modified texture on the outward facing display. This may provide the benefit of saving battery life of a battery that is powering the outward facing display and reducing computational load on the XR rendering device by initiating display and displaying the modified texture on the outward facing display only when the viewing user 300 is within a distance threshold that the viewing user 300 can understand what is being displayed. Additionally, or alternatively, if the viewing user 300 is within a distance threshold of the viewing user 100, the XR rendering device may control the level of detail of the modified texture displayed on the outward facing display. In this instance, XR rendering device may control a higher level of detail of the modified texture to be displayed on the outward facing display if a viewing user 300 is within the distance threshold, and vice versa.

[0074] Additionally, in some embodiments, the distance and / or the offset angle between the viewing user and the viewed user is constantly, or periodically, determined and compared to the threshold. In some of these embodiments, responsive to completing initiating of the display of the modified texture on the outward facing display and subsequently determining the distance has become greater than the distance threshold and / or the offset angle has become greater than the offset threshold, the XR rendering device ceases the displaying of the modified texture on the outward facing display and displays the texture without the modification on the outward facing display.

[0075] In other embodiments, as shown in Figure 6, if the distance and / or the offset angle is less than the threshold, then the XR rendering device may perform operation 608. In operation 608, the XR rendering device may compare a characteristic of the viewing user to an XR application context texture disclosure policy. In some embodiments, the modification of the texture is performed based on the comparison of the characteristic of the viewing user to the XR application disclosure policy.

[0076] In some additional, or alternative, embodiments, the determination of the XR application context is based on the comparison of the characteristic of the viewing user to the XR application disclosure policy. In these embodiments, the comparison may result in the XR rendering device identifies one or more options from which one or more XR application contexts should be determined from. For example, if the comparison results in only an option for an XR application context to include an indication of a type of XR environment the viewed user is interacting with, then only an XR application context may be determinedbased on output of the XR application that indicates the type of XR environment the viewed user is interacting with.

[0077] In some embodiments, the characteristic of the viewing user indicates an identity of the viewing user and / or an age of the viewing user. In these embodiments, the XR application disclosure policy defines whether the modification of the texture is to be performed and / or defines how the texture is to be modified based on the comparison of the characteristic of the viewing user to the XR application disclosure policy.

[0078] The XR rendering device may determine a characteristic of the one or more viewing users through facial recognition using images or other data captured by cameras of other sensors. For example, in instances where face recognition capability and features use Amazon Rekognition, an API towards Rekognition may be used where the tool returns a FaceDetail object for each face detected in a face detection operations that may be performed in conjunction with or in addition to the detection of presence of the one or more viewing users operation.

[0079] FaceDetail object may contain a bounding box and information about landmarks, quality, and pose for a detected face of a viewing user. The FaceDetail object may also return predictions for emotion, gender, age, face occlusion, eye gaze direction, and other attributes for each face if the parameter for attributes is set to ALL in the API request. Each attribute or emotion has a value and a confidence score. For example, a certain face might be predicted as having the gender ‘Female’ with a confidence score of 85% and the emotion ‘Happy’ with a confidence score of 90%. The FaceDetail object may among many other attributes also return estimated age for a detected face. That is carried in the attribute AgeRange, such as the estimated age range, in years, for the face. Estimated age ranges can overlap, for example, a face of a 5-year-old might have an estimated range of 4-6 while the face of a 6-year-old might have an estimated range of 4-8.

[0080] In some embodiments, the XR rendering device may establish an eye gaze direction of the viewing user toward the viewed user and initiate display of a modified texture based on establish the gaze direction of the viewing user toward the viewed user. For example, sensors on the XR HMD may capture images of a viewing user’s face and eyes. Based on the captured images, the XR rendering device may determine an eye gaze direction of the viewing user. Once the viewing user is determined to be looking at the viewed user (i.e., the eye gaze direction of the viewing user is in the direction of the viewed user), then the XR rendering device may initiate display of the modified texture.

[0081] Alternatively, the XR rendering device may determine a characteristic of the one or more viewing users by receiving communications from a device carried by the viewing user. For example, the XR rendering device may communicate with a device within a defined range of the XR HMD and determine an identity and age of the owner of the device. The device may use information associated with a logged into social media account and transmit the information or only the information that identifies the identity and / or age of the social media account holder.

[0082] The disclosure policy may define that certain modifications of the texture is to be performed if the viewing user is above / below a certain age or whether any modification of texture is to be performed at all if the viewing user is above / below a certain age. For example, if the viewing user is determined to be an age or within an age range that is below 18 years old, then the texture may not be modified by an XR application context that is determined to indicate that the avatar of the viewed user in the XR application is wounded. Instead, only the texture may be displayed on the outward facing display or only the avatar of the viewed user without the wounds may be used to modify the texture.

[0083] In some additional embodiments, the XR rendering device may determine a relationship between the viewed user and the viewing user based on the characteristic of the viewing user indicating the identity of the viewing user. For example, an identity of the viewing user may be used in conjunction with text messages, user inputted information, social media platforms, etc. to determine a relationship between the viewed user and the viewing user. In some embodiments, the relationship between the viewed user and the viewing user includes a familial, business, friendship, etc. relationship. For example, if a viewing user is a boss or colleague of the viewed user, certain modification of the texture may be performed while other modifications may not be performed. Similarly, if the viewing user is a child of the viewed user certain modifications of the texture may be performed based on this relationship.

[0084] This may be beneficial because some modified textures may not fit being disclosed outside certain social spheres (e.g., a mud-bath may be fine among close friends whereas considered slightly less appropriate in some business contexts).

[0085] However, there may be required tradeoff and / or policy matching-leveling in a situation where more than one viewing user is detected since the viewing users have different identities and may have different ages or relationships with the viewed user. For example, one viewing user may have a relationship with the viewed user as “best friend” and another viewing user may have a strict corporate relationship with the viewed user.

[0086] In some embodiments, the XR rendering device may detect presence of a plurality of viewing users, and compare a combination of characteristics of the plurality of viewing users to the XR application context disclosure policy. In these embodiments, the modification of the texture is performed based on a combination of characteristics of the viewing users to the XR application disclosure policy.

[0087] In some of these embodiments, the combination of characteristics of the plurality of viewing users may include an average age of the plurality of viewing users, a lowest age of the plurality of viewing users, a priority level of one or more of the plurality of viewing users, a percentage of identified to unidentified viewing users, number of trusted and / or untrusted viewing users, etc. For example, if two viewing users are detected and a first viewing user is determined to be 10 years old and a second viewing user is determined to be 12 years old, then the combination of the characteristics of the viewing users may be viewing users with an average age of 11 years old. In another example, if two viewing users are detected and a first viewing user is determined to be 22 years old and a second viewing user is determined to be 10 years old, then the lowest age of the plurality of viewing users is 10 years old. In yet another example, if two viewing users are detected and a first viewing user has a high priority level and a second viewing user has a low priority level the combination of the characteristics of the viewing users may be a medium priority (an average of the priority levels) or may be high priority (take the highest priority into account).

[0088] In operation 610, the XR rendering device may determine an XR application context that is indicative of the viewed user's interaction with the XR application rendering of at least a part of the XR environment. This may be performed in a similar manner as in operation 502 of Figure 5.

[0089] In operation 612, the XR rendering device may modify the texture based on the XR application context. This may be performed in a similar manner as in operation 504 of Figure 5. In operation 614, the XR rendering device may display the modified texture on an outward facing display worn by the viewed user for viewing by a viewing user. This may be performed in a similar manner as operation 506 of Figure 5.

[0090] After operation 614 is performed, the XR rendering device may return to operation 604 and go through some or all of operations 604 through 614. This may provide the benefit of continuously or periodically tracking a viewing user’s location (distance and offset angle) and displaying the same or different modified textures on the outward facing display. Alternatively, the XR rendering device may return to operation 602 and performoperations 602 through 614 to be able to factor in if additional or alternative viewing users have been detected.

[0091] In some embodiments, the XR rendering device may display the modified texture on other surfaces (e.g., tabletops, chairs, curtains, car windows, cabin panels, etc.) capable of visual texture rendering that are not worn by the viewed user.

[0092] In some embodiments, the XR rendering device outputs an audio stream that is indicative of the viewed user’s interaction with the XR application rendering of at least a part of the XR environment. For example, in Figure 4, the audio stream may be output through the speaker(s) 132 or speaker(s) that are physically separate from the XR HMD 110.

[0093] In another embodiment, the XR rendering device detects presence of the viewing user and determines an offset angle between the viewing user and an outward facing display. In these embodiments, the modification of the texture renders the texture to represent an offset view of part of the viewed user's body, where the offset view is determined based on the offset angle. This may result in the displaying of the modified texture giving the viewing user a visual indication that essentially places the viewing user’s field of view (FOV) in an in-application position and thus reveal related textures, light reflections, etc., from said inapplication position. In these embodiments, the distance of the viewing user to the viewed user may also be determined in order to determine a more accurate “in-application position” of the viewing user and to display a more accurate “in-application” FOV for the viewing user.

[0094] In another embodiment, the XR rendering device determines a location of the viewed user, compares the location of the viewed user to an XR application disclosure policy, and controls whether the modification of the texture is performed and / or controls how the texture is modified based on the comparison of the location of the viewing user to the XR application disclosure policy.

[0095] The XR rending device may determine the location of the viewed user through a GPS device in the XR HMD, cellular triangulation, image processing and comparisons to images of known locations stored in a memory (e.g., the memory of the XR server), or other processes of location detection / determination.

[0096] In some embodiments, the XR rendering device acquires a viewed user defined preference that indicates an XR application disclosure policy defining a precondition for performing the modification of the texture and / or defining how the texture is to be modified. For example, the viewed user may input a preference on what type of XR application context the viewed user would like to have modify the texture in certain circumstances (e.g., if a business-related viewing user is determined or if a younger sibling is determined). In anotherexample, the viewed user may input a level of modification (e.g., only partial modification or full modification) that the viewed user would like the XR application context to modify the texture. Additionally, the XR rendering device may control whether the modification of the texture is performed and / or controlling how the texture is modified based on the viewed user defined preference.

[0097] In another embodiment, the XR rendering device acquires digital rights information defining a precondition for performing the modification of the texture and / or defining how the texture is to be modified, and controls whether the modification of the texture is performed and / or controlling how the texture is modified based on the digital rights information. For example, certain XR application context may be allowed in certain areas (e.g., certain countries, at home, in public) but not allowed in others. In this example, if the viewed user is playing a superhero game and the XR application context is the superhero costume (or part thereof), the acquired digital rights information may define a precondition of the viewed user being located within North America in order for the modification of the texture to be performed. If the viewing user is in South America, the modification of the texture may be denied or simply not be performed based on said precondition.

[0098] In some embodiments, The XR rendering device acquires a battery state of the XR HMD worn by the viewed user, and control whether the modification of the texture is performed and / or controlling how the texture is modified based on the battery state. For example, the XR rendering device may request a battery state of the XR HMD worn by the viewed user and if the battery state is below a threshold the XR rendering device may control a level of detail or quality that the texture is modified by the XR application context. In another example, if the battery state is below a threshold the XR rendering device may prevent or otherwise not perform the modification of the texture. This may provide the benefit of reducing drain on the battery when the battery is low.

[0099] Additionally, or alternatively, in some embodiments, the XR rendering device acquires a current processing load of the XR HMD worn by the viewed user, and controls whether the modification of the texture is performed and / or controlling how the texture is modified based on the current processing load. For example, the XR rendering device may continuously or periodically check the current processing load of the XR HMD and if the processing load is above a threshold, then the XR rendering device may prevent or otherwise not perform the modification of the texture. Alternatively, if the current processing load is above a threshold, then the XR rending device may decrease the level that the texture is modified by the XR application context. This may provide the benefit of reducing processingload on the XR HMD and improving the experience quality of the viewed user interacting with the XR application.

[0100] In another embodiment, the XR rendering device predicts a subsequent XR application context that is indicative of a subsequent viewed user interaction with the XR application rendering of at least a part of the XR environment and / or is indicative of a prediction of a when the viewing user will look at the outward facing display. The XR rendering device may further modify the texture based on the subsequent XR application context, store the further modified texture in a memory buffer of candidate modified textures, and select among the candidate modified textures in the memory buffer responsive to determination of a new XR application context. These candidate modified textures may be stored in the memory buffer of the XR HMD or the XR server and provide for quick access to a predicted subsequent interaction or for quick access to a current interaction for displaying when a viewing user is predicted to look at the outward facing display.

[0101] For example, if the viewed user is interacting with an XR environment that has lightning occurring in the XR environment, then the XR rendering device may predict that a flash of lightning may occur in the future. The XR rendering device may further modify the texture based on the predicted lightning (e.g., further modify the texture to include an increase in white light brightness for a short period of time), store the further modified textured in the memory buffer of the XR HMD, and select the candidate modified texture in the memory buffer that includes the increased white light brightness modified texture responsive to lightning occurring in the XR environment that the viewed user is interacting with.

[0102] In another embodiment, the XR rendering device determines another XR application context that is indicative of the viewed user’s new interaction with the XR application, further modify the texture based on the another XR application context, and display the further modified texture on the outward facing display. For example, the XR rendering device may be displaying a first modified texture on an outward facing display. Then the viewed user may interact with the XR application in a new way and the XR rendering device may detect this and determine another XR application context that is indicative of the viewed user’s new interaction with the XR application. The XR application may further modify the acquired texture based on the another XR application context, and then display the further modified texture (i. e. , a second modified texture that is different than the first modified texture) on the outward facing display. This may provide the benefit of displaying an up-to-date interaction of the viewed user with the XR application.

[0103] Further Definitions and Embodiments:

[0104] In the above-description of various embodiments of present inventive concepts, it is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of present inventive concepts. Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which present inventive concepts belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of this specification and the relevant art and will not be interpreted in an idealized or overly formal sense expressly so defined herein.

[0105] When an element is referred to as being "connected", "coupled", "responsive", or variants thereof to another element, it can be directly connected, coupled, or responsive to the other element or intervening elements may be present. In contrast, when an element is referred to as being "directly connected", "directly coupled", "directly responsive", or variants thereof to another element, there are no intervening elements present. Like numbers refer to like elements throughout. Furthermore, "coupled", "connected", "responsive", or variants thereof as used herein may include wirelessly coupled, connected, or responsive. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Well-known functions or constructions may not be described in detail for brevity and / or clarity. The term "and / or" includes any and all combinations of one or more of the associated listed items.

[0106] It will be understood that although the terms first, second, third, etc. may be used herein to describe various elements / operations, these elements / operations should not be limited by these terms. These terms are only used to distinguish one element / operation from another element / operation. Thus, a first element / operation in some embodiments could be termed a second element / operation in other embodiments without departing from the teachings of present inventive concepts. The same reference numerals or the same reference designators denote the same or similar elements throughout the specification.

[0107] As used herein, the terms "comprise", "comprising", "comprises", "include", "including", "includes", "have", "has", "having", or variants thereof are open-ended, and include one or more stated features, integers, elements, steps, components or functions but does not preclude the presence or addition of one or more other features, integers, elements, steps, components, functions or groups thereof. Furthermore, as used herein, the common abbreviation "e.g.", which derives from the Latin phrase "exempli gratia," may be used tointroduce or specify a general example or examples of a previously mentioned item, and is not intended to be limiting of such item. The common abbreviation "i.e.", which derives from the Latin phrase "id est," may be used to specify a particular item from a more general recitation.

[0108] Example embodiments are described herein with reference to block diagrams and / or flowchart illustrations of computer-implemented methods, apparatus (systems and / or devices) and / or computer program products. It is understood that a block of the block diagrams and / or flowchart illustrations, and combinations of blocks in the block diagrams and / or flowchart illustrations, can be implemented by computer program instructions that are performed by one or more computer circuits. These computer program instructions may be provided to a processor circuit of a general purpose computer circuit, special purpose computer circuit, and / or other programmable data processing circuit to produce a machine, such that the instructions, which execute via the processor of the computer and / or other programmable data processing apparatus, transform and control transistors, values stored in memory locations, and other hardware components within such circuitry to implement the functions / acts specified in the block diagrams and / or flowchart block or blocks, and thereby create means (functionality) and / or structure for implementing the functions / acts specified in the block diagrams and / or flowchart block(s).

[0109] These computer program instructions may also be stored in a tangible computer- readable medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instructions which implement the functions / acts specified in the block diagrams and / or flowchart block or blocks. Accordingly, embodiments of present inventive concepts may be embodied in hardware and / or in software (including firmware, resident software, micro-code, etc.) that runs on a processor such as a digital signal processor, which may collectively be referred to as "circuitry," "a module" or variants thereof.

[0110] It should also be noted that in some alternate implementations, the functions / acts noted in the blocks may occur out of the order noted in the flowcharts. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality / acts involved. Moreover, the functionality of a given block of the flowcharts and / or block diagrams may be separated into multiple blocks and / or the functionality of two or more blocks of the flowcharts and / or block diagrams may be at least partially integrated. Finally,other blocks may be added / inserted between the blocks that are illustrated, and / or blocks / operations may be omitted without departing from the scope of inventive concepts. Moreover, although some of the diagrams include arrows on communication paths to show a primary direction of communication, it is to be understood that communication may occur in the opposite direction to the depicted arrows.

[0111] Many variations and modifications can be made to the embodiments without substantially departing from the principles of the present inventive concepts. All such variations and modifications are intended to be included herein within the scope of present inventive concepts. Accordingly, the above disclosed subject matter is to be considered illustrative, and not restrictive, and the appended examples of embodiments are intended to cover all such modifications, enhancements, and other embodiments, which fall within the spirit and scope of present inventive concepts. Thus, to the maximum extent allowed by law, the scope of present inventive concepts are to be determined by the broadest permissible interpretation of the present disclosure including the following examples of embodiments and their equivalents, and shall not be restricted or limited by the foregoing detailed description.

Claims

CLAIMS:

1. A method by an extended reality, XR, rendering device including an XR application rendering an XR environment for viewing by a viewed user through an inward facing display of an XR head mounted display, HMD, the inward facing display arranged on the XR HMD facing toward the viewed user when wearing the XR HMD, the method comprising: acquiring (500) a texture that has been sampled from a scan of the viewed user's body and / or that has been generated for the viewed user by the XR application; determining (502) an XR application context that is indicative of the viewed user's interaction with the XR application rendering of at least a part of the XR environment; modifying (504) the texture based on the XR application context; and displaying (506) the modified texture on an outward facing display worn by the viewed user for viewing by a viewing user.

2. The method of Claim 1, wherein: the outward facing display is on the XR HMD facing away from the viewed user when wearing the XR HMD.

3. The method of Claim 1, wherein the outward facing display is attached to or incorporated in clothing and / or accessory worn by the viewed user.

4. The method of any of Claims 1 to 3, wherein the XR application context is determined based on output of the XR application that indicates at least one of: an achievement of the viewed user through interaction with the XR application, a feature of an avatar of the viewed user in the XR application, an indication of a type of XR environment the viewed user is interacting with through the XR application, an indication of an activity of the viewed user within the XR environment, an indication of a physiological condition of the viewed user which is sensed by at least one sensor and provided to the XR application, and an indication of a lighting characteristic experienced by the viewed user in the XR environment through the XR application.

5. The method of any of Claims 1 to 4, further comprising: detecting presence of the viewing user;determining a distance between the viewing user and the viewed user and / or an offset angle between the viewing user and a front face of the XR HMD; and responsive to determining that the distance is within a distance threshold and / or the offset angle is within an offset threshold, initiating the display of the modified texture on the outward facing display and / or controlling a level of detail of the modified texture displayed on the outward facing display.

6. The method of Claim 5, further comprising: responsive to completing initiating of the display of the modified texture on the outward facing display and subsequently determining the distance has become greater than the distance threshold and / or the offset angle has become greater than the offset threshold, ceasing the displaying of the modified texture on the outward facing display and displaying of the texture without the modification on the outward facing display.

7. The method of any of Claims 1 to 6, further comprising: detecting presence of the viewing user; and comparing a characteristic of the viewing user to an XR application context texture disclosure policy, wherein the modification of the texture is performed based on the comparison of the characteristic of the viewing user to the XR application disclosure policy.

8. The method of Claim 7, further comprising: detecting presence of a plurality of viewing users; and comparing a combination of characteristics of the plurality of viewing users to the XR application context disclosure policy, wherein the modification of the texture is performed based on the combination of the characteristics of the viewing users to the XR application disclosure policy.

9. The method of Claim 7, wherein the characteristic of the viewing user indicates an identity of the viewing user and / or an age of the viewing user, and wherein the XR application disclosure policy defines whether the modification of the texture is to be performed and / or defines how the texture is to be modified based on the comparison of the characteristic of the viewing user to the XR application disclosure policy.

10. The method of Claim 9, further comprising: determining a relationship between the viewed user and the viewing user based on the characteristic of the viewing user indicating the identity of the viewing user.

11. The method of any of Claims 1 to 10, further comprising: detecting presence of the viewing user; and determining an offset angle between the viewing user and the outward facing display, wherein the modification of the texture renders the texture to represent an offset view of part of the viewed user's body, wherein the offset view is determined based on the offset angle.

12. The method of any of Claims 1 to 11, further comprising: determining a location of the viewed user; comparing the location of the viewed user to an XR application disclosure policy; and controlling whether the modification of the texture is performed and / or controlling how the texture is modified based on the comparison of the location of the viewing user to the XR application disclosure policy.

13. The method of any of Claims 1 to 12, further comprising: acquiring a viewed user defined preference that indicates an XR application disclosure policy defining a precondition for performing the modification of the texture and / or defining how the texture is to be modified; and controlling whether the modification of the texture is performed and / or controlling how the texture is modified based on the viewed user defined preference.

14. The method of any of Claims 1 to 13, further comprising: acquiring digital rights information defining a precondition for performing the modification of the texture and / or defining how the texture is to be modified; and controlling whether the modification of the texture is performed and / or controlling how the texture is modified based on the digital rights information.

15. The method of any of Claims 1 to 14, further comprising: acquiring a battery state of the XR HMD worn by the viewed user; andcontrolling whether the modification of the texture is performed and / or controlling how the texture is modified based on the battery state.

16. The method of any of Claims 1 to 15, further comprising: acquiring a current processing load of the XR HMD worn by the viewed user; and controlling whether the modification of the texture is performed and / or controlling how the texture is modified based on the current processing load.

17. The method of any of Claims 1 to 16, further comprising: predicting a subsequent XR application context that is indicative of a subsequent viewed user interaction with the XR application rendering of at least a part of the XR environment and / or is indicative of a prediction of when the viewing user will look at the outward facing display; further modifying the texture based on the subsequent XR application context; storing the further modified texture in a memory buffer of candidate modified textures; and selecting among the candidate modified textures in the memory buffer responsive to determination of a new XR application context.

18. The method of any of Claims 1 to 17, further comprising: determining another XR application context that is indicative of the viewed user’s new interaction with the XR application; further modifying the texture based on the another XR application context; and displaying the further modified texture on the outward facing display.

19. An extended reality, XR, rendering device (110, 450) comprising: an XR head mounted display, HMD, (110) including an inward facing display (122) arranged on the XR HMD (110) facing toward a viewed user when wearing the XR HMD (110); at least one processor circuit (410, 460); and at least one memory circuit (430, 480) storing an XR application executable by the at least one processor circuit (410, 460) to render an XR environment for viewing by the viewed user through the XR HMD (110) and instructions executable by the at least one processor circuit (410, 460) to perform operations to:acquire a texture that has been sampled from a scan of the viewed user's body and / or that has been generated for the viewed user by the XR application; determine an XR application context that is indicative of the viewed user's interaction with the XR application rendering of at least a part of the XR environment; modify the texture based on the XR application context; and display the modified texture on an outward facing display worn by the viewed user for viewing by a viewing user.

20. A computer program product comprising a non-transitory computer readable medium (430, 480) storing instructions executable by at least one processing circuit (410, 460) of an extended reality, XR, rendering device (110, 450) including an XR application rendering an XR environment for viewing by a viewed user through an inward facing display of an XR head mounted display, HMD, the inward facing display arranged on the XR HMD facing toward the viewed user when wearing the XR HMD, the instructions executable by the at least one processing circuit (410, 460) to perform operations to: acquire a texture that has been sampled from a scan of the viewed user's body and / or that has been generated for the viewed user by the XR application; determine an XR application context that is indicative of the viewed user's interaction with the XR application rendering of at least a part of the XR environment; modify the texture based on the XR application context; and display the modified texture on an outward facing display worn by the viewed user for viewing by a viewing user.

Images