Biomarker-based extended reality discomfort mitigation

Abstract

Some disclosed methods involve obtaining extended reality (XR) discomfort indication data and classifying a user as having either a cumulative effects XR discomfort profile or a refractory XR discomfort profile. The cumulative effects XR discomfort profile may correspond with increased XR discomfort during successive instances of XR content consumption, increased XR discomfort during time intervals between successive instances of XR content consumption, or both. The refractory XR discomfort profile may correspond with reduced XR discomfort during time intervals between successive instances of XR content consumption and with reduced XR discomfort during at least some successive instances of XR content consumption. Some methods may involve outputting, by the control system, a XR discomfort profile classification, implementing, based at least in part on a user classification, one or more discomfort mitigation procedures associated with an XR presentation, or both.

Description

BIOMARKER-BASED EXTENDED REALITY DISCOMFORT MITIGATION CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims the benefit of priority from EP Application No. 24192153.5, filed on 31 July 2024, which in turn, claims priority to U.S. Provisional Application Ser. No.63 / 657,034, filed on 6 June 2024, all of which are incorporated by reference in their entirety. TECHNICAL FIELD

[0002] This disclosure pertains generally to devices, systems and methods for extended reality presentations and more particularly to estimating and mitigating the discomfort of people experiencing extended reality presentations. BACKGROUND

[0003] Extended reality (XR) is a term that refers broadly to virtual reality (VR), augmented reality (AR) and mixed reality (MR). Cybersickness (e.g., headache, visual fatigue, nausea) and general discomfort pose significant challenges to widespread adoption of XR, including but not limited to the adoption of XR and MR glasses, and VR headsets. Some methods, devices and systems for XR comfort mitigation are known. Although existing devices, systems and methods can provide benefits in some contexts, improved devices, systems and methods would be desirable. SUMMARY

[0004] At least some aspects of the present disclosure may be implemented via one or more methods. In some instances, the method(s) may be implemented, at least in part, by a control system and / or via instructions (e.g., software) stored on one or more non-transitory media. Some disclosed methods involve obtaining, by a control system, extended reality (XR) discomfort indication data and classifying, by the control system, at least one user as having either a cumulative effects XR discomfort profile or a refractory XR discomfort profile. In some examples, the cumulative effects XR discomfort profile may correspond with increased XR discomfort during successive instances of XR contentconsumption, increased XR discomfort during time intervals between successive instances of XR content consumption, or both. According to some examples, the refractory XR discomfort profile may correspond with reduced XR discomfort during time intervals between successive instances of XR content consumption and with reduced XR discomfort during at least some successive instances of XR content consumption.

[0005] Some disclosed methods involve outputting, by the control system, a XR discomfort profile classification for the at least one user. According to some examples, outputting the XR discomfort profile classification may involve storing the XR discomfort profile classification, transmitting the XR discomfort profile classification to a device that is configured to provide a XR experience, providing the XR discomfort profile classification for further processing, or combinations thereof.

[0006] In some examples, obtaining the XR discomfort indication data may involve retrieving previously-obtained XR discomfort indication data from a memory. According to some examples, obtaining the XR discomfort indication data may involve obtaining galvanic skin response (GSR) data. In some examples, the classifying may involve determining whether the GSR data indicates that a maximum GSR value or an average GSR value increases during successive instances of XR content consumption. According to some examples, the classifying may involve determining whether the GSR data indicates that an average GSR value increases or decreases during time intervals between successive instances of XR content consumption. In some examples, the average GSR value may be an average during a time window in a range of 2 seconds to 2 minutes.

[0007] According to some examples, at least some of the GSR data may be obtained prior to XR content consumption. In some such examples, the classifying may involve determining whether the GSR data indicates that an average GSR value increases or decreases prior to XR content consumption.

[0008] In some examples, obtaining the XR discomfort indication data may involve obtaining blood pressure data, heart rate (HR) data, including but not limited to HR variability data, pupil dilation data, gaze data, posture data, pose data, movement data, facial expression data, or combinations thereof. According to some examples, obtaining the XR discomfort indication data may involveobtaining user feedback, including but not limited to verbal feedback, user demographic information, content metadata, or combinations thereof. In some examples, the XR discomfort indication data may be obtained after user notification, without user notification, during a XR device setup process, during a XR application setup process, prior to XR content consumption, during XR content consumption, responsive to an indication that a XR-capable device is being put on, or combinations thereof.

[0009] Some disclosed methods may involve implementing one or more discomfort mitigation procedures associated with an XR presentation. In some examples, the one or more discomfort mitigation procedures may be based, at least in part, on whether a user has been classified as having a cumulative effects XR discomfort profile or a refractory XR discomfort profile.

[0010] In some examples wherein a user has been classified as having a refractory XR discomfort profile, the one or more discomfort mitigation procedures may include reducing a field of view (FOV) of the XR presentation. According to some examples, the one or more discomfort mitigation procedures may include reducing a maximum movement angle of the XR presentation, reducing a maximum movement angular velocity of the XR presentation, reducing a maximum acceleration of the XR presentation, reducing a display quality during the XR presentation, or combinations thereof.

[0011] According to some examples wherein a user has been classified as having a cumulative effects XR discomfort profile, the one or more discomfort mitigation procedures may include pausing the XR presentation, presenting a stationary view of the XR presentation regardless of a user’s head or body motion, or a combination thereof.

[0012] In some examples, the one or more discomfort mitigation procedures may include subsequently presenting a version of the XR presentation that includes reduced movement angles, subsequently presenting a version of the XR presentation that includes reduced movement angular velocities, subsequently presenting a version of the XR presentation that includes reduced accelerations, subsequently presenting a version of the XR presentation that includes reduced display quality, or combinations thereof. According to some examples, the subsequently presenting may involve selecting and providing an alternate presentation different than the XR presentation. Some disclosed methods mayinvolve modifying an existing version of the XR presentation. In some such examples, the subsequently presenting may involve providing a modified version of the XR presentation.

[0013] Some disclosed methods may involve identifying one or more XR presentation time intervals that will be redesigned, presented differently, or both. According to some examples, the one or more XR presentation time intervals may be identified according to XR discomfort indication data obtained from multiple users classified as having refractory XR discomfort profiles. In some examples, the one or more XR presentation time intervals may be redesigned for users classified as having cumulative effects XR discomfort profiles, presented differently to users classified as having cumulative effects XR discomfort profiles, or both.

[0014] Some disclosed methods may involve obtaining, by a control system, extended reality (XR) discomfort indication data and making, by the control system, a user classification of at least one user as having either a cumulative effects XR discomfort profile or a refractory XR discomfort profile. According to some examples, the cumulative effects XR discomfort profile may correspond with increased XR discomfort during successive instances of XR content consumption, increased XR discomfort during time intervals between successive instances of XR content consumption, or both. In some examples, the refractory XR discomfort profile may correspond with reduced XR discomfort during time intervals between successive instances of XR content consumption and with reduced XR discomfort during at least some successive instances of XR content consumption.

[0015] Some disclosed methods may involve implementing, based at least in part on the user classification, one or more discomfort mitigation procedures associated with an XR presentation. According to some examples wherein a user has been classified as having a refractory XR discomfort profile, the one or more discomfort mitigation procedures may include reducing a field of view (FOV) of the XR presentation. Alternatively, or additionally, the one or more discomfort mitigation procedures may include reducing a maximum movement angle of the XR presentation, reducing a maximum movement angular velocity of the XR presentation, reducing a maximum acceleration of the XR presentation, reducing a display quality during the XR presentation, or combinations thereof. In someexamples wherein a user has been classified as having a cumulative effects XR discomfort profile, the one or more discomfort mitigation procedures may include pausing the XR presentation, presenting a stationary view of the XR presentation regardless of a user’s head or body motion, or a combination thereof.

[0016] According to some examples, the one or more discomfort mitigation procedures may include subsequently presenting a version of the XR presentation that includes reduced movement angles, subsequently presenting a version of the XR presentation that includes reduced movement angular velocities, subsequently presenting a version of the XR presentation that includes reduced accelerations, subsequently presenting a version of the XR presentation that includes reduced display quality, or combinations thereof. In some examples, the subsequently presenting may involve selecting and providing an alternate presentation different than the XR presentation.

[0017] Some examples may involve modifying an existing version of the XR presentation. In some such examples, the subsequently presenting may involve providing a modified version of the XR presentation.

[0018] Some or all of the operations, functions and / or methods described herein may be performed by one or more devices according to instructions (e.g., software) stored on one or more non-transitory media. Such non-transitory media may include memory devices such as those described herein, including but not limited to random access memory (RAM) devices, read-only memory (ROM) devices, etc. Accordingly, some innovative aspects of the subject matter described in this disclosure can be implemented via one or more non-transitory media having software stored thereon.

[0019] At least some aspects of the present disclosure may be implemented via apparatus. For example, one or more devices (e.g., a system that includes one or more devices) may be capable of performing, at least in part, the methods disclosed herein. In some implementations, an apparatus is, or includes, an audio processing system having an interface system and a control system. The control system may include one or more general purpose single- or multi-chip processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or other programmable logic devices, discrete gates or transistor logic, discrete hardwarecomponents, or combinations thereof. The control system may be configured for implementing some or all of the methods disclosed herein.

[0020] Details of one or more implementations of the subject matter described in this specification are set forth in the accompanying drawings and the description below. Other features, aspects, and advantages will become apparent from the description, the drawings, and the claims. Note that the relative dimensions of the following figures may not be drawn to scale. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Like reference numbers and designations in the various drawings indicate like elements.

[0022] Figure 1 is a block diagram that shows examples of components of an apparatus capable of implementing various aspects of this disclosure.

[0023] Figures 2A and 2B are graphs that show galvanic skin responses (GSRs) of two different people during successive instances of XR content consumption.

[0024] Figures 2C and 2D show maximum GSR values for four different people and for six different people, respectively, during three successive instances of XR content consumption.

[0025] Figures 3A and 3B show maximum GSR values for four different people and for six different people, respectively, during three successive instances of XR content consumption.

[0026] Figure 4 is a flow diagram that outlines one example of a disclosed method.

[0027] Figures 5A and 5B are graphs that show additional examples of GSRs during successive instances of XR content consumption.

[0028] Figures 5C shows examples of responses to salient events in XR content by multiple individuals having cumulative effects XR discomfort profiles.

[0029] Figures 5D shows examples of responses to salient events in XR content by multiple individuals having refractory XR discomfort profiles.

[0030] Figure 6 is a flow diagram that outlines one example of a disclosed method.

[0031] Figure 7 is a flow diagram that outlines another example of a disclosed method.DETAILED DESCRIPTION OF EMBODIMENTS

[0032] As noted above, many people experience at least some level of discomfort, such as nausea, headache, visual fatigue, etc., when experiencing an XR presentation. The process of a person experiencing an XR presentation may also be referred to herein as “XR content consumption.” Methods for ameliorating the discomfort caused by XR content consumption may be referred to herein as “XR discomfort mitigation procedures,” as “discomfort mitigation procedures associated with an XR presentation” or simply as “discomfort mitigation procedures.”

[0033] Previously-implemented approaches to XR comfort mitigation do not take into account variations in how people may react to XR content consumption. Because previous methods, devices and systems for XR comfort mitigation lack personalized, data-based implementation rules, such previously-implemented approaches may cause unnecessary reductions in XR immersion levels or may provide insufficient levels of XR comfort mitigation.

[0034] Various disclosed examples overcome at least some of the limitations of previously-implemented approaches to XR comfort mitigation. Some disclosed methods involve obtaining extended reality (XR) discomfort indication data and classifying a user as having either a “cumulative effects” XR discomfort profile or a “refractory” XR discomfort profile. In some examples, the XR discomfort indication data may be, or may include, skin conductance data, which is also referred to herein as galvanic skin response (GSR) data. Alternatively or additionally, according to some examples the XR discomfort indication data may be, or may include, heart rate (HR) data, including but not limited to HR data indicating decreased HR variability, eye-related data, including but not limited to variations in pupil size, posture data, user movement data, facial expression data, sounds produced by a user, including but not limited to verbal reports of user experiences, or combinations thereof. As used herein, the term “XR discomfort profile” refers generally to one or more aspects of the XR discomfort indication data, such as one or more patterns in the XR discomfort indication data. Some examples are provided herein.

[0035] The cumulative effects XR discomfort profile may correspond with increased XR discomfort during successive instances of XR content consumption, increased XR discomfort during time intervals between successiveinstances of XR content consumption, or both. The refractory XR discomfort profile may correspond with reduced XR discomfort during time intervals between successive instances of XR content consumption and with reduced XR discomfort during at least some successive instances of XR content consumption.

[0036] As used herein, the term “successive instances of XR content consumption” refers generally to successive time intervals during which a person is experiencing XR presentations. For example, if a person experiences a first VR presentation of wingsuit base jumping that lasts for a first VR presentation time interval—such as a few seconds or a few minutes—and after a pause time interval—such as a few seconds or a few minutes—then the person experiences a second VR presentation of wingsuit base jumping that lasts for a second VR presentation time interval, the first VR presentation time interval and the second VR presentation time interval are examples of “successive instances of XR content consumption.” The pause time interval is an example of a “time interval between successive instances of XR content consumption.” In some examples, one or more successive instances of XR content consumption may involve different types of presentations. For example, a first XR presentation and a second XR presentation may involve sky diving and a third XR presentation may involve bungee jumping. Additional examples are provided herein.

[0037] Some disclosed methods may involve outputting, by the control system, a XR discomfort profile classification. Outputting the XR discomfort profile classification may involve storing the XR discomfort profile classification, transmitting the XR discomfort profile classification to a device that is configured to provide a XR experience, providing the XR discomfort profile classification for further processing, or combinations thereof. Some disclosed methods may involve implementing, based at least in part on a user classification, one or more discomfort mitigation procedures associated with an XR presentation, or both.

[0038] Figure 1 is a block diagram that shows examples of components of an apparatus capable of implementing various aspects of this disclosure. As with other figures provided herein, the types, numbers and arrangements of elements shown in Figure 1 are merely provided by way of example. Other implementations may include more, fewer and / or different types, numbers and arrangements of elements. According to some examples, the apparatus 100 may be configured for performing at least some of the methods disclosed herein. Insome implementations, the apparatus 100 may be, or may include, one or more components of a workstation, one or more components of a home entertainment system, etc. For example, the apparatus 100 may be a laptop computer, a tablet device, a mobile device (such as a cellular telephone), an XR wearable, such as a VR headset, an automotive subsystem (e.g., an infotainment system, a driver assistance or safety system, etc.), a game system or console, a smart home hub, a television or another type of device.

[0039] According to some alternative implementations the apparatus 100 may be, or may include, a server. In some such examples, the apparatus 100 may be, or may include, an encoder. In some examples, the apparatus 100 may be, or may include, a decoder. Accordingly, in some instances the apparatus 100 may be a device that is configured for use within an environment, such as a home environment, whereas in other instances the apparatus 100 may be a device that is configured for use in “the cloud,” e.g., a server.

[0040] In this example, the apparatus 100 includes an interface system 105 and a control system 110. The interface system 105 may, in some implementations, be configured for communication with one or more other devices of an environment. The environment may, in some examples, be a home environment. In other examples, the environment may be another type of environment, such as an office environment, an automobile environment, a train environment, a street or sidewalk environment, a park environment, an entertainment environment (e.g., a theatre, a performance venue, a theme park, a VR experience room, an e-games arena), etc. The interface system 105 may, in some implementations, be configured for exchanging control information and associated data with other devices of the environment. The control information and associated data may, in some examples, pertain to one or more software applications that the apparatus 100 is executing.

[0041] The interface system 105 may, in some implementations, be configured for receiving, or for providing, a content stream. In some examples, the content stream may include video data and audio data corresponding to the video data. The audio data may include, but may not be limited to, audio signals. In some instances, the audio data may include spatial data, such as channel data and / or spatial metadata. Metadata may, for example, have been provided by what maybe referred to herein as an “encoder.” According to some examples, the content stream may correspond to an XR presentation, such as a VR presentation.

[0042] The interface system 105 may include one or more network interfaces and / or one or more external device interfaces (such as one or more universal serial bus (USB) interfaces). According to some implementations, the interface system 105 may include one or more wireless interfaces. The interface system 105 may include one or more devices for implementing a user interface, such as one or more microphones, one or more speakers, a display system, a touch sensor system, a gesture sensor system, or combinations thereof. Accordingly, while some such devices are represented separately in Figure 1, such devices may, in some examples, correspond with aspects of the interface system 105.

[0043] In some examples, the interface system 105 may include one or more interfaces between the control system 110 and a memory system, such as the optional memory system 115 shown in Figure 1. Alternatively, or additionally, the control system 110 may include a memory system in some instances. The interface system 105 may, in some implementations, be configured for receiving input from one or more microphones in an environment.

[0044] The control system 110 may, for example, include a general purpose single- or multi-chip processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or combinations thereof.

[0045] In some implementations, the control system 110 may reside in more than one device. For example, in some implementations a portion of the control system 110 may reside in a device within one of the environments referred to herein and another portion of the control system 110 may reside in a device that is outside the environment, such as a server, a game console, a mobile device (such as a smartphone or a tablet computer), etc. In other examples, a portion of the control system 110 may reside in a device within one of the environments depicted herein and another portion of the control system 110 may reside in one or more other devices of the environment. For example, control system functionality may be shared by an orchestrating device (such as what may be referred to herein as a smart home hub) and one or more other devices of the environment. In other examples, a portion of the control system 110 may residein a device that is implementing a cloud-based service, such as a server, and another portion of the control system 110 may reside in another device that is implementing the cloud-based service, such as another server, a memory device, etc. The interface system 105 also may, in some examples, reside in more than one device.

[0046] In some implementations, the control system 110 may be configured to perform, at least in part, the methods disclosed herein. According to some examples, the control system 110 may be configured to obtain extended reality (XR) discomfort indication data. In some examples, the control system 110 may be configured to obtain extended reality (XR) discomfort indication data from one or more sensors of the optional sensor system 130, from the optional microphone system 120, or from both. According to some examples, the control system 110 may be configured to obtain extended reality (XR) discomfort indication data from one or more sensors of another device in contact with the person or in the vicinity of the person. In some examples, the control system 110 may be configured to obtain extended reality (XR) discomfort indication data from a memory in which previously-obtained extended reality (XR) discomfort indication data have been stored.

[0047] According to some examples, the control system 110 may be configured to classify at least one user as having either a cumulative effects XR discomfort profile or a refractory XR discomfort profile. In some examples, a cumulative effects XR discomfort profile may correspond with increased XR discomfort during successive instances of XR content consumption. Alternatively, or additionally, a cumulative effects XR discomfort profile may correspond with increased XR discomfort during time intervals between successive instances of XR content consumption. According to some examples, the refractory XR discomfort profile may correspond with reduced XR discomfort during time intervals between successive instances of XR content consumption. Alternatively, or additionally, refractory XR discomfort profile may correspond with reduced XR discomfort during at least some successive instances of XR content consumption.

[0048] In some examples, the control system 110 may be configured to output a XR discomfort profile classification. Outputting the XR discomfort profile classification may involve storing the XR discomfort profile classification,transmitting the XR discomfort profile classification to a device that is configured to provide a XR experience, providing the XR discomfort profile classification for further processing, or combinations thereof. Classifying at least one user as having either a cumulative effects XR discomfort profile or a refractory XR discomfort profile may be referred to herein as making a user classification. According to some examples, the control system 110 may be configured to implement, based at least in part on a user classification, one or more discomfort mitigation procedures associated with an XR presentation. Some detailed examples are described below.

[0049] Some or all of the methods described herein may be performed by one or more devices according to instructions (e.g., software) stored on one or more non-transitory media. Such non-transitory media may include memory devices such as those described herein, including but not limited to random access memory (RAM) devices, read-only memory (ROM) devices, etc. The one or more non-transitory media may, for example, reside in the optional memory system 115 shown in Figure 1 and / or in the control system 110. Accordingly, various innovative aspects of the subject matter described in this disclosure can be implemented in one or more non-transitory media having software stored thereon. The software may, for example, include instructions for controlling at least one device to perform some or all of the methods disclosed herein. The software may, for example, be executable by one or more components of a control system such as the control system 110 of Figure 1.

[0050] In some examples, the apparatus 100 may include the optional microphone system 120 shown in Figure 1. The optional microphone system 120 may include one or more microphones. According to some examples, the optional microphone system 120 may include an array of microphones. In some examples, the array of microphones may be configured to determine direction of arrival (DOA) and / or time of arrival (TOA) information, e.g., according to instructions from the control system 110. The array of microphones may, in some instances, be configured for receive-side beamforming, e.g., according to instructions from the control system 110. In some implementations, one or more of the microphones may be part of, or associated with, another device, such as a speaker of the speaker system, a smart audio device, etc. In some examples, the apparatus 100 may not include a microphone system 120. However, in somesuch implementations the apparatus 100 may nonetheless be configured to receive microphone data for one or more microphones in an environment via the interface system 110. In some such implementations, a cloud-based implementation of the apparatus 100 may be configured to receive microphone data, or data corresponding to the microphone data, from one or more microphones in an environment via the interface system 110.

[0051] According to some implementations, the apparatus 100 may include the optional loudspeaker system 125 shown in Figure 1. The optional loudspeaker system 125 may include one or more loudspeakers, which also may be referred to herein as “speakers” or, more generally, as “audio reproduction transducers.” In some examples (e.g., cloud-based implementations), the apparatus 100 may not include a loudspeaker system 125.

[0052] In some implementations, the apparatus 100 may include the optional sensor system 130 shown in Figure 1. The optional sensor system 130 may include one or more GSR sensors, touch sensors, gesture sensors, motion detectors, cameras, eye tracking devices, or combinations thereof. In some implementations, the one or more cameras may include one or more free-standing cameras. In some examples, one or more cameras, eye trackers, etc., of the optional sensor system 130 may reside in a television, a mobile phone, a smart speaker, a laptop, a game console or system, or combinations thereof. Although the optional sensor system 130 and the optional microphone system 120 are shown as separate elements in Figure 1, microphones also may be considered to be “sensors” within the meaning of the present disclosure.

[0053] In some examples, the apparatus 100 may not include a sensor system 130. However, in some such implementations the apparatus 100 may nonetheless be configured to receive sensor data for one or more sensors (such as GSR sensors, cameras, eye trackers, monitors, etc.) residing in or on other devices in an environment via the interface system 110.

[0054] In some implementations, the apparatus 100 may include the optional display system 135 shown in Figure 1. The optional display system 135 may include one or more displays, such as one or more light-emitting diode (LED) displays. In some instances, the optional display system 135 may include one or more organic light-emitting diode (OLED) displays. In some examples, the optional display system 135 may include one or more displays of a television, alaptop, a mobile device, a smart audio device, an automotive subsystem (e.g., infotainment system, driver assistance or safety system, etc.), or another type of device. In some examples wherein the apparatus 100 includes the display system 135, the sensor system 130 may include a touch sensor system and / or a gesture sensor system proximate one or more displays of the display system 135. According to some such implementations, the control system 110 may be configured for controlling the display system 135 to present one or more graphical user interfaces (GUIs).

[0055] According to some such examples the apparatus 100 may be, or may include, a smart audio device, such as a smart speaker. In some such implementations the apparatus 100 may be, or may include, a wakeword detector. For example, the apparatus 100 may be configured to implement (at least in part) a virtual assistant.

[0056] Figures 2A and 2B are graphs that show galvanic skin responses (GSRs) of two different people during successive instances of XR content consumption. Figure 2A shows an example of a GSR graph over time of a person having a cumulative effects XR discomfort profile and Figure 2B shows an example of a GSR graph over time of a person having a refractory XR discomfort profile. In these examples, the units of the vertical axes indicate skin conductance, with the skin conductance units being microsiemens (µS). According to these examples, the units of the horizontal axes indicate time in seconds.

[0057] In these examples, the time intervals 205a, 205b and 205c correspond to successive instances of XR content consumption. According to these examples, VR presentations of roller coaster rides were made during the time intervals 205a, 205b and 205c. During the time intervals 205a, VR presentations of roller coaster rides were provided with a narrow field of view, which was approximately 32 degrees in this example. During the time intervals 205b, VR presentations of roller coaster rides were provided with a wide field of view, which was approximately 95 degrees in this example. During the time intervals 205c, VR presentations of roller coaster rides were provided with an intermediate field of view, which was approximately 52 degrees in this example. The dashed vertical lines within the successive instances of XR content consumption indicate times at which a person indicated verbal expressions of discomfort.

[0058] During the intervals labeled BL1, BL2 and BL3, no VR presentation is made. The intervals labeled BL2 and BL3 are examples of what are referred to herein as “time intervals between successive instances of XR content consumption.”

[0059] An increased GSR value generally corresponds to an increased level of discomfort. Referring to Figure 2A, one may see that the GSR values trend increasingly higher, indicating that the cumulative effects individual grows more uncomfortable over time, particularly during successive instances of XR content consumption. Although the individual having a cumulative effects XR discomfort profile recovers somewhat during time intervals between successive instances of XR content consumption, the GSR value at the end of each successive instance of XR content consumption is higher than the GSR value at the end of the previous instance of XR content consumption. This indicates increased XR discomfort during time intervals between successive instances of XR content consumption.

[0060] Referring to Figure 2B, one may see that the GSR values do not trend increasingly higher, but instead decrease to lower levels at the end of each time interval between successive instances of XR content consumption. The GSR value at the ending time of BL2 is lower than the GSR value before the beginning of the time interval 205a and the GSR value at the ending time of BL3 is lower than the GSR value before the beginning of the time interval 205b. The GSR values during the 3rdtime interval of XR content consumption (205c) remain below the GSR value before the beginning of the 1sttime interval of XR content consumption (205a). Moreover, the GSR values continue to decrease during the first 100 seconds of the 3rdtime interval of XR content consumption (205c). These factors indicate that the individual having a refractory XR discomfort profile recovers during time intervals between successive instances of XR content consumption and, to some extent, even during instances of XR content consumption.

[0061] Figures 2C and 2D show maximum GSR values for four different people and for six different people, respectively, during three successive instances of XR content consumption. In these examples, the successive instances of XR content consumption 1, 2 and 3 correspond with the successive instances of XR content consumption during the time intervals 205a, 205b and 205c, respectively, ofFigures 2A and 2B. According to these examples, the broken lines correspond to responses of individual people and the solid line represents the average response of the group.

[0062] Figure 2C indicates maximum GSR values corresponding to people having a cumulative effects XR discomfort profile, whereas Figure 2D indicates maximum GSR values corresponding to people having a refractory XR discomfort profile. One may observe that in Figure 2C, the maximum GSR value increases with each successive instance of XR content consumption for people having a cumulative effects XR discomfort profile. However, Figure 2D indicates that the maximum GSR value does not necessarily increase with each successive instance of XR content consumption for people having a refractory XR discomfort profile.

[0063] Several conclusions may be drawn based on the foregoing observations, as well as numerous other confirming observations involving the responses of other people to XR content consumption. On such conclusion is that people having a cumulative effects XR discomfort profile are highly sensitive to time spent during XR content consumption, particularly VR content consumption, because these individuals do not fully recover during instances of XR content consumption or even between successive instances of XR content consumption. However, people having a refractory XR discomfort profile tend to recover between successive instances of XR content consumption and, to some extent, even during instances of XR content consumption.

[0064] Various methods of obtaining XR discomfort indication data are disclosed herein. In the examples that are described with reference to Figures 2A–2D, the XR discomfort indication data was GSR data. In other examples, obtaining the XR discomfort indication data may involve obtaining blood pressure data, heart rate (HR) data, including but not limited to HR variability data, pupil dilation data, gaze data, posture data, pose data, movement data, facial expression data, or combinations thereof. Alternatively, or additionally, obtaining the XR discomfort indication data may involve obtaining user feedback, including but not limited to verbal feedback, obtaining user demographic information, obtaining content metadata—such as content metadata provided with an XR presentation indicating instances of known user discomfort—or combinations thereof.

[0065] Moreover, the time(s) at which XR discomfort indication data are obtained may vary according to the particular implementation. In the examples that are described with reference to Figures 2A–2D, the XR discomfort indication data were obtained before, between and during successive instances of XR content consumption. In some examples, XR discomfort indication data may be obtained as part of setup process for a new VR headset, for new XR or MR glasses, in a standalone application, etc., during which XR discomfort indication data are obtained while a user is being presented with XR content that is known to induce XR discomfort in some users.

[0066] However, some implementations may not require any setup or pre-testing process that involves obtaining XR discomfort indication data. In some such implementations, XR discomfort indication data may be obtained before, between and / or during successive instances of XR content consumption of the user’s selection, in the normal course of using an XR device or system.

[0067] Various methods of classifying user as having either a cumulative effects XR discomfort profile or a refractory XR discomfort profile are also disclosed herein. In some examples, the classifying process may involve determining whether an average GSR value increases or decreases during time intervals between successive instances of XR content consumption. According to some examples, the average GSR value may be an average obtained during a time window in the range of 2 seconds to 2 minutes.

[0068] In some examples, at least some of the GSR data may be obtained prior to XR content consumption. For example, a rolling average of GSR may be computed, beginning before users are engaged with XR content at all—e.g., during the time intervals BL1 in Figures 2A and 2B—and continuing during time intervals between successive instances of XR content consumption, for example during the time intervals BL2 and BL3 in Figures 2A and 2B. According to some such examples, if the rolling average progressively increases, the user may be classified as having a cumulative effects XR discomfort profile. In some such examples, if the rolling average fluctuates or decreases, the user may be classified as having a refractory XR discomfort profile.

[0069] The present inventors have investigated the effects of altering the field of view during instances of XR content consumption. Figures 3A and 3B show maximum GSR values for four different people and for six different people,respectively, during three successive instances of XR content consumption. In these examples, the three successive instances of XR content consumption were presented with increasingly wide fields of view, with the narrowest field of view during instance 1 of XR content consumption, an intermediate field of view during instance 2 of XR content consumption and the widest field of view during instance 3 of XR content consumption. According to these examples, the narrow field of view was approximately 32 degrees, the intermediate field of view was approximately 52 degrees and the wide field of view was approximately 95 degrees. In these examples, the broken lines correspond to responses of individual people and the solid line represents the average response of the group.

[0070] Figure 3A indicates maximum GSR values corresponding to people having a cumulative effects XR discomfort profile, whereas Figure 3B indicates maximum GSR values corresponding to people having a refractory XR discomfort profile. One may observe that the maximum GSR values do not differ significantly when the field of view is varied during instances of XR content consumption for people having a cumulative effects XR discomfort profile. However, the maximum GSR values do differ significantly when the field of view is varied during instances of XR content consumption for people having a refractory XR discomfort profile. One may observe, for example, that the GSR values for people having a refractory XR discomfort profile measured for XR content consumption at the widest field of view increase significantly relative to the GSR values measured for XR content consumption at the medium field of view. There is no corresponding increase in GSR values for people having a cumulative effects XR discomfort profile.

[0071] Figure 4 is a flow diagram that outlines one example of a disclosed method. The blocks of method 400, like other methods described herein, are not necessarily performed in the order indicated. According to some examples, one or more blocks may be performed in parallel. Moreover, some similar methods may include more or fewer blocks than shown and / or described. The method 400 may be performed by an apparatus or system, such as the apparatus 100 that is shown in Figure 1 and described above. In some examples, the apparatus 100 includes at least the control system 110 shown in Figure 1 and described above. In some examples, the blocks of method 400 may be performed by one or more devices within a local environment, e.g., by a device involved with providing anXR experience to a user, such as XR glasses, MR glasses, a VR headset, a game console or system, etc. However, in some implementations at least some blocks of the method 400 may be performed by one or more devices that are configured to implement a cloud-based service, such as one or more servers.

[0072] In this example, block 405 involves classifying one or more users as having either a cumulative effects XR discomfort profile or a refractory XR discomfort profile. In some examples, the classification may be based, at least in part, on GSR data. For example, block 405 also may involve obtaining, by a control system, GSR data corresponding to one or more users and making a user classification based, at least in part, on the GSR data. According to some examples, the control system may obtain the GSR data from one or more skin conductance sensors of the sensor system 130 that is described with reference to Figure 1. However, in other examples, GSR data corresponding to one or more users may have been previously obtained. In some such examples, the control system may obtain the GSR data from the memory system 115 that is described with reference to Figure 1, via data transfer from another device via the interface system 105, or otherwise. According to some alternative implementations, the classification of block 405 may be based, at least in part, on one or more other types of data, such as heart rate (HR) data, including but not limited to HR data indicating decreased HR variability, eye-related data, including but not limited to variations in pupil size, posture data, user movement data, facial expression data, sounds produced by a user, including but not limited to verbal reports of user experiences, or combinations thereof.

[0073] According to this example, if a user is classified as having a cumulative effects XR discomfort profile, the process continues from block 405 to block 410. In this example, if a user is classified as having a refractory XR discomfort profile, the process continues from block 405 to block 420. In either case, method 400 involves providing an XR experience to the user(s) and monitoring GSR values during the XR experience.

[0074] In this example, block 410 involves determining that the measured GSR values of a user classified as having a cumulative effects XR discomfort profile exceed a GSR threshold. The GSR threshold of block 410 may be referred to herein as a cumulative effects GSR threshold. In some examples, the cumulative effects GSR threshold may be in the range of 1.0 to 2.5 microsiemens (µS), forexample 1.5 µS, 1.75 µS, 2.0 µS, etc. According to some examples, the cumulative effects GSR threshold may be specific to a particular user classified as having a cumulative effects XR discomfort profile. In some such examples, the cumulative effects GSR threshold may be selected by a user, for example during a start-up process for newly-acquired XR glasses, for newly-acquired MR glasses, for a newly-acquired VR headset, etc. However, in some instances the cumulative effects GSR threshold may not be specific to a particular user. In some such examples, the cumulative effects GSR threshold may be a default cumulative effects GSR threshold. The default cumulative effects GSR threshold may, for example, be based on GSR measurements that were previously obtained from many users classified as having a cumulative effects XR discomfort profile.

[0075] In this example, block 415 involves implementing at least one discomfort mitigation procedure associated with the XR presentation. According to this example, block 415 involves imposing an XR presentation timeout until measured GSR values return to, or are below, a GSR baseline level. In some examples, the GSR baseline level for a user classified as having a cumulative effects XR discomfort profile may be in the range of 0.3 to 1.5 microsiemens (µS), for example 0.5 µS, 0.75 µS, 1.0 µS, etc. As with the GSR threshold, the GSR baseline level may, in some examples, be user-specific.

[0076] Alternatively, or additionally, some examples of method 400 may involve discontinuing all motion of the XR presentation until measured GSR values return to, or are below, the GSR baseline level. In some such examples, the XR presentation may provide a stationary view, even if the user’s head is turning, until measured GSR values return to, or are below, the GSR baseline level.

[0077] In the example shown in Figure 4, block 420 involves determining that the measured GSR values of a user classified as having a refractory XR discomfort profile exceed a GSR threshold. The GSR threshold of block 420 may be referred to herein as a refractory GSR threshold. According to some examples, the refractory GSR threshold may be different from the cumulative effects GSR threshold that is applied in block 410. In some examples, the refractory GSR threshold may be in the range of 2.5 to 4.0 microsiemens (µS), for example 2.75 µS, 3.0 µS, 3.25 µS, 3.5 µS, 3.75 µS, 4.0 µS, etc. According to some examples, the refractory GSR threshold may be specific to a particular user classified as having a refractory XR discomfort profile. In some such examples,the refractory GSR threshold may be selected by a user, for example during a start-up process for newly-acquired XR glasses, for newly-acquired MR glasses, for a newly-acquired VR headset, etc. However, in some instances the refractory GSR threshold may not be specific to a particular user. In some such examples, the refractory GSR threshold may be a default refractory GSR threshold. The default refractory GSR threshold may, for example, be based on GSR measurements that were previously obtained from many users classified as having a refractory XR discomfort profile.

[0078] In this example, block 425 involves implementing at least one discomfort mitigation procedure associated with the XR presentation. According to this example, block 425 involves reducing the field of view of the XR presentation until measured GSR values are below a GSR threshold. For example, if the XR presentation that caused the refractory GSR threshold of block 420 to be exceeded was presented with a wide field of view, such as a field of view in the range of 90 to 120 degrees, block 425 may involve reducing the field of view of the XR presentation to a medium field of view, such as a field of view in the range of 50 to 70 degrees, until measured GSR values are below the GSR threshold that is applied in block 425. In another example, if the XR presentation that caused the refractory GSR threshold of block 420 to be exceeded had a medium field of view, such as a field of view in the range of 50 to 70 degrees, block 425 may involve reducing the field of view of the XR presentation to a narrow field of view, such as a field of view in the range of 30 to 40 degrees, until measured GSR values are below the GSR threshold that is applied in block 425. In another example, if the XR presentation that caused the refractory GSR threshold of block 420 to be exceeded had a “full periphery” field of view, such as a field of view in the range of 160 to 220 degrees, block 425 may involve reducing the field of view of the XR presentation to a wide field of view, such as a field of view in the range of 90 to 120 degrees, or reducing the field of view of the XR presentation to a medium field of view, such as a field of view in the range of 50 to 70 degrees, until measured GSR values are below the GSR threshold that is applied in block 425.

[0079] In some examples, the GSR threshold that is applied in block 425 may be the same refractory GSR threshold that is applied in block 420. However, in some alternative examples the GSR threshold that is applied in block 425 may bedifferent from, for example lower than, the GSR threshold that is applied in block 420. The GSR threshold that is applied in block 425 may or may not be user- specific, depending on the particular implementation.

[0080] Alternatively, or additionally, some examples of method 400 may involve altering one or more of the following until measured GSR values of a user classified as having a refractory XR discomfort profile are below the GSR threshold that is applied in block 425:

[0081] Haptic feedback, such as reducing types of haptic feedback that create the impression of falling, increasing relaxing / massage types of haptic feedback that, increasing types of haptic feedback that help a user feel more connected with the physical world, etc.;

[0082] Movement angle or velocity, such as decreasing how quickly the user appears to turn, decreasing the amount of pitch and / or roll in an XR presentation, etc.;

[0083] User gain control, for example limiting a user’s ability to cause an apparent acceleration during an XR presentation;

[0084] Display quality or type, such as reducing contrast to make an XR presentation seem less realistic, increasing pass-through visuals provided by XR glasses or MR glasses, or other ways of presenting video to reduce sensory conflict related discomfort, such as visual / vestibular mismatch.

[0085] Some examples may involve subsequently—for example, subsequent to determining that the measured GSR values of a user classified as having a refractory XR discomfort profile exceed the refractory GSR threshold— presenting an alternative version of the XR presentation, which also may be referred to herein as a modified version of the XR presentation. Some such examples may involve subsequently presenting the alternative version until measured GSR values return to, or are below, the GSR threshold that is applied in block 425. However, some examples may involve subsequently presenting the alternative version even after measured GSR values return to, or are below, the refractory GSR threshold. Some examples may involve subsequently presenting a version of the XR presentation that includes reduced movement angles, subsequently presenting a version of the XR presentation that includes reduced movement angular velocities, subsequently presenting a version of the XR presentation that includes reduced accelerations, subsequently presenting aversion of the XR presentation that includes reduced display quality, or combinations thereof.

[0086] In some examples, the subsequently presenting may involve selecting an alternative presentation different from the XR presentation that caused the measured GSR values to exceed the refractory GSR threshold—for example, selecting the alternative presentation from among one or more versions of the XR presentation stored in a memory—and providing the alternate presentation. Alternatively, or additionally, some examples may involve modifying the version of the XR presentation that caused the measured GSR values to exceed the refractory GSR threshold, for example by applying an artificial intelligence based method.

[0087] Figures 5A and 5B are graphs that show additional examples of GSRs during successive instances of XR content consumption. Figures 5A and 5B show examples of GSR graphs over time of two people, who will be referred to as person A and person B, respectively, having cumulative effects XR discomfort profiles. In these examples, the time intervals 505a, 505b and 505c correspond to successive instances of XR content consumption by person A and person B. One may observe that the GSR values for both person A and person B trend upwards during successive instances of XR content consumption and remain high during time intervals between successive instances of XR content consumption, both of which are characteristics of cumulative effects XR discomfort profiles.

[0088] According to these examples, the arrows within the successive instances of XR content consumption indicate times at which person A had strong responses to salient events in the XR content, as evidenced by GSR peaks. One can see that the GSR values for person A remained high after the times indicated by the arrows. However, person B did not have strong responses at these times.

[0089] Figures 5C shows examples of responses to salient events in XR content by multiple individuals having cumulative effects XR discomfort profiles. The salient events were evidenced by GSR peaks corresponding to one or more of the “cumulative effects” individuals. In this example, the graph is aligned with the times of the salient events: the time of zero seconds corresponds to the aligned times of the salient events. Negative time values correspond to times prior to the salient events and positive time values correspond to times after the salient events. One may see that Figure 5C does not show a significant overall increasein GSR caused by the salient events, due to heterogeneity in the responses of individuals having cumulative effects XR discomfort profiles.

[0090] Figures 5D shows examples of responses to salient events in XR content by multiple individuals having refractory XR discomfort profiles. In this example, the graph is aligned with the times of the salient events: the time of zero seconds corresponds to the aligned times of the salient events. Negative time values correspond to times prior to the salient events and positive time values correspond to times after the salient events. One may see that Figure 5D shows a significant overall increase in the GSR values of “refractory” individuals caused by the salient events, due to a greater similarity in the responses of individuals having refractory XR discomfort profiles as compared to the responses of “cumulative effects” individuals.

[0091] In view of the varying responses of “refractory” and “cumulative effects” individuals, some disclosed examples involve leveraging pooled GSR data from refractory individuals—such as the data shown in Figure 5D—to identify moments of content that should be modified (e.g., via an offline process) or presented differently (e.g., via a preventative real-time process) to prevent spikes in GSR of cumulative effects individuals, who may be unable to fully recover responsive to real-time content modification strategies. The pooled GSR data may be anonymized in order to preserver user privacy.

[0092] Figure 6 is a flow diagram that outlines one example of a disclosed method. The blocks of method 600, like other methods described herein, are not necessarily performed in the order indicated. According to some examples, one or more blocks may be performed in parallel. Moreover, some similar methods may include more or fewer blocks than shown and / or described. The method 600 may be performed by an apparatus or system, such as the apparatus 100 that is shown in Figure 1 and described above. In some examples, the apparatus 100 includes at least the control system 110 shown in Figure 1 and described above. In some examples, the blocks of method 600 may be performed by one or more devices within a local environment, e.g., by a device involved with providing an XR experience to a user, such as XR glasses, MR glasses, a VR headset, a game console or system, etc. However, in some implementations at least some blocks of the method 600 may be performed by one or more devices that are configured to implement a cloud-based service, such as one or more servers.

[0093] In this example, block 605 involves aligning the GSR responses of multiple individuals having refractory XR discomfort profiles. For example, block 605 may involve obtaining, by a control system, GSR data corresponding to multiple “refractory” individuals to the same XR presentation—such as the same VR presentation—and time-aligning the GSR data. According to some examples, the control system may obtain the GSR data from one or more skin conductance sensors of the sensor system 130 that is described with reference to Figure 1. In some alternative examples, at least some of the GSR data may be obtained via data transfer from another device via the interface system 105, or otherwise. In some examples, at least some of the GSR data may have been previously obtained. In some such examples, the control system may obtain the GSR data from the memory system 115 that is described with reference to Figure 1. In some alternative examples, the aligning may be based on responses other than, or in addition to, GSR responses.

[0094] According to this example, block 610 involves identifying content that frequently cause GSR values to exceed a GSR threshold. The qualifier “frequently” may vary according to the particular implementation. In some examples, “frequently” causing GSR values to exceed the GSR threshold may mean causing more than 50% of the individuals’ GSR values to exceed the threshold, causing more than 60% of the individuals’ GSR values to exceed the threshold, causing more than 70% of the individuals’ GSR values to exceed the threshold, etc. According to some examples, the GSR threshold of block 610 may be the same GSR threshold that is evaluated in block 420 of Figure 4. In some examples, the GSR threshold of block 610 may be referred to herein as a refractory GSR threshold. According to some examples, the refractory GSR threshold may be different from the cumulative effects GSR threshold that is applied in block 410. In some examples, the refractory GSR threshold may be in the range of 2.5 to 4.0 microsiemens (µS), for example 2.75 µS, 3.0 µS, 3.25 µS, 3.5 µS, 3.75 µS, 4.0 µS, etc.

[0095] In this example, block 615 involves modifying the content of an XR presentation. According to some examples, block 615 may involve modifying the content of the portion(s) of the XR presentation identified in block 610. In some examples, block 615 may involve reducing a maximum movement angle of the XR presentation, reducing a maximum movement angular velocity of the XRpresentation, reducing a maximum acceleration of the XR presentation, reducing a display quality during the XR presentation, or combinations thereof. According to some examples, block 615 may involve selecting and providing an alternative version of the XR presentation. Some such examples may involve modifying the XR presentation by removing certain portions or sections entirely, e.g., by omitting one or more portions that include sudden and / or repeated instances of acceleration, high-speed turning, falling, crashing, etc.

[0096] Figure 7 is a flow diagram that outlines another example of a disclosed method. The blocks of method 700, like other methods described herein, are not necessarily performed in the order indicated. According to some examples, one or more blocks may be performed in parallel. Moreover, some similar methods may include more or fewer blocks than shown and / or described. The method 700 may be performed by an apparatus or system, such as the apparatus 100 that is shown in Figure 1 and described above. In some examples, the apparatus 100 includes at least the control system 110 shown in Figure 1 and described above. In some examples, the blocks of method 700 may be performed by one or more devices within a local environment, e.g., by a device involved with providing an XR experience to a user, such as XR glasses, MR glasses, a VR headset, a game console or system, etc. However, in some implementations at least some blocks of the method 700 may be performed by one or more devices that are configured to implement a cloud-based service, such as one or more servers.

[0097] In this example, block 705 involves obtaining, by a control system, XR discomfort indication data. For example, block 705 may involve obtaining, by the control system 110 of Figure 1, the XR discomfort indication data from one or more sensors of the sensor system 130. In some alternative examples, at least some of the XR discomfort indication data may be obtained via data transfer from another device via the interface system 105. In some examples, at least some of the XR discomfort indication data may have been previously obtained. In some such examples, the control system may obtain some or all of the XR discomfort indication data from the memory system 115 that is described with reference to Figure 1.

[0098] According to some examples, obtaining the XR discomfort indication data may involve obtaining GSR data, obtaining blood pressure data, heart rate (HR) data, including but not limited to HR variability data, pupil dilation data, gazedata, posture data, pose data, movement data, facial expression data, or combinations thereof. In some examples, obtaining the XR discomfort indication data may involve obtaining user feedback, including but not limited to verbal feedback, user demographic information, content metadata, or combinations thereof.

[0099] In some examples, the XR discomfort indication data may be obtained after user notification. Alternatively, or additionally, the XR discomfort indication data may be obtained without user notification. In some examples, XR discomfort indication data may be obtained during a XR device setup process, during a XR application setup process, prior to XR content consumption, during XR content consumption, responsive to an indication that a XR-capable device is being put on, or combinations thereof.

[0100] According to this example, block 710 involves classifying, by the control system, at least one user as having either a cumulative effects XR discomfort profile or a refractory XR discomfort profile. In this example, the cumulative effects XR discomfort profile corresponds with increased XR discomfort during successive instances of XR content consumption, increased XR discomfort during time intervals between successive instances of XR content consumption, or both. According to this example, the refractory XR discomfort profile corresponds with reduced XR discomfort during time intervals between successive instances of XR content consumption and with reduced XR discomfort during at least some successive instances of XR content consumption.

[0101] According to some examples, block 710 may involve determining whether GSR data indicates that a maximum GSR value or an average GSR value increases during successive instances of XR content consumption. Alternatively, or additionally, block 710 may involve determining whether the GSR data indicates that an average GSR value increases or decreases during time intervals between successive instances of XR content consumption. In some examples, the average GSR value may be an average during a time window in a range of 2 seconds to 2 minutes. According to some examples in which at least some of the GSR data is obtained prior to XR content consumption, the classifying process of block 710 may involve determining whether the GSR data indicates that an average GSR value increases or decreases prior to XR content consumption.

[0102] In this example, block 715 involves outputting, by the control system, a XR discomfort profile classification for the at least one user. According to some examples, outputting the XR discomfort profile classification may involve storing the XR discomfort profile classification, transmitting the XR discomfort profile classification to a device that is configured to provide a XR experience, providing the XR discomfort profile classification for further processing, or combinations thereof.

[0103] Alternatively, or additionally, in some examples block 715—or another aspect of method 700—may involve implementing one or more discomfort mitigation procedures associated with an XR presentation. In some such examples, the one or more discomfort mitigation procedures may be based, at least in part, on whether a user has been classified as having a cumulative effects XR discomfort profile or a refractory XR discomfort profile. For example, if a user has been classified as having a refractory XR discomfort profile, the one or more discomfort mitigation procedures may include reducing a field of view (FOV) of the XR presentation. According to some examples, the one or more discomfort mitigation procedures may involve reducing a maximum movement angle of the XR presentation, reducing a maximum movement angular velocity of the XR presentation, reducing a maximum acceleration of the XR presentation, reducing a display quality during the XR presentation, or combinations thereof. In some examples, if a user has been classified as having a cumulative effects XR discomfort profile, the one or more discomfort mitigation procedures may include pausing the XR presentation, presenting a stationary view of the XR presentation regardless of a user’s head or body motion, or a combination thereof.

[0104] According to some examples, the one or more discomfort mitigation procedures may involve subsequently presenting a version of the XR presentation that includes reduced movement angles, subsequently presenting a version of the XR presentation that includes reduced movement angular velocities, subsequently presenting a version of the XR presentation that includes reduced accelerations, subsequently presenting a version of the XR presentation that includes reduced display quality, or combinations thereof. In some examples, “subsequently presenting” may involve selecting and providing an alternate presentation different than the XR presentation. According to some examples, the one or more discomfort mitigation procedures may involve modifying an existingversion of the XR presentation. In some such examples, the subsequently presenting may involve providing a modified version of the XR presentation.

[0105] In some examples, method 700 may involve identifying one or more XR presentation time intervals that will be redesigned, presented differently, or both. In some such examples, the one or more XR presentation time intervals may be identified according to XR discomfort indication data obtained from multiple users classified as having refractory XR discomfort profiles. According to some such examples, the one or more XR presentation time intervals may be redesigned for users classified as having cumulative effects XR discomfort profiles, presented differently to users classified as having cumulative effects XR discomfort profiles, or both.

[0106] Some aspects of the present disclosure include a system or device configured (e.g., programmed) to perform one or more examples of the disclosed methods, and a tangible computer readable medium (e.g., a disc) which stores code for implementing one or more examples of the disclosed methods or steps thereof. For example, some disclosed systems can be or include a programmable general purpose processor, digital signal processor, or microprocessor, programmed with software or firmware and / or otherwise configured to perform any of a variety of operations on data, including an embodiment of disclosed methods or steps thereof. Such a general purpose processor may be or include a computer system including an input device, a memory, and a processing subsystem that is programmed (and / or otherwise configured) to perform one or more examples of the disclosed methods (or steps thereof) in response to data asserted thereto.

[0107] Some embodiments may be implemented as a configurable (e.g., programmable) digital signal processor (DSP) that is configured (e.g., programmed and otherwise configured) to perform required processing on audio signal(s), including performance of one or more examples of the disclosed methods. Alternatively, embodiments of the disclosed systems (or elements thereof) may be implemented as a general purpose processor (e.g., a personal computer (PC) or other computer system or microprocessor, which may include an input device and a memory) which is programmed with software or firmware and / or otherwise configured to perform any of a variety of operations including one or more examples of the disclosed methods. Alternatively, elements of someembodiments of the inventive system are implemented as a general purpose processor or DSP configured (e.g., programmed) to perform one or more examples of the disclosed methods, and the system also includes other elements (e.g., one or more loudspeakers and / or one or more microphones). A general purpose processor configured to perform one or more examples of the disclosed methods may be coupled to an input device (e.g., a mouse and / or a keyboard), a memory, and a display device.

[0108] Another aspect of the present disclosure is a computer readable medium (for example, a disc or other tangible storage medium) which stores code for performing (e.g., coder executable to perform) one or more examples of the disclosed methods or steps thereof.

[0109] While specific embodiments of the present disclosure and applications of the disclosure have been described herein, it will be apparent to those of ordinary skill in the art that many variations on the embodiments and applications described herein are possible without departing from the scope of the disclosure described and claimed herein. It should be understood that while certain forms of the disclosure have been shown and described, the disclosure is not to be limited to the specific embodiments described and shown or the specific methods described.

[0110] Various aspects of the present disclosure may be appreciated from the following Enumerated Example Embodiments (EEEs): EEE1. A method, comprising: obtaining, by a control system, extended reality (XR) discomfort indication data; classifying, by the control system, at least one user as having either a cumulative effects XR discomfort profile or a refractory XR discomfort profile, wherein: the cumulative effects XR discomfort profile corresponds with increased XR discomfort during successive instances of XR content consumption, increased XR discomfort during time intervals between successive instances of XR content consumption, or both; and the refractory XR discomfort profile corresponds with reduced XR discomfort during time intervals between successive instances of XRcontent consumption and with reduced XR discomfort during at least some successive instances of XR content consumption; and outputting, by the control system, a XR discomfort profile classification for the at least one user. EEE2. The method of EEE1, wherein outputting the XR discomfort profile classification involves storing the XR discomfort profile classification, transmitting the XR discomfort profile classification to a device that is configured to provide a XR experience, providing the XR discomfort profile classification for further processing, or combinations thereof. EEE3. The method of EEE1 or EEE2, wherein obtaining the XR discomfort indication data involves retrieving previously-obtained XR discomfort indication data from a memory. EEE4. The method of any one of EEE1 to EEE3, wherein obtaining the XR discomfort indication data involves obtaining galvanic skin response (GSR) data. EEE5. The method of EEE4, wherein the classifying involves determining whether the GSR data indicates that a maximum GSR value or an average GSR value increases during successive instances of XR content consumption. EEE6. The method of EEE4 or EEE5, wherein the classifying involves determining whether the GSR data indicates that an average GSR value increases or decreases during time intervals between successive instances of XR content consumption. EEE7. The method of EEE6, wherein the average GSR value comprises an average during a time window in a range of 2 seconds to 2 minutes. EEE8. The method of any one of EEE4 to EEE6, wherein: at least some of the GSR data is obtained prior to XR content consumption; and the classifying involves determining whether the GSR data indicates that an average GSR value increases or decreases prior to XR content consumption. EEE9. The method of any one of EEE1 to EEE8, wherein obtaining the XR discomfort indication data involves obtaining blood pressure data, heart rate (HR)data, including but not limited to HR variability data, pupil dilation data, gaze data, posture data, pose data, movement data, facial expression data, or combinations thereof. EEE10. The method of any one of EEE1 to EEE9, wherein obtaining the XR discomfort indication data involves obtaining user feedback, including but not limited to verbal feedback, user demographic information, content metadata, or combinations thereof. EEE11. The method of any one of EEE1 to EEE10, wherein the XR discomfort indication data is obtained after user notification, without user notification, during a XR device setup process, during a XR application setup process, prior to XR content consumption, during XR content consumption, responsive to an indication that a XR-capable device is being put on, or combinations thereof. EEE12. The method of any one of EEE1 to EEE11, further comprising implementing one or more discomfort mitigation procedures associated with an XR presentation. EEE13. The method of EEE12, wherein the one or more discomfort mitigation procedures are based, at least in part, on whether a user has been classified as having a cumulative effects XR discomfort profile or a refractory XR discomfort profile. EEE14. The method of EEE13, wherein a user has been classified as having a refractory XR discomfort profile and wherein the one or more discomfort mitigation procedures include reducing a field of view (FOV) of the XR presentation. EEE15. The method of EEE14, wherein the one or more discomfort mitigation procedures also include reducing a maximum movement angle of the XR presentation, reducing a maximum movement angular velocity of the XR presentation, reducing a maximum acceleration of the XR presentation, reducing a display quality during the XR presentation, or combinations thereof.EEE16. The method of EEE13, wherein a user has been classified as having a cumulative effects XR discomfort profile and wherein the one or more discomfort mitigation procedures include pausing the XR presentation, presenting a stationary view of the XR presentation regardless of a user’s head or body motion, or a combination thereof. EEE17. The method of any one of EEE12 to EEE15, wherein the one or more discomfort mitigation procedures include subsequently presenting a version of the XR presentation that includes reduced movement angles, subsequently presenting a version of the XR presentation that includes reduced movement angular velocities, subsequently presenting a version of the XR presentation that includes reduced accelerations, subsequently presenting a version of the XR presentation that includes reduced display quality, or combinations thereof. EEE18. The method of EEE17, wherein the subsequently presenting involves selecting and providing an alternate presentation different than the XR presentation. EEE19. The method of EEE17, further comprising modifying an existing version of the XR presentation, wherein the subsequently presenting involves providing a modified version of the XR presentation. EEE20. The method of any one of EEE12 to EEE19, further comprising identifying one or more XR presentation time intervals that will be redesigned, presented differently, or both. EEE21. The method of EEE20, wherein the one or more XR presentation time intervals are identified according to XR discomfort indication data obtained from multiple users classified as having refractory XR discomfort profiles. EEE22. The method of EEE21, wherein the one or more XR presentation time intervals are redesigned for users classified as having cumulative effects XR discomfort profiles, presented differently to users classified as having cumulative effects XR discomfort profiles, or both. EEE23. A method, comprising:obtaining, by a control system, extended reality (XR) discomfort indication data; making, by the control system, a user classification of at least one user as having either a cumulative effects XR discomfort profile or a refractory XR discomfort profile, wherein: the cumulative effects XR discomfort profile corresponds with increased XR discomfort during successive instances of XR content consumption, increased XR discomfort during time intervals between successive instances of XR content consumption, or both; and the refractory XR discomfort profile corresponds with reduced XR discomfort during time intervals between successive instances of XR content consumption and with reduced XR discomfort during at least some successive instances of XR content consumption; and implementing, based at least in part on the user classification, one or more discomfort mitigation procedures associated with an XR presentation. EEE24. The method of EEE23, wherein a user has been classified as having a refractory XR discomfort profile and wherein the one or more discomfort mitigation procedures include reducing a field of view (FOV) of the XR presentation. EEE25. The method of EEE24, wherein the one or more discomfort mitigation procedures also include reducing a maximum movement angle of the XR presentation, reducing a maximum movement angular velocity of the XR presentation, reducing a maximum acceleration of the XR presentation, reducing a display quality during the XR presentation, or combinations thereof. EEE26. The method of EEE23, wherein a user has been classified as having a cumulative effects XR discomfort profile and wherein the one or more discomfort mitigation procedures include pausing the XR presentation, presenting a stationary view of the XR presentation regardless of a user’s head or body motion, or a combination thereof. EEE27. The method of any one of EEE22 to EEE25, wherein the one or more discomfort mitigation procedures include subsequently presenting a version of the XR presentation that includes reduced movement angles, subsequentlypresenting a version of the XR presentation that includes reduced movement angular velocities, subsequently presenting a version of the XR presentation that includes reduced accelerations, subsequently presenting a version of the XR presentation that includes reduced display quality, or combinations thereof. EEE28. The method of EEE27, wherein the subsequently presenting involves selecting and providing an alternate presentation different than the XR presentation. EEE29. The method of EEE27, further comprising modifying an existing version of the XR presentation, wherein the subsequently presenting involves providing a modified version of the XR presentation. EEE30. An apparatus configured to implement the method of any one of EEE1 to EEE29. EEE31. A system configured to implement the method of any one of EEE1 to EEE29. EEE32. One or more non-transitory computer-readable media having instructions stored thereon for controlling one or more devices to implement the method of any one of EEE1 to EEE29.

Claims

CLAIMS 1. A method, comprising: obtaining, by a control system, extended reality (XR) discomfort indication data; classifying, by the control system, at least one user as having either a cumulative effects XR discomfort profile or a refractory XR discomfort profile, wherein: the cumulative effects XR discomfort profile corresponds with increased XR discomfort during successive instances of XR content consumption, increased XR discomfort during time intervals between successive instances of XR content consumption, or both; and the refractory XR discomfort profile corresponds with reduced XR discomfort during time intervals between successive instances of XR content consumption and with reduced XR discomfort during at least some successive instances of XR content consumption; and outputting, by the control system, a XR discomfort profile classification for the at least one user.

2. The method of claim 1, wherein outputting the XR discomfort profile classification involves storing the XR discomfort profile classification, transmitting the XR discomfort profile classification to a device that is configured to provide a XR experience, providing the XR discomfort profile classification for further processing, or combinations thereof.

3. The method of claim 1 or claim 2, wherein obtaining the XR discomfort indication data involves retrieving previously-obtained XR discomfort indication data from a memory.

4. The method of any one of claims 1 to 3, wherein obtaining the XR discomfort indication data involves obtaining galvanic skin response (GSR) data.

5. The method of claim 4, wherein the classifying involves determining whether the GSR data indicates that a maximum GSR value or an average GSR value increases during successive instances of XR content consumption.

6. The method of claim 4 or claim 5, wherein the classifying involves determining whether the GSR data indicates that an average GSR value increases or decreases during time intervals between successive instances of XR content consumption.

7. The method of claim 6, wherein the average GSR value comprises an average during a time window in a range of 2 seconds to 2 minutes.

8. The method of any one of claims 4 to 6, wherein: at least some of the GSR data is obtained prior to XR content consumption; and the classifying involves determining whether the GSR data indicates that an average GSR value increases or decreases prior to XR content consumption.

9. The method of any one of claims 1 to 8, wherein obtaining the XR discomfort indication data involves obtaining blood pressure data, heart rate (HR) data, including but not limited to HR variability data, pupil dilation data, gaze data, posture data, pose data, movement data, facial expression data, or combinations thereof.

10. The method of any one of claims 1 to 9, wherein obtaining the XR discomfort indication data involves obtaining user feedback, including but not limited to verbal feedback, user demographic information, content metadata, or combinations thereof.

11. The method of any one of claims 1 to 10, wherein the XR discomfort indication data is obtained after user notification, without user notification, during a XR device setup process, during a XR application setup process, prior to XR content consumption, during XR content consumption, responsive to an indication that a XR-capable device is being put on, or combinations thereof.

12. The method of any one of claims 1 to 11, further comprising implementing one or more discomfort mitigation procedures associated with an XR presentation.

13. The method of claim 12, wherein the one or more discomfort mitigation procedures are based, at least in part, on whether a user has been classified as having a cumulative effects XR discomfort profile or a refractory XR discomfort profile.

14. The method of claim 13, wherein a user has been classified as having a refractory XR discomfort profile and wherein the one or more discomfort mitigation procedures include reducing a field of view (FOV) of the XR presentation.

15. The method of claim 14, wherein the one or more discomfort mitigation procedures also include reducing a maximum movement angle of the XR presentation, reducing a maximum movement angular velocity of the XR presentation, reducing a maximum acceleration of the XR presentation, reducing a display quality during the XR presentation, or combinations thereof.

16. The method of claim 13, wherein a user has been classified as having a cumulative effects XR discomfort profile and wherein the one or more discomfort mitigation procedures include pausing the XR presentation, presenting a stationary view of the XR presentation regardless of a user’s head or body motion, or a combination thereof.

17. The method of any one of claims 12 to 15, wherein the one or more discomfort mitigation procedures include subsequently presenting a version of the XR presentation that includes reduced movement angles, subsequently presenting a version of the XR presentation that includes reduced movement angular velocities, subsequently presenting a version of the XR presentation that includes reduced accelerations, subsequently presenting a version of the XR presentation that includes reduced display quality, or combinations thereof.

18. The method of claim 17, wherein the subsequently presenting involves selecting and providing an alternate presentation different than the XR presentation.

19. The method of claim 17, further comprising modifying an existing version of the XR presentation, wherein the subsequently presenting involves providing a modified version of the XR presentation.

20. The method of any one of claims 12 to 19, further comprising identifying one or more XR presentation time intervals that will be redesigned, presented differently, or both.

21. The method of claim 20, wherein the one or more XR presentation time intervals are identified according to XR discomfort indication data obtained from multiple users classified as having refractory XR discomfort profiles.

22. The method of claim 21, wherein the one or more XR presentation time intervals are redesigned for users classified as having cumulative effects XR discomfort profiles, presented differently to users classified as having cumulative effects XR discomfort profiles, or both.

23. A method, comprising: obtaining, by a control system, extended reality (XR) discomfort indication data; making, by the control system, a user classification of at least one user as having either a cumulative effects XR discomfort profile or a refractory XR discomfort profile, wherein: the cumulative effects XR discomfort profile corresponds with increased XR discomfort during successive instances of XR content consumption, increased XR discomfort during time intervals between successive instances of XR content consumption, or both; and the refractory XR discomfort profile corresponds with reduced XR discomfort during time intervals between successive instances of XR content consumption and with reduced XR discomfort during at least some successive instances of XR content consumption; and implementing, based at least in part on the user classification, one or more discomfort mitigation procedures associated with an XR presentation.

24. The method of claim 23, wherein a user has been classified as having a refractory XR discomfort profile and wherein the one or more discomfortmitigation procedures include reducing a field of view (FOV) of the XR presentation.

25. The method of claim 24, wherein the one or more discomfort mitigation procedures also include reducing a maximum movement angle of the XR presentation, reducing a maximum movement angular velocity of the XR presentation, reducing a maximum acceleration of the XR presentation, reducing a display quality during the XR presentation, or combinations thereof.

26. The method of claim 23, wherein a user has been classified as having a cumulative effects XR discomfort profile and wherein the one or more discomfort mitigation procedures include pausing the XR presentation, presenting a stationary view of the XR presentation regardless of a user’s head or body motion, or a combination thereof.

27. The method of any one of claims 22 to 25, wherein the one or more discomfort mitigation procedures include subsequently presenting a version of the XR presentation that includes reduced movement angles, subsequently presenting a version of the XR presentation that includes reduced movement angular velocities, subsequently presenting a version of the XR presentation that includes reduced accelerations, subsequently presenting a version of the XR presentation that includes reduced display quality, or combinations thereof.

28. The method of claim 27, wherein the subsequently presenting involves selecting and providing an alternate presentation different than the XR presentation.

29. The method of claim 27, further comprising modifying an existing version of the XR presentation, wherein the subsequently presenting involves providing a modified version of the XR presentation.

30. An apparatus configured to implement the method of any one of claims 1 to 29.

31. A system configured to implement the method of any one of claims 1 to 29.

2. One or more non-transitory computer-readable media having instructions stored thereon for controlling one or more devices to implement the method of any one of claims 1 to 29.

Images