Changing resource utilization associated with media objects based on engagement scores

Abstract

The present disclosure relates to changing resource utilization associated with a media object based on an engagement score. According to some implementations, a method is performed at an electronic device with one or more processors, non-transitory memory, and a display. The method includes displaying, on the display, a representation of a first portion of a media object, where the first portion of the media object is associated with a first resource utilization value. The first resource utilization value characterizes utilization of a respective resource by the electronic device. The method includes determining an engagement score that characterizes a level of user engagement with respect to the representation of the first portion of the media object. The method includes changing the utilization of the respective resource from the first resource utilization value to a second resource utilization value based on a function of the engagement score. The second resource utilization value is associated with a second portion of the media object.

Description

[0001] Cross Reference to Related Applications

[0002] This application claims priority to U.S. Provisional Patent Application No. 63 / 041,287, filed June 19, 2020, which is hereby incorporated by reference in its entirety. TECHNICAL FIELD

[0003] The present disclosure relates to presenting media objects, and in particular to changing device resource utilization associated with presenting media objects. BACKGROUND

[0004] In various cases, a device presents a media object, such as displaying a video stream or avatar associated with a co-presence session. To display the media object, the device fetches the media object and renders the media object to generate corresponding display data for display. Fetching and rendering the media object utilizes a combination of the device’s communication links, processing, and memory resources.

[0005] Furthermore, a user’s engagement with respect to a media object is a function of various characteristics, such as the user’s level of focus or the location of the media object within the field of view of the display. However, the device does not change the resource utilization associated with the media object based on a function of the user’s engagement level. As a result, the device utilizes excess resources. SUMMARY

[0006] According to some implementations, a method is performed at an electronic device having one or more processors, non-transitory memory, and a display. The method includes displaying, on the display, a representation of a first portion of a media object, where the first portion of the media object is associated with a first resource utilization value. The first resource utilization value characterizes utilization of a respective resource by the electronic device. The method includes determining an engagement score that characterizes a level of user engagement with respect to the representation of the first portion of the media object. The method includes changing the utilization of the respective resource from the first resource utilization value to a second resource utilization value based on a function of the engagement score. The second resource utilization value is associated with a second portion of the media object.

[0007] According to some implementations, an electronic device includes one or more processors, a non-transitory memory, and a display. One or more programs are stored in the non-transitory memory and configured to be executed by the one or more processors. The one or more programs include instructions for performing or causing performance of the operations of any of the methods described herein. According to some implementations, a non-transitory computer-readable storage medium stores instructions that, when executed by one or more processors of an electronic device, cause the device to perform or cause performance of the operations of any of the methods described herein. According to some implementations, an electronic device includes means for performing or causing performance of the operations of any of the methods described herein. According to some implementations, an information processing apparatus, for use in an electronic device, includes means for performing or causing performance of the operations of any of the methods described herein. BRIEF DESCRIPTION OF DRAWINGS

[0008] For a better understanding of the various described implementations, reference should be made to the Drawings in conjunction with the following detailed description of specific implementations wherein like reference numerals refer to corresponding parts throughout the several views.

[0009] Figure 1 is a block diagram of an example of a portable multifunctional device in accordance with some implementations.

[0010] Figures 2A-2K is an example of changing resource utilization associated with a media object based on an engagement score in accordance with some implementations.

[0011] Figures 3A-3H is another example of changing resource utilization associated with a media object based on an engagement score in accordance with some implementations.

[0012] Figure 4 is an example of a flowchart of a method of changing resource utilization associated with a media object based on an engagement score in accordance with some implementations. SUMMARY

[0014] In various cases, a device presents a media object. For example, the device displays a three-dimensional (3D) representation of an object or a video stream. As another example, the device plays audio content through integrated speakers. To present the media object, the device initially fetches the media object. For example, the device can fetch the media object from a local storage or from a separate content distribution server via a communication link. To display a particular media object, the device also renders the particular media object in order to generate corresponding display data for display. Fetching and rendering the media object utilizes a combination of the device's communication link, processing, and memory resources. Moreover, a user's engagement with respect to the media object can be a function of various characteristics. For example, a degree of focus (e.g., a user's eye gaze) with respect to the media object can vary over time. As another example, in response to a change in the device's position (e.g., a user wearing a head-mounted device (HMD) turning their head), the device moves the media object to a different position on the display or stops displaying the media object altogether. However, the device does not change a resource utilization associated with the media object based on changes in the user's engagement level. Thus, the device does not, for example, reduce resource utilization in response to a decrease in the user's engagement level. Accordingly, the device utilizes excess resources when presenting the media object.

[0015] In contrast, various implementations disclosed herein include methods, electronic devices, and systems for changing an electronic device's utilization of a respective resource based on a function of an engagement score associated with a media object. For example, the media object corresponds to a complete television show episode or a complete sequence of moving three-dimensional (3D) representations of insects. The engagement score characterizes a user's engagement level with respect to a representation of a first portion of the media object being displayed. In some implementations, the engagement score varies with eye tracking data indicative of a user's gaze. In some implementations, the engagement score varies with a position on a display at which the representation of the first portion of the media object is located. For example, based on a position change input that changes a position of the electronic device, the electronic device stops displaying the representation of the first portion of the media object. Accordingly, the electronic device can set the engagement score to a nominal value. Based on the nominal value, the electronic device reduces a resource utilization associated with a second portion of the media object because the second portion of the media object is not within a field of view of the display and thus cannot be seen by the user. By changing the utilization of the respective resource based on the engagement score, the electronic device reduces resource utilization as compared to other devices.

[0016] In some implementations, the respective resource can include a combination of a rendering resource associated with rendering the media object and a communication link resource associated with obtaining the media object. For example, in response to determining a decrease in the engagement score, the electronic device instructs the content distribution server to provide the second portion of the media object at an output rate that is lower than an output rate at which the content distribution service provided the first portion of the media object. As another example, in response to determining an increase in the engagement score, the electronic device increases utilization of a graphics processing unit (GPU) resource in order to render the second portion of the media object at a higher resolution (e.g., more information) than the first portion of the media object. DETAILED DESCRIPTION

[0017] Reference will now be made in detail to implementations, examples of which are illustrated in the accompanying drawings. The detailed description uses numerous specific details to provide a thorough understanding of various described implementations. However, it will be clear to those of ordinary skill in the art that the various described implementations can be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the implementations.

[0018] It will also be appreciated that, although the terms “first,” “second,” etc. can be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first contact could be termed a second contact, and, similarly, a second contact could be termed a first contact, without departing from the scope of the various described implementations. The first contact and the second contact are both contacts, but they are not the same contact, unless the context clearly indicates otherwise.

[0019] The terminology used in the description of the various described implementations herein is for the purpose of describing particular implementations only and is not intended to be limiting. As used in the description of the various described implementations and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and / or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms “comprises” and / or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0020] As used herein, the term “if’ is optionally interpreted as meaning “when” or “upon” or “in response to a determination” or “in response to a detection” depending on the context. Similarly, the phrase “if determined” or “if detected [a stated condition or event]” is optionally interpreted as meaning “upon a determination” or “in response to a determination” or “upon a detection” or “in response to a detection” of [a stated condition or event], depending on the context.

[0021] A physical environment refers to the physical world that people are able to sense and / or interact with without the aid of electronic devices. A physical environment can include physical features such as physical surfaces or physical objects. For example, a physical environment corresponds to a physical park that includes physical trees, physical buildings, and physical people. People are able to directly sense and / or interact with a physical environment such as through sight, touch, hearing, taste, and smell. In contrast, an extended reality (XR) environment refers to a fully or partially simulated environment that people sense and / or interact with via electronic devices. For example, an XR environment can include augmented reality (AR) content, mixed reality (MR) content, virtual reality (VR) content, etc. In the case of an XR system, a subset of people’s physical motions, or representations thereof, are tracked, and in response, one or more characteristics of one or more virtual objects simulated in the XR system are adjusted in a manner consistent with at least one physical law. For example, an XR system can detect head movements and, in response, adjust graphical content and a sound field presented to the person in a manner similar to how such views and sounds would change in a physical environment. As another example, an XR system can detect movements of an electronic device (e.g., a mobile phone, a tablet, a laptop, etc.) presenting an XR environment and, in response, adjust graphical content and a sound field presented to the person in a manner similar to how such views and sounds would change in a physical environment. In some cases (e.g., for accessibility reasons), an XR system can adjust characteristics of graphical content in an XR environment in response to representations of physical motions (e.g., voice commands).

[0022] There are many different types of electronic systems that enable a person to sense and / or interact with various XR environments. Examples include head-mounted systems, projection-based systems, heads-up displays (HUDs), vehicle windshields having integrated display capability, windows having integrated display capability, displays formed as lenses designed to be placed on a person's eyes (e.g., similar to contact lenses), headphones / earphones, speaker arrays, input systems (e.g., wearable or handheld controllers with or without haptic feedback), smartphones, tablets, and desktop / laptop computers. A head-mounted system can have an integrated opaque display and one or more speakers. Alternatively, a head-mounted system can be configured to accept an external opaque display (e.g., a smartphone). A head-mounted system can incorporate one or more imaging sensors for capturing images or video of a physical environment, and / or one or more microphones for capturing audio of the physical environment. Rather than an opaque display, a head-mounted system can have a transparent or translucent display. A transparent or translucent display can have a medium through which light representative of images is directed to a person's eyes. The display can utilize digital light projection, OLED, LED, uLED, liquid crystal on silicon, laser scanning light source, or any combination of these technologies. The medium can be an optical waveguide, hologram medium, optical combiner, optical reflector, or any combination thereof. In some implementations, a transparent or translucent display can be configured to selectively become opaque. Projection-based systems can employ retinal projection technology that projects graphical images onto a person's retinas. Projection systems can also be configured to project virtual objects into a physical environment, for example, as a hologram or on a physical surface.

[0023] Figure 1is a block diagram that illustrates the architecture of an example of some implementations of a portable multifunction device 100 (also referred to herein as a "mobile device 100" for brevity). The mobile device 100 includes a memory 102 (which optionally includes one or more computer-readable storage mediums), a memory controller 122, one or more processing units (CPU's) 120, a peripherals interface 118, an input / output (I / O) subsystem 106, a speaker 111, a touch-sensitive display system 112, an inertial measurement unit (IMU) 130, an image sensor 143 (e.g., a camera), a contact intensity sensor 165, an audio sensor 113 (e.g., a microphone), an eye tracking sensor 164 (e.g., included within a head-mounted device (HMD)), a limb tracking sensor 150, and other input or control devices 116. In some implementations, the mobile device 100 corresponds to one of a mobile telephone, a tablet computer, a laptop computer, a wearable computing device, a head-mounted device (HMD), a head-mounted housing (e.g., to which the mobile device 100 slides into or otherwise attaches), or the like. In some implementations, the head-mounted housing is shaped to form a receptacle for receiving the mobile device 100 having a display.

[0024] In some implementations, the peripherals interface 118, the one or more processing units 120, and the memory controller 122 are optionally implemented on a single chip, such as chip 103. In some other implementations, they are optionally implemented on separate chips.

[0025] The I / O subsystem 106 couples the input / output peripherals of the electronic device 100, such as the touch-sensitive display system 112 and other input or control devices 116, with the peripherals interface 118. The I / O subsystem 106 optionally includes a display controller 156, an image sensor controller 158, an intensity sensor controller 159, an audio controller 157, an eye tracking controller 160, one or more input controllers 152 for other input or control devices, an IMU controller 132, a limb tracking controller 180, and a privacy subsystem 170. The one or more input controllers 152 receive / send electrical signals from / to the other input or control devices 116. The other input or control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and so on. In some alternative implementations, the one or more input controllers 152 optionally

[0026] In some implementations, the other input or control devices 116 include a depth sensor and / or a time-of-flight sensor that acquire depth information characterizing an operating environment.

[0027] The touch-sensitive display system 112 provides an input interface and an output interface between the electronic device 100 and a user. The display controller 156 receives and / or sends electrical signals from / to the touch-sensitive display system 112. The touch-sensitive display system 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively termed “graphics”). In some implementations, some or all of the visual output or graphical content comprises one or more user interfaces that, when displayed, provide a user with the ability to interact with the electronic device 100. As used herein, the term “affordance” refers to a user-interactive graphical user interface object (e.g., a graphical user interface object configured to be responsive to input by a user) that is capable of being manipulated by a user to perform a particular action or to indicate a particular status or value. Examples of user-interactive graphical user interface objects include, without limitation, a button, a slider, an icon, a selectable menu item, a switch, a hyperlink, or other user interface controls.

[0028] The touch-sensitive display system 112 has a touch-sensitive surface, sensor or set of sensors that accepts input from the user based on haptic and / or tactile contact. The touch-sensitive display system 112 and the display controller 156 (along with any associated modules and / or sets of instructions in memory 102) detect contact (and any movement or breaking of the contact) on the touch-sensitive display system 112 and convert the detected contact into interaction with user-interface objects (e.g., one or more soft keys, icons, web pages or images) that are displayed on the touch-sensitive display system 112. In an exemplary implementation, a point of contact between the touch-sensitive display system 112 and the user corresponds to the location of a finger of the user or a stylus.

[0029] The touch-sensitive display system 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other implementations. The touch-sensitive display system 112 and the display controller 156 optionally detect contact and any movement or breaking thereof using any of a plurality of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch-sensitive display system 112.

[0030] The user optionally uses any appropriate object or attachment, such as a stylus, finger, etc. to contact the touch-sensitive display system 112. In some implementations, the user interface is designed to work, in conjunction with a finger-based contact and gestu re, where the contact area of a finger on a touch screen is larger than the area of a stylus. In some implementations, the electronic device 100 translates the rough finger -based input into a precise pointer / cursor position or command for performing the actions that are desired by the user.

[0031] The speaker 111 and the audio sensor 113 provide an audio interface between the user and the electronic device 100. The audio circuitry receives audio data from the peripherals interface 118, converts the audio data to an electrical signal, and transmits the electrical signal to the speaker 111. The speaker 111 converts the electrical signal to a human-audible sound wave. The audio circuitry also receives electrical signals converted by the audio sensor 113 (e.g., a microphone) from a sound wave. The audio circuitry converts the electrical signals to audio data and transmits the audio data to the peripherals interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the storage 102 and / or RF circuitry by the peripherals interface 118. In some implementations, the audio circuitry also includes a headset jack. The headset jack provides an interface between the audio circuitry and a removable audio input / output peripheral, such as an output-only headset or a headset that includes both output (e.g., stereo speakers) and input (e.g., a microphone).

[0032] The inertial measurement unit (IMU) 130 includes an accelerometer, a gyroscope, and / or a magnetometer to measure various force, angular rate, and / or magnetic field information relative to the electronic device 100. Accordingly, depending on the various implementations, the IMU 130 detects one or more positional change inputs of the electronic device 100, such as the electronic device 100 being shaken, rotated, moved in a particular direction, and the like.

[0033] The image sensor 143 captures still images and / or video. In some implementations, the optical sensor 143 is located on the back of the electronic device 100, opposite the touch screen, so that the touch screen is used as the viewfinder for still and / or video image acquisition. In some implementations, another image sensor 143 is located on the front of the electronic device 100, so that the user’s image is obtained (e.g., for a selfie, for a video conference when the user is viewing other video conference participants on the touch screen, etc.). In some implementations, the image sensor is integrated within the HMD.

[0034] Contact intensity sensor 165 detects intensity of contacts on the electronic device 100 (e.g., the force (or pressure) of a touch input on a touch-sensitive surface of the electronic device 100). Contact intensity sensor 165 is, optionally, coupled with the intensity sensor controller 159 in the I / O subsystem 106. The contact intensity sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electric force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of a contact anywhere on the electronic device 100). The contact intensity sensor 165 receives contact intensity information (e.g., pressure information or a proxy for pressure information) from the physical environment. In some implementations, at least one contact intensity sensor 165 is collocated with, or coplanar with, the touch-sensitive surface of the electronic device 100. In some implementations, at least one contact intensity sensor 165 is located on the side of the electronic device 100.

[0035] Eye tracking sensor 164 detects eye gaze of a user of the electronic device 100 and generates eye tracking data indicative of the eye gaze of the user. In various implementations, the eye tracking data includes data indicative of a fixation point (e.g., a point of regard) of the user on a display panel, such as a display panel within a head-mounted device (HMD), a head-mounted housing, or a heads-up display.

[0036] Limb tracking sensor 150 obtains limb tracking data indicative of a position of a limb of a user. For example, in some implementations, the limb tracking sensor 150 corresponds to a hand tracking sensor that obtains hand tracking data indicative of a position of a hand or a finger of a user within an operating environment. In some implementations, the limb tracking sensor 150 utilizes computer vision techniques to estimate a pose of a limb based on camera images.

[0037] In various embodiments, electronic device 100 includes a privacy subsystem 170 that includes one or more privacy setting filters associated with user information, such as user information included in limb tracking data, eye tracking data, and / or body location data associated with the user. In some embodiments, privacy subsystem 170 selectively prevents and / or restricts electronic device 100 or parts thereof from acquiring and / or transmitting user information. To this end, privacy subsystem 170 receives user preferences and / or choices from the user in response to prompting the user to make user preferences and / or choices. In some embodiments, privacy subsystem 170 prevents electronic device 100 from acquiring and / or transmitting user information unless and until informed consent is obtained from the user. In some embodiments, privacy subsystem 170 anonymizes (e.g., scrambles or obfuscates) certain types of user information. For example, privacy subsystem 170 receives user input specifying which types of user information privacy subsystem 170 anonymizes. As another example, privacy subsystem 170 may include certain types of user information, including sensitive and / or identifying information, through user-specified (e.g., automatic) anonymization.

[0038] Figures 2A-2K This is an example of altering resource utilization associated with a media object based on engagement scores according to some specific implementations. Although relevant features are shown, those skilled in the art will recognize from this disclosure that various other features are not shown for the sake of brevity and in order not to obscure further relevant aspects of the exemplary embodiments disclosed herein.

[0039] like Figure 2A As shown, electronic device 210 is associated with operating environment 200. For example, in some embodiments, operating environment 200 includes a combination of computer-generated objects and physical objects, such as an augmented reality (AR) or mixed reality (MR) environment. As another example, in some embodiments, operating environment 200 includes physical sidewalls 204 and a physical rear wall 202, and electronic device 210 displays a computer-generated display screen 220 via display 212. In some embodiments, operating environment 200 is a virtual reality (VR) environment, where the entire operating environment 200 is composed of computer-generated elements.

[0040] Electronic device 210 is held by user 50. In some embodiments, electronic device 210 corresponds to a mobile device, such as a smartphone, laptop, or tablet. In some embodiments, electronic device 210 is... Figure 1 The electronic device 100 is similar to and modified from it.

[0041] In some implementations, the electronic device 210 corresponds to a head-mounted device (HMD) that includes an integrated display (e.g., a built-in display) that displays a representation of the operating environment 200. In some implementations, the electronic device 210 includes a head-mounted housing. In various implementations, the head-mounted housing includes an attachment region to which another device having a display can be attached. In various implementations, the head-mounted housing is shaped to form a receptacle for receiving another device (e.g., the electronic device 210) that includes a display. For example, in some implementations, the electronic device 210 slides / snaps into or otherwise attaches to the head-mounted housing. In some implementations, the display of the device that is attached to the head-mounted housing presents (e.g., displays) a representation of the operating environment 200. For example, in some implementations, the electronic device 210 corresponds to a mobile phone that is attachable to the head-mounted housing. In various implementations, examples of the electronic device 210 include a smartphone, a tablet, a media player, a laptop, etc.

[0042] The electronic device 210 includes a display 212. The electronic device 212 is associated with a field of view 214 that includes a portion of the operating environment 200. The portion of the operating environment 200 includes a display screen 220 and a video stream within the display screen 220. The video stream represents a media object that includes a dog 221. For example, in some implementations, the electronic device 210 acquires the media object and renders the media object so as to generate the video stream for display on the display 212.

[0043] In some implementations, the display screen 220 corresponds to a virtual display screen (e.g., a computer-generated television) that is displayed by the display 212, and the electronic device 210 displays the video stream within the virtual display screen. In some implementations, the display screen 220 corresponds to a physical display screen (e.g., a real-world television), and the electronic device 210 displays the video stream within the physical display screen. To this end, in some implementations, the electronic device 210 performs semantic segmentation with respect to the operating environment 200 so as to semantically identify, for example, a "television" or a "viewing area." Those of ordinary skill in the art will appreciate that, in some implementations, the electronic device 210 displays the video stream without displaying a virtual display screen, or displays the video stream independent of the location of the physical display screen within the operating environment 200.

[0044] As Figure 2BAs shown, display 212 displays a first portion of a video stream within display screen 220. The first portion of the video stream represents a first portion of a media object. The first portion of the video stream is characterized by a relatively high resolution value, such as a 4K video stream of a dog 221. Accordingly, the first portion of the media object is associated with a relatively high first resource utilization value. The first resource utilization value characterizes the utilization of a respective resource by electronic device 210.

[0045] For example, in some implementations, the first resource utilization value characterizes that electronic device 210 utilizes a relatively high level of communication link resources in order to obtain the first portion of the media object. For example, electronic device 210 utilizes communication link resources in order to satisfy performance metrics relative to quality of service (QoS) metrics (e.g., bandwidth, packet loss, jitter, etc.) associated with obtaining the first portion of the media object.

[0046] As another example, in some implementations, the first resource utilization value characterizes that electronic device 210 utilizes a relatively high level of rendering resources associated with rendering the first portion of the video stream. For example, electronic device 210 renders the first portion of the media object in order to generate a relatively high resolution (e.g., 4K) representation of the first portion of the video stream. In some implementations, the first resource utilization value characterizes utilization of a combination of communication link resources, rendering resources, and other device resources associated with displaying a representation of the media object.

[0047] In contrast to previously available devices, electronic device 210 maintains or changes utilization of respective resources based on engagement score 232. Engagement score 232 characterizes a level of user engagement relative to a representation of a media stream, such as the displayed video stream of a dog 221. Accordingly, in some cases, electronic device 210 reduces resource utilization without impacting the experience of user 50 in contrast to previously available devices. To this end, in some implementations, as Figure 2C As shown, electronic device 210 includes and utilizes one or more eye tracking sensors 164 and one or more depth sensors 231 in order to determine engagement score 232. The one or more eye tracking sensors 164 output eye tracking data associated with user 50, and electronic device 210 determines that the eye gaze of user 50 is directed at dog 221. Further, depth sensor 231 outputs depth data characterizing operating environment 200, and electronic device 210 determines a first depth value characterizing a distance between display 212 and display screen 220 (e.g., a center of display screen 220). Those of ordinary skill in the art will understand that, in some implementations, electronic device 210 determines engagement score 232 based on other sensor data.

[0048] As shown, display 212 displays a first portion of a video stream within display screen 220. The first portion of the video stream represents a first portion of a media object. The first portion of the video stream is characterized by a relatively high resolution value, such as a 4K video stream of a dog 221. Accordingly, the first portion of the media object is associated with a relatively high first resource utilization value. The first resource utilization value characterizes the utilization of a respective resource by electronic device 210. Figure 2DAs shown, the electronic device 210 determines an engagement score 232 having a value of “7” based on the eye tracking data and the depth data. Referring back to Figures 2A-2K As shown in the example, the engagement score 232 is in a range of “0” (e.g., completely disengaged) to “10” (highest level of engagement). However, one of ordinary skill in the art will understand that other implementations include different ranges and / or scales for the engagement score 232. Referring back to Figure 2D , the electronic device 210 determines a relatively high engagement score 232 of “7” because the eye gaze of the user 50 is directed at the dog 221.

[0049] As further shown in Figure 2D , the electronic device 210 selects a high resource utilization based on the locally-stored resource mapping table 230. The resource mapping table 230 provides a mapping between engagement scores and resource utilization levels. That is, because the engagement score is higher than “5”, the electronic device 210 selects a high resource utilization, as shown in Figure 2D . Thus, the electronic device 210 maintains a relatively high first resource utilization value associated with obtaining and / or rendering the first portion of the media object. Thus, as shown in Figure 2D and Figure 2E , the display 212 maintains the display of the dog 221 at a relatively high resolution value. As shown in Figure 2E , the dog 221 begins to move across the display screen 220, as shown by the movement line 234. The movement line 234 is shown for illustrative purposes only. The movement of the dog 221 from the left side of the display screen 220 to the right side of the display screen 220 is shown in Figures 2F-2K .

[0050] As shown in Figure 2F , based on the eye tracking data, the electronic device 210 determines that the eye gaze of the user 50 has moved a first distance 236 away from the display screen 220. The first distance 236 is shown for illustrative purposes only. Further, the electronic device 210 determines that the distance between the display 212 and the display screen 220 remains at the first depth value based on the depth data. Thus, because the eye gaze of the user 50 is no longer focused on the display screen 220 or the dog 221, the electronic device 210 reduces the engagement score from “7” to “5”, as shown in Figure 2F . Based on determining the engagement score of “5” and based on the resource mapping table 230, the electronic device 210 changes the utilization of the corresponding resources from the high resource utilization to a medium resource utilization. Thus, as shown in Figure 2F , the electronic device 210 displays a second portion of the video stream having a medium resolution value (e.g., 1080p) on the display 212. That is, Figure 2F the dog 221 in Figure 2EThe solid line dog 221 shown represents a reduction in resolution. The second portion of the video stream is associated with a second portion of the media object associated with moderate resource utilization. Therefore, in some embodiments, compared to acquiring the first portion of the media object, the electronic device 210 acquires the second portion of the media object based on lower utilization of communication link resources (e.g., lower bandwidth). In some embodiments, compared to rendering the first portion of the media object, the electronic device 210 renders the second portion of the media object based on lower utilization of rendering resources (e.g., lower GPU processing speed).

[0051] like Figure 2G As shown, based on eye-tracking data, electronic device 210 determines that user 50's eye gaze has moved away from display screen 220 by a second distance 238. The second distance 238 is shown for illustrative purposes only. On the other hand, electronic device 210 determines, based on depth data, that the distance between display screen 212 and display screen 220 remains at a first depth value. The second distance 238 is greater than the first distance 236. Therefore, electronic device 210 further reduces the engagement score from "5" to "3". Based on determining the engagement score "3" and based on resource mapping table 230, electronic device 210 changes the utilization rate of the corresponding resource from medium resource utilization to low resource utilization. Therefore, electronic device 210 displays a third portion of the video stream with a low resolution value (e.g., 480p) on display screen 212. That is, Figure 2G Dog 221 in the diagram is shown with a short dashed line to indicate its relationship with... Figure 2F The long dashed line dog 221 shown represents a reduction in resolution. The third portion of the video stream is associated with a third portion of the media object that is associated with low resource utilization. Therefore, in some embodiments, compared to acquiring the second portion of the media object, the electronic device 210 acquires the third portion of the media object based on lower utilization of communication link resources (e.g., lower bandwidth). In some embodiments, compared to rendering the second portion of the media object, the electronic device 210 renders the third portion of the media object based on lower utilization of rendering resources (e.g., lower GPU processing speed).

[0052] like Figure 2H and Figure 2I As shown, user 50 and therefore electronic device 210 move closer to rear wall 202, as indicated by device movement line 240. Device movement line 240 is shown for illustrative purposes only. Therefore, as Figure 2J As shown, with Figure 2G In comparison, monitor 212 displays a larger screen 220 and video stream.

[0053] like Figure 2KAs shown, electronic device 210 determines, based on eye-tracking data, that the user 50's eye gaze has moved above display screen 220 and has been maintained at a second distance 238 from display screen 220. Furthermore, electronic device 210 determines, based on depth data, that the distance between display 212 and display screen 220 (e.g., the center of display screen 220) has decreased from a first depth value to a second depth value. The change from the first depth value to the second depth value is caused by movement 240 of electronic device 210 toward the rear wall 202. It is worth noting that, with... Figure 2G In contrast, although the eye gaze remains at a second distance 238 from the display screen 220, the electronic device 210 is closer to the display screen 220 and the video stream. Therefore, compared with the reference... Figure 2G Compared to the relatively low engagement score of "3", electronic device 210 determines a medium engagement score of "5", such as Figure 2K As shown. Therefore, based on resource mapping table 230, electronic device 210 changes the utilization rate of the corresponding resource from low resource utilization to medium resource utilization. Therefore, electronic device 210 displays the fourth part of the video stream with a medium resolution value (e.g., 1080p) on display 212. That is, Figure 2K Dog 221 in the diagram is shown with a long dashed line to indicate its relationship with... Figure 2G The short dashed line shown indicates an increase in resolution compared to the 221-dog model.

[0054] Figures 3A-3H This is another example of altering resource utilization associated with media objects based on engagement scores in some specific implementations. Although relevant features are shown, those skilled in the art will recognize from this disclosure that various other features are not shown for brevity and to avoid obscuring further relevant aspects of the exemplary embodiments disclosed herein. Figure 3A As shown, electronic device 210 is associated with operating environment 300. Operating environment 300 includes a rear wall 302, a side wall 304, and a painting 311 suspended on the rear wall 302. Furthermore, operating environment 300 includes a headshot 310 representing an individual associated with an assistive device (e.g., currently using the assistive device). For example, in some embodiments, electronic device 210 and assistive device communicate via a co-occurrence session, and operating environment 300 serves as a shared operating space (e.g., a real or virtual meeting room). In some embodiments, electronic device 210 generates headshot 310. For example, electronic device 210 obtains information characterizing the individual (e.g., height, hair color, etc.) from the assistive device and generates headshot 310 based on that information.

[0055] like Figure 3B As shown, the electronic device 210 displays the rear wall 302, side wall 304, painting 311 and portrait 310 via the display 212. Figure 3BThe avatar 310 shown is displayed based on the relatively high utilization of corresponding resources, such as high utilization of rendering resources (e.g., 4K rendering). Furthermore, as shown for illustrative purposes only, the center point 312 indicates the center point of the display 212. As described below, in some embodiments, the electronic device 210 determines the engagement score 232 based on changes in the center point 312. Those skilled in the art will understand that in some embodiments, the electronic device 210 determines the engagement score 232 based on other factors such as relative to the edges or corners of the display 212.

[0056] like Figure 3C As shown, the electronic device 210 determines a first distance 324 between the head image 310 and the center point 312. Therefore, as Figure 3D As shown, electronic device 210 determines the participation score to be "4" based on the first distance. Based on the participation score 232 being 4, electronic device 210 sets the utilization rate of the corresponding resource to a medium resource utilization rate, as shown in the resource mapping table 230 in 3D. Therefore, with... Figure 3C Compared to the solid-line portrait 310 shown, Figure 3D The avatar 310 in the image has a dashed appearance to indicate a reduced resolution. The avatar 310 with reduced resolution is associated with an electronic device 210 that utilizes corresponding resources based on a moderate resource utilization rate, such as GPU utilization for rendering at a moderate resolution (e.g., 1080p) or a reduced bandwidth level associated with a corresponding portion of the avatar 310 representing data acquired (e.g., from an auxiliary device).

[0057] like Figure 3E As shown, electronic device 210 uses one or more input devices (e.g., Figure 1 The IMU 130 in the device detects the first position change input 332. The first position change input 332 instructs the electronic device 210 to change from a first position to a second position. For example, in some embodiments, the first position change input 332 corresponds to a rotational movement or a translational movement (e.g., along the xy axis) of the electronic device 210.

[0058] In response to detection Figure 3E The first position in the input 332 changes, and the electronic device 210 responds accordingly. Figure 3F The corresponding positions of the image 311 and the avatar 310 are moved on the display 212. Therefore, the avatar 310 moves to a second distance 334 from the center point 312. The second distance 334 is less than the first distance 324. Furthermore, the electronic device 310 changes the participation score 232 from "4" to "7" because... Figure 3F The avatar in the middle is 310 times Figure 3EThe avatar 310 is closer to the center point 312. Therefore, based on increasing the participation score 232 to "7", the electronic device 210 increases the utilization rate of the corresponding resource from the second value to the third value. That is, compared with Figure 3E Compared to the dashed head image 310 shown, the display 212 shows... Figure 3F The portrait 310 in the image has a solid line appearance to indicate the increased resolution.

[0059] like Figure 3G As shown, electronic device 210 detects second position change input 336 via one or more input devices. Second position change input 336 instructs electronic device 210 to change from a second position to a third position. In response to the detection... Figure 3G The second position of input 336 is changed, and the electronic device 210 determines that neither picture 311 nor avatar 310 is displayed on the display 212, therefore it stops displaying picture 311 and avatar 310. Therefore, the electronic device 210 reduces the engagement score 232 from "7" to "2", and accordingly reduces the resource utilization to low resource utilization, such as... Figure 3H As shown. In other words, since the avatar 310 is no longer displayed on the monitor 212, the electronic device 210 does not need to continue acquiring or rendering the corresponding displayable data associated with the avatar 310. In some specific implementations, low resource utilization corresponds to the electronic device 210 playing the spatial audio 340 associated with the avatar 310, such as... Figure 3H As shown. Electronic device 210 reduces the utilization of communication links and rendering resources because spatial audio 340 contains less information than video data, and because spatial audio 340 does not require rendering. For example, electronic device 210 plays spatial audio 340 as if it were emanating from the left side of the operating environment 300, because the avatar 310 moves away from the left side of the display 212 based on the second position change input 336. Therefore, electronic device 210 provides the user 50 with an unaffected experience while saving resources associated with acquiring and rendering video data associated with the avatar 310. Thus, as described herein, electronic device 210 utilizes fewer resources than other devices.

[0060] Figure 4 This is an example of a flowchart illustrating a method 400 for altering resource utilization associated with a media object based on engagement scores, according to some specific implementation. In various implementations, method 400, or portions thereof, comprises an electronic device including a display (e.g., Figure 1 Electronic devices 100 Figures 2A-2K or Figures 3A-3HThe method is executed by an electronic device 210. In various embodiments, method 400 or a portion thereof is executed by a head-mounted device (HMD) including an integrated display. In some embodiments, method 400 is executed by processing logic components (including hardware, firmware, software, or a combination thereof). In some embodiments, method 400 is executed by a processor that executes code stored in a non-transitory computer-readable medium (e.g., memory). In various embodiments, some operations in method 400 are optionally combined, and / or the order of some operations is optionally changed.

[0061] As shown in box 402, method 400 includes displaying a representation of a first portion of a media object on a display. For example, refer to... Figure 2B Display 212 displays a first portion of the video stream. As shown in box 404, the first portion of the media object is associated with a first resource utilization value, which characterizes the utilization rate of the corresponding resource by the electronic device. Continuing the previous example, the first portion of the video stream is associated with a relatively high resource utilization rate, therefore the electronic device 210 displays a first portion of the video stream. Figure 2B The first portion of the video stream is displayed at a corresponding high resolution. In some implementations, the media object is a complete TV series, a complete movie, a complete sequence of moving 3D textures, etc., and the first portion of the media object corresponds to one or more sequential images of the media object. For example, in some implementations, the media object corresponds to a reference... Figures 3A-3H The profile picture described is 310.

[0062] As shown in box 406, method 400 includes determining an engagement score that characterizes the level of user engagement relative to a first portion of a media object. This engagement score characterizes the degree to which a user focuses on the representation of the first portion of the media object, such as the length of time the user gazes at the video stream.

[0063] As shown in box 408, in some embodiments, method 400 includes determining an engagement score based on a function of eye-tracking data. For this purpose, the electronic device includes an eye-tracking sensor that provides eye-tracking data associated with the user. For example, the engagement score ranges from medium to low when a representation of a first portion of a media object is located in the user's periphery. As another example, the engagement score is higher when a representation of the first portion of the media object is within the user's gaze. As yet another example, in some embodiments, a representation of the first portion of the media object is displayed at a first position on a display, and method 400 includes identifying the gaze position based on a function of eye-tracking data. Continuing with the foregoing example, based on determining that the gaze position is less than a threshold distance from the first position, method 400 includes setting the engagement score to a first value, and based on determining that the gaze position is not less than a threshold distance from the first position, method 400 includes setting the engagement score to a second value less than the first value. For example, refer to...Figure 2F When the user's eyes are fixed (determined based on eye-tracking data) at a first distance 236 from the display screen 220, the electronic device 210 sets the engagement score to a value of "5". For example, refer to Figure 2G When the user's eyes are fixed (determined based on eye-tracking data) at a second distance 238 from the display screen 220, the electronic device 210 sets the engagement score to a smaller value of "3". The second distance 238 is greater than the first distance 236.

[0064] As shown in box 410, in some implementations, method 400 includes determining an engagement score based on a function of depth data. For this purpose, the electronic device includes a depth sensor that provides depth data relative to a first portion of the media object. For example, referencing... Figure 2G and Figure 2K Electronic device 210 determines the same second distance 238 between user 50's eye gaze and display screen 220. However, electronic device 210 sets the engagement score 232 to... Figure 2G The "3" and Figure 2K The "5" in the figure is because the depth data indicates that the electronic device 210 is in Figure 2G China and Belgium in Figure 2K The center is 220 units further away from the display area.

[0065] As shown in box 412, in some implementations, method 400 includes determining an engagement score based on changes in position change data. For this purpose, the electronic device includes one or more input devices (e.g., an IMU, an accelerometer, etc.), and method 400 includes detecting a position change input via one or more input devices. The position change input indicates that the electronic device has changed from a first position to a second position. For example, the position change input corresponds to HMD movement, such as being initiated by a head rotation while wearing the HMD. For example, in response to detection... Figure 3E The first position of input 332 is changed, and the electronic device 210 is in Figure 3F The avatar 310 is repositioned closer to the center point 312 of the display 212, and thus the engagement score 232 is increased from "4" to "7".

[0066] In some specific implementations, in response to detecting a position change input, based on determining that the representation of a first portion of the media object is located on the display at a first position less than a threshold distance from the center of the display, method 400 includes setting an engagement score to a first value. Furthermore, based on determining that the representation of the first portion of the media object is located on the display at a second position not less than a threshold distance from the center of the display, method 400 includes setting the engagement score to a second value less than the first value. Furthermore, based on determining that the representation of the first portion of the media object is not located on the display, method 400 includes setting the engagement score to a nominal value. For example, in response to detecting...Figure 3E The first position of input 332 is changed, and the electronic device 210 is in Figure 3F The general's portrait 310 was repositioned closer to the center point 312, thus increasing the engagement score 232 from "4" to "7". On the other hand, in response to detection... Figure 3G The second position in the input 336 is changed, and the electronic device 210 determines the avatar 310 in Figure 3H The score will no longer be displayed, and the participation score will therefore be reduced to the nominal value of "2".

[0067] As shown in box 414, method 400 includes changing the utilization of a corresponding resource from a first resource utilization value to a second resource utilization value based on an engagement score. This second resource utilization value is associated with a second portion of a media object. This second portion of the media object differs from the first portion of the media object. For example, the first portion of the media object corresponds to a first video frame of a video stream, while the second portion of the media object corresponds to a second video frame of the video stream. In some implementations, method 400 includes a function for recording engagement scores, wherein the utilization of the corresponding resource is changed from the first resource utilization value to the second resource utilization value in response to the function determining the engagement score satisfying a change criterion. For example, refer to... Figure 2F and Figure 2G In response to determining that the eye gaze distance from the display screen 220 is a second distance 238 and that the second distance 238 is greater than the first distance 236, the electronic device 210 reduces the engagement score 232 from "5" to "3". Continuing this example, the electronic device 210 determines that the change in engagement score 232 from "5" to "3" meets the change criterion, and therefore the electronic device 210 accordingly reduces the resource utilization rate from medium resource utilization rate to low resource utilization rate. Furthermore, when the function of engagement score corresponds to an increase in engagement score, the second resource utilization rate value is higher than the first resource utilization rate value, and when the function of engagement score corresponds to a decrease in engagement score, the second resource utilization rate value is lower than the first resource utilization rate value.

[0068] As shown in box 416, in some specific implementations, the corresponding resources correspond to communication link resources. Therefore, the first resource utilization value characterizes the electronic device acquiring a first portion of the media object, and the second resource utilization value characterizes the electronic device acquiring a second portion of the media object. For example, refer to... Figure 2E Electronic device 210 acquires the first portion of a media object at a relatively high download rate via communication link resources in order to display the corresponding first portion of the video stream at high resolution (e.g., 4K). For example, see reference... Figure 2FElectronic device 210 acquires a second portion of a media object at a moderate download rate via communication link resources in order to display the corresponding second portion of the video stream at a moderate resolution (e.g., 1080p). In some specific implementations, method 400 includes acquiring a first portion of a media object provided by a content supply system at a first output rate based on a first resource utilization value, and acquiring a second portion of the media object provided by the content supply system at a second output rate different from the first output rate based on a second resource utilization value.

[0069] In some specific implementations, such as when an electronic device retrieves media objects from local non-transitory storage, a content delivery system is included within the electronic device. Therefore, communication link resources correspond to communication systems (e.g., processing resources, memory resources) within the electronic device that facilitate the retrieval of media objects from local storage.

[0070] In some implementations, the content delivery system is a content distribution server separate from the electronic device, such as a content distribution server included in a content delivery network (CDN). For example, communication link resources correspond to a network interface, and the electronic device downloads (e.g., streams) media objects through the network interface. For example, in some implementations, the electronic device corresponds to a device capable of adaptive bitrate (ABR). Continuing the previous example, the electronic device transmits a request to the content distribution server for a second portion of the media object in order to change the utilization of the corresponding resource from a first resource utilization value to a second resource utilization value. As an example, this request corresponds to an HTTP GET command representing a specific segment of the media object, which represents the second portion of the media object. Again, in some implementations, this specific segment representation is based on various factors, including the subscription tier bandwidth allocated to the electronic device and the amount of data currently residing in the playback buffer of the electronic device.

[0071] As shown in box 418, in some embodiments, the corresponding resource corresponds to a rendering resource. Therefore, a first resource utilization value characterizes a first portion of the media object rendered by the electronic device, and a second resource utilization value characterizes a second portion of the media object rendered by the electronic device. To this end, in some embodiments, method 400 includes rendering the first portion of the media object according to the first resource utilization value to generate a representation of the first portion of the media object, and rendering the second portion of the media object according to the second resource utilization value to generate a representation of the second portion of the media object. For example, electronic device 210 renders a portion of avatar 310 according to a moderate utilization of the rendering resource, in order to... Figure 3D A medium-resolution avatar 310 is generated and ultimately displayed. Alternatively, the electronic device 210 renders a portion of the avatar 310 based on high utilization of rendering resources, so as to... Figure 3EA high-resolution avatar 310 is generated and ultimately displayed. Therefore, in some embodiments, the representation of a first portion of the media object is characterized by a first video resolution, and the representation of a second portion of the media object is characterized by a second video resolution different from the first video resolution. In some embodiments, data representing the media object (e.g., a model of the media object) is locally stored in the non-transitory memory of the electronic device, and the electronic device only acquires the location information representing the media object. Therefore, the electronic device utilizes relatively low network resource utilization, but can utilize medium to high utilization of rendering resources when the media object is to be displayed at a corresponding medium to high resolution.

[0072] As shown in box 420, in some implementations, in response to determining that the engagement score is below a threshold (e.g., set to a nominal value), method 400 includes stopping the display of a representation of a first portion of the media object and playing an audio representation of a second portion of the media object through a speaker in the electronic device. The audio representation may correspond to spatial audio played as a function of the engagement score. For example, in response to determining that avatar 310 is in Figure 3H The electronic device 210 no longer displays the engagement score as "2" and therefore plays spatial audio 340 without acquiring or rendering video data associated with the avatar 310. Thus, by acquiring and rendering video as described above, in some cases, the electronic device 210 reduces overall resource utilization without affecting the user experience.

[0073] This disclosure describes various features, none of which alone can achieve the benefits described herein. It should be understood that the various features described herein can be combined, modified, or omitted, as will be apparent to those skilled in the art. Other combinations and sub-combinations beyond those specifically described herein will be apparent to those skilled in the art and are intended to form part of this disclosure. Various methods are described herein in conjunction with various flowchart steps and / or stages. It should be understood that in many cases, certain steps and / or stages can be combined such that multiple steps and / or stages shown in the flowchart can be performed as a single step and / or stage. Additionally, certain steps and / or stages can be divided into additional sub-components to be performed independently. In some cases, the order of steps and / or stages can be rearranged, and certain steps and / or stages can be omitted entirely. Furthermore, the methods described herein should be understood to be broadly interpretable, such that additional steps and / or stages beyond those shown and described herein can also be performed.

[0074] Some or all of the methods and tasks described herein can be performed and fully automated by a computer system. In some cases, the computer system may include multiple different computers or computing devices (e.g., physical servers, workstations, storage arrays, etc.) that communicate and interoperate via a network to perform the functions described herein. Each such computing device typically includes a processor (or multiple processors) that executes program instructions or modules stored in memory or other non-transitory computer-readable storage media or devices. The various functions disclosed herein may be implemented in such program instructions, but alternatively, some or all of the disclosed functions may be implemented in the computer system's dedicated circuitry (e.g., ASIC, FPGA, or GP-GPU). In cases where the computer system includes multiple computing devices, these devices may be located in the same location or not. The results of the disclosed methods and tasks can be persistently stored by converting physical storage devices such as solid-state memory chips and / or disks into different states.

[0075] The various processes defined herein take into account options for obtaining and using users' personal information. For example, such personal information may be used to provide improved privacy screens on electronic devices. However, the extent to which such personal information is collected should be based on the user's informed consent. As described herein, users should understand and control the use of their personal information.

[0076] Personal information will be used by the appropriate parties only for lawful and reasonable purposes. Parties using such information will comply with privacy policies and practices that are at least in accordance with applicable laws and regulations. Furthermore, such policies should be comprehensive, user-accessible, and considered to meet or exceed government / industry standards. In addition, parties may not distribute, sell, or otherwise share such information except for any reasonable and lawful purpose.

[0077] However, users can limit the extent to which parties can access or otherwise obtain their personal information. For example, settings or other preferences can be adjusted so that users can decide whether their personal information can be accessed by various entities. Furthermore, while some of the characteristics defined herein are described in the context of the use of personal information, aspects of these characteristics can be implemented without the need for such information. For example, if user preferences, account names, and / or location history are collected, this information can be obfuscated or otherwise generalized so that it does not identify the corresponding user.

[0078] This disclosure is not intended to be limited to the specific embodiments shown herein. Various modifications to the specific embodiments described herein will be apparent to those skilled in the art, and the general principles defined herein can be applied to other specific embodiments without departing from the spirit or scope of this disclosure. The teachings of the invention provided herein can be applied to other methods and systems, and are not limited to those described above, and elements and actions of the various specific embodiments described above can be combined to provide further specific embodiments. Therefore, the novel methods and systems described herein can be implemented in many other forms; furthermore, various omissions, substitutions, and changes can be made to the form of the methods and systems described herein without departing from the spirit of this disclosure. The appended claims and their equivalents are intended to cover such forms or modifications that fall within the scope and spirit of this disclosure.

Claims

1. A method for displaying a media object, comprising: In an electronic device having one or more processors, non-transitory memory, one or more input devices, and a display: A representation of a first portion of a media object is displayed on the display, wherein the first portion of the media object is associated with a first resource utilization value, and wherein the first resource utilization value characterizes the utilization rate of the electronic device for a corresponding resource; The position change input is detected via the one or more input devices, wherein the position change input indicates that the electronic device changes from a first position to a second position; In response to detecting the location change input, an engagement score is determined, the engagement score representing the level of user engagement relative to the representation of the first portion of the media object, wherein: The engagement score corresponds to a first value based on the determination that the representation of the first portion of the media object is located at a first position on the display at a distance less than a threshold from the center of the display; Based on the determination that the representation of the first portion of the media object is located at a second position on the display at a distance from the center of the display not less than the threshold distance, the participation score corresponds to a second value less than the first value; and; Based on the determination that the representation of the first portion of the media object is not located on the display, the engagement score corresponds to a nominal value; and Based on the engagement score, the utilization rate of the corresponding resource is changed from a first resource utilization rate value to a second resource utilization rate value, wherein the second resource utilization rate value is associated with a second portion of the media object.

2. The method according to claim 1, further comprising: Changes in engagement scores are recorded, wherein changing the utilization rate of the corresponding resource from a first resource utilization rate value to a second resource utilization rate value is performed in response to determining that the change in engagement scores meets a change criterion.

3. The method according to claim 2, wherein: When the change in the engagement score corresponds to an increase in the engagement score, the second resource utilization value is higher than the first resource utilization value; and When the change in the engagement score corresponds to a decrease in the engagement score, the second resource utilization value is lower than the first resource utilization value.

4. The method of claim 1, wherein the corresponding resource corresponds to a rendering resource, wherein the first resource utilization value characterizes the electronic device rendering the first portion of the media object, and wherein the second resource utilization value characterizes the electronic device rendering the second portion of the media object.

5. The method according to claim 4, further comprising: Render the first portion of the media object according to the first resource utilization value to generate the representation of the first portion of the media object; as well as Render the second portion of the media object based on the second resource utilization value to generate a representation of the second portion of the media object.

6. The method of claim 5, wherein the representation of the first portion of the media object is characterized by a first video resolution, and wherein the representation of the second portion of the media object is characterized by a second video resolution different from the first video resolution.

7. The method of claim 1, wherein the corresponding resource corresponds to a communication link resource, wherein the first resource utilization value characterizes the electronic device acquiring the first portion of the media object, and wherein the second resource utilization value characterizes the electronic device acquiring the second portion of the media object.

8. The method according to claim 7, further comprising: The first portion of the media object is obtained from the content supply system at a first output rate based on the first resource utilization value; as well as The second portion of the media object is obtained from the content supply system at a second output rate different from the first output rate, based on the second resource utilization value.

9. The method of claim 8, wherein the content delivery system is integrated into the electronic device.

10. The method of claim 8, wherein the content delivery system corresponds to a content distribution server separate from the electronic device.

11. The method of claim 10, wherein the electronic device corresponds to a device capable of adaptive bit rate (ABR), and wherein changing the utilization of the corresponding resource from the first resource utilization value to the second resource utilization value includes transmitting a request for the second portion of the media object to the content distribution server.

12. The method of claim 10, wherein the content delivery server is included in a content delivery network (CDN).

13. The method of claim 1, wherein the electronic device includes an eye tracker sensor that provides eye tracking data associated with the user, and wherein the engagement score is determined based on a function of the eye tracking data.

14. The method of claim 13, wherein the representation of the first portion of the media object is displayed at a first position on the display, the method further comprising: A function based on the eye-tracking data is used to identify the gaze position; Based on the determination that the gaze position is less than a threshold distance from the first position, the engagement score is set to a first value; and Based on the determination that the distance between the gaze position and the first position is not less than the threshold distance, the engagement score is set to a second value that is less than the first value.

15. The method of claim 1, wherein the electronic device includes a depth sensor that provides depth data relative to the first portion of the media object, and wherein the engagement score is determined as a function based on the depth data.

16. The method according to claim 1, further comprising: In response to determining that the participation score has fallen below a threshold: Stop displaying the representation of the first portion of the media object; as well as An audio representation of the second portion of the media object is played via a speaker integrated in the electronic device, wherein the audio representation corresponds to spatial audio played as a function of the participation score.

17. An electronic device comprising: One or more processors; Non-transitory memory; One or more input devices; monitor; as well as One or more programs, wherein the one or more programs are stored in the non-transitory memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for the following operations: A representation of a first portion of a media object is displayed on the display, wherein the first portion of the media object is associated with a first resource utilization value, and wherein the first resource utilization value characterizes the utilization rate of the electronic device for a corresponding resource; The position change input is detected via the one or more input devices, wherein the position change input indicates that the electronic device changes from a first position to a second position; In response to detecting the location change input, an engagement score is determined, the engagement score representing the level of user engagement relative to the representation of the first portion of the media object, wherein: The engagement score corresponds to a first value based on the determination that the representation of the first portion of the media object is located at a first position on the display at a distance less than a threshold from the center of the display; Based on the determination that the representation of the first portion of the media object is located at a second position on the display at a distance from the center of the display not less than the threshold distance, the participation score corresponds to a second value less than the first value; and; Based on the determination that the representation of the first portion of the media object is not located on the display, the engagement score corresponds to a nominal value; and Based on the engagement score, the utilization rate of the corresponding resource is changed from a first resource utilization rate value to a second resource utilization rate value, wherein the second resource utilization rate value is associated with a second portion of the media object.

18. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display, one or more input devices, and one or more processors, cause the electronic device to: A representation of a first portion of a media object is displayed on the display, wherein the first portion of the media object is associated with a first resource utilization value, and wherein the first resource utilization value characterizes the utilization rate of the electronic device for a corresponding resource; The position change input is detected via the one or more input devices, wherein the position change input indicates that the electronic device changes from a first position to a second position; In response to detecting the location change input, an engagement score is determined, the engagement score representing the level of user engagement relative to the representation of the first portion of the media object, wherein: The engagement score corresponds to a first value based on the determination that the representation of the first portion of the media object is located at a first position on the display at a distance less than a threshold from the center of the display; Based on the determination that the representation of the first portion of the media object is located at a second position on the display at a distance from the center of the display not less than the threshold distance, the participation score corresponds to a second value less than the first value; and; Based on the determination that the representation of the first portion of the media object is not located on the display, the engagement score corresponds to a nominal value; and Based on the engagement score, the utilization rate of the corresponding resource is changed from a first resource utilization rate value to a second resource utilization rate value, wherein the second resource utilization rate value is associated with a second portion of the media object.

19. A computer program product comprising a computer program that, when executed by a processor, causes the processor to perform the method according to any one of claims 1-16.

Images