SYSTEM AND METHOD FOR ADAPTIVELY MODIFYING THE PRESENTATION OF MEDIA CONTENT - Patent application
The system addresses the issue of varying content clarity due to changing screen apparent size by dynamically adjusting the content's presentation based on the user's distance, ensuring a consistent and clear viewing experience.
Patent Information
- Application Number
- JP2021577430
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-02-28
- Filing Date
- 2020-12-29
- Publication Date
- 2025-05-23
- Estimated Expiration
- 2040-12-29
AI Technical Summary
The apparent size of a display screen changes as the user moves closer to or farther from it, affecting the viewing experience by varying the clarity of content.
A system that adaptively modifies the presentation of content based on the apparent size of the display screen, by calculating the apparent size using the actual size of the content area and the user's distance, and adjusting the zoom level and panning accordingly.
Improves the user's viewing experience by maintaining clear content visibility regardless of the user's distance from the screen, through dynamic adjustments to the content's presentation.
Smart Images

Figure 0007682111000005 
Figure 0007682111000006 
Figure 0007682111000007
Abstract
Description
Technical Field
[0001] The present disclosure relates to a content presentation system, and more particularly, to modifying the presentation of content based on the apparent size of a display screen.
Summary of the Invention
Means for Solving the Problems
[0002] Content is being consumed more and more in different settings using different devices. Many users watch video content more frequently on smartphones, tablets, or other mobile devices than on a television or other large-screen display device. The aspect ratio of a typical device with a rectangular display is 16:9. The size of the display area is often defined as the diagonal distance between the corners of the rectangle. When consuming content on a mobile device, the user can hold the mobile device at various distances from their eyes under different circumstances, and the distance can change over time as the user consumes the content. When the user consumes content on a television, they may not be sitting directly in front of the screen and may move around the room while consuming the content. Therefore, the apparent size of the screen can change as the distance of the user from the screen changes. This results in a viewing experience where the user's ability to clearly see what is happening in the content can vary with the distance from the screen.
[0003] Systems and methods are described herein for adaptively modifying the presentation of content in relation to a display device. The content is presented in a content area or display region associated with the display device, such as a media player window, that may not occupy the entire screen. The distance between a first user and the display device and the actual size of the content area in which the content is presented is determined. This may be based on one or more dimensions of the content area. Based on the distance and the actual size of the content area, an apparent size of the content area is calculated, and the presentation of the content is modified based on the apparent size of the content area. In some embodiments, modifying the presentation of the content involves modifying a zoom level of the content within the content area in which the content is displayed such that the user's distance from the screen is compensated for by enlarging the presented content. The amount by which the zoom level is modified may be inversely related to the distance or the apparent size of the content area. In effect, the distance is used to adjust the apparent size of the content area within the user's field of view.
[0004] In some embodiments, a ratio between the zoom level and the apparent size of the content area is calculated. When a change in the distance between the user and the display device is detected, a new distance between the user and the display device is determined and a new apparent size is calculated. The zoom level of the content is then modified by an amount determined to maintain the ratio between the zoom level and the apparent size of the content area.
[0005] The zoom level of the content may be modified, for example, by comparing the apparent size of the content area or display region to a first threshold size based on one or more of the dimensions of the content area and the distance of the user from the display device. If the apparent size is greater than or equal to the first threshold size, the zoom level of the content in the content area is set to a default zoom level. However, if the apparent size is less than the first threshold size, a difference between the apparent size and the first threshold size is determined, and the zoom level is increased by a zoom factor corresponding to the difference. Increasing the zoom level may involve determining a zoom level at which the apparent size of the content area matches the actual size of the content area, and modifying the zoom level of the content in the content area by the zoom factor.
[0006] The apparent size of the content area may be further compared to a second threshold size that is smaller than the first threshold size. If the apparent size is smaller than the second threshold size, the content is panned within the content area. Panning the content may involve identifying a spatial portion of the content that contains a current focus of the content and generating the spatial portion of the content for display within the content area. A zoom factor at which the spatial portion of the content fills more of the content area may also be determined, and the zoom level of the content is then modified by the zoom factor.
[0007] The step of identifying a spatial portion of the content that contains a current focus of the content may be accomplished by identifying a plurality of entities that appear in the content, and for each entity of the plurality of entities, determining a timestamp within the content at which the individual entity is a focus of the content. A current timestamp of the content is monitored, and if the current timestamp matches a timestamp at which an individual entity of the plurality of entities is a focus of the content, the spatial portion of the content at which the individual entity is displayed is selected.
[0008] In some embodiments, the step of modifying the zoom level of the content may be accomplished by identifying a plurality of entities displayed in the content and determining an individual importance level for each entity of the plurality of entities. A subset of the entities of the plurality of entities having an importance level higher than an importance threshold is then selected, and a set of coordinates describing the location and dimensions, such as width and height, of each entity of the subset of entities is determined. A smallest spatial portion of the content that contains all entities of the subset of entities is identified, and a zoom factor at which the smallest spatial portion of the content fills more of the content area is determined. The zoom level of the content within the content area is then modified by the zoom factor.
[0009] One way to accomplish the step of modifying the presentation of the content based on the apparent size is to determine the maximum size of the content area, determine the current apparent size of the content area, and compare the maximum size to the current size. If the current size of the content area is smaller than the maximum size of the content area, a size of the content area may be determined where the apparent size of the content area matches the actual size of the content area. The size of the content area is then increased to the determined size, and the zoom level of the content within the content area is modified by a zoom factor corresponding to the increased size of the content area. If the current size of the content area is already equal to the maximum size of the content area, the current focus of the content is determined, and a spatial portion of the content in which the identified entity is displayed is generated for display within the content area. The current focus of the content may be determined by comparing the current timestamp with the timestamp at which each entity is the current focus of the content as described above.
[0010] Another way to accomplish the step of modifying the presentation of the content in the content area based on the apparent size is to determine an ambient luminance level and compare it to a luminance threshold. If the ambient luminance level is below the luminance threshold, entities displayed in the content are identified and a spatial portion of the content in which each individual entity is displayed is determined. An entity of the entities that is currently the focus of the content is identified and the luminance of the spatial portion of the content in which the identified entity is not currently displayed is reduced.
[0011] Sometimes, multiple users may be viewing content together on a single display device. In some embodiments, a preference level for each user is determined and a preferred user is identified. For example, one user may have a higher preference level than other users. The presentation of the content is then modified based on the apparent size of the content area to the preferred user. In other embodiments, an individual distance between each user and the display device is determined and an individual apparent size is calculated for each user. Each individual apparent size is then compared to a size threshold and the presentation of the content is modified if the apparent size of the content area to any user is smaller than the size threshold. In some cases, the apparent size of the content area to more than one user may be smaller than the size threshold. If applicable, the smallest individual apparent size of the content area among the individual apparent sizes for each user is determined and the zoom level of the content is modified by the zoom factor corresponding to the smallest apparent size of the content area. The average apparent size among all users may also be used.
[0012] In some embodiments where multiple users are viewing together, a picture-in-picture (PIP) window may be generated for display. The PIP window may display at least a spatial portion of the content, and the zoom level of the content within the PIP window may be modified by a zoom factor that corresponds to the apparent size of the PIP window. In other embodiments, the PIP window may display the entire content, while the presentation of the content is modified within the main content area based on the apparent size of the content area. The present invention provides, for example, the following: (Item 1) 1. A method for adaptively modifying a presentation of content, the method comprising: Presenting content within a content area of a display device; determining a distance between a first user and the display device; determining an actual size of the content area in which the content is presented; calculating an apparent size of the content area based on an actual size of the content area and the distance between the first user and the display device; modifying the presentation of the content based on the apparent size of the content area; A method comprising: (Item 2) Item 13. The method of item 1, wherein modifying the presentation of the content based on the apparent size includes modifying a zoom level of the content. (Item 3) 3. The method of claim 2, wherein the amount by which the zoom level is modified is inversely proportional to the apparent size of the content area. (Item 4) calculating a ratio between the zoom level and the apparent size of the content area; Detecting a change in distance between the first user and the display device; in response to detecting a change in the distance; determining a second distance between the first user and the display device; calculating a second apparent size of the content area based on the actual size of the content area and the second distance; modifying the zoom level of the content by an amount determined to maintain the ratio between the zoom level and the apparent size of the content area; The method according to item 2 or 3, further comprising: (Item 5) Modifying the zoom level of the content includes: comparing the apparent size of the content area to a first threshold size; in response to determining that the apparent size is greater than or equal to the first threshold size, setting a zoom level of the content to a default zoom level; in response to determining that the apparent size is less than the first threshold size, determining a difference between the apparent size and the first threshold size; increasing the zoom level of the content by a zoom factor corresponding to the difference; and The method according to any one of Items 2 to 4, comprising: (Item 6) Increasing the zoom level of the content determining a zoom level at which the apparent size of the content matches the actual size of the content; modifying the zoom level of the content according to the zoom factor; The method according to item 5, comprising: (Item 7) comparing the apparent size of the content area to a second threshold size that is smaller than the first threshold size; panning the content within the content area in response to determining that the apparent size is less than the second threshold size based on the comparison; and 7. The method according to item 5 or 6, further comprising: (Item 8) Panning the content within the content area includes: identifying a spatial portion of the content that contains a current focus of the content; generating a spatial portion of the content within the content area for display; The method according to item 7, comprising: (Item 9) determining a zoom factor such that the spatial portion of the content fills the content area; modifying the zoom level of the content according to the zoom factor; The method according to any one of items 2 to 8, further comprising: (Item 10) 9. The method of claim 8, wherein the current focus comprises one of a character, an actor, a location, or a sound source. (Item 11) Identifying a spatial portion of the content that contains a current focus of the content includes: identifying a plurality of entities that appear in the content; determining, for each of the plurality of entities, a timestamp within the content at which the respective entity is a focus of the content; monitoring a current timestamp of said content; in response to determining that the current timestamp matches a timestamp at which an individual entity of the plurality of entities is a focus of the content, selecting a spatial portion of the content at which the individual entity is to be displayed; 11. The method according to any one of items 8 to 10, comprising: (Item 12) Modifying the zoom level of the content includes: identifying a plurality of entities that appear in the content; determining an individual importance level for each entity of the plurality of entities; selecting a subset of entities of the plurality of entities having an importance level above an importance threshold; determining a set of coordinates describing a position, a width, and a height of each entity in said subset of entities; identifying a smallest spatial portion of the content that contains all of the entities in the subset of entities; determining a zoom factor at which a minimal spatial portion of the content fills the content area; modifying the zoom level of the content according to the zoom factor; 12. The method according to any one of items 2-11, comprising: (Item 13) Modifying the presentation of the content based on the apparent size includes: determining a maximum size of the content area; Detecting a current size of the content area; comparing a current size of the content area with a maximum size of the content area; in response to determining, based on the comparison, that the current size of the content area is less than the maximum size of the content area; determining a size of the content area such that an apparent size of the content area matches an actual size of the content area; increasing a size of the content area to the determined size; modifying the zoom level of the content by a zoom factor corresponding to the increased size of the content area; 13. The method according to any one of items 1 to 12, comprising: (Item 14) in response to determining, based on the comparison, that the current size of the content area is equal to the maximum size of the content area; determining a current focus of a content item, said determining the current focus comprising: identifying a plurality of entities that appear in the content; determining, for each entity of the plurality of entities, a timestamp at which the respective entity is a focus of the content; monitoring a current timestamp of said content; in response to determining that the current timestamp matches a timestamp for which an individual entity of the plurality of entities is a focus of the content, identifying the individual entity and a current focus of the content; and generating for display only a spatial portion of the content in which the identified entity is displayed; and Item 14. The method of item 13, further comprising: (Item 15) Modifying the presentation of the content in the content area based on the apparent size includes: determining an ambient luminance level; comparing the ambient luminance level to a luminance threshold; in response to determining, based on the comparison, that the ambient luminance level is below the luminance threshold; identifying a plurality of entities that appear in the content; determining, for each entity of the plurality of entities, a spatial portion of the content in which the respective entity is to be displayed; identifying an entity of the plurality of entities that is currently a focus of the content; reducing the brightness of spatial portions of the content in which the identified entity is not currently being displayed; 15. The method according to any one of items 1 to 14, comprising: (Item 16) A plurality of users are viewing the content on a single display device, the method further comprising: determining a preference level for each of the plurality of users; identifying a preferred user, the preferred user having a highest preference level; Including, The user is the preferred user. 16. The method according to any one of items 1 to 15. (Item 17) multiple users viewing the content on a single display device; The method further comprises: determining, for each user of the plurality of users, a respective distance between the respective user and the display device; calculating, for each user, an individual apparent size of the content area based on the actual size of the content area and the individual distance of the individual user; comparing each user's individual apparent size to a size threshold; Including, modifying the presentation of the content is responsive to determining that the apparent size for at least one user is less than the size threshold. 17. The method according to any one of items 1 to 16. (Item 18) Modifying the presentation of the content includes: determining, for each individual user of the plurality of users, a smallest individual apparent size of the content area among the individual apparent sizes; modifying the zoom level of the content by a zoom factor corresponding to the smallest apparent size of the content area; Item 18. The method according to item 17, comprising: (Item 19) Modifying the presentation of the content includes: calculating, for each individual user of the plurality of users, an average apparent size of the content area based on the individual apparent sizes; modifying a zoom level of the content based on an average apparent size of the content area; 19. The method according to item 17 or 18, comprising: (Item 20) Modifying the presentation of the content includes: generating at least a spatial portion of the content for display within a picture-in-picture window; modifying a zoom level of at least a spatial portion of the content by a zoom factor corresponding to an apparent size of the picture-in-picture window; 20. The method according to any one of items 17-19, comprising: (Item 21) Modifying the presentation of the content includes: generating said content for display within a picture-in-picture window; modifying the zoom level of the content by a zoom factor corresponding to the apparent size of the content area; 21. The method according to any one of items 17-20, comprising: (Item 22) 22. A system for adaptively modifying a presentation of content, the system comprising a control circuit configured to perform the method according to any of items 1-21. (Item 23) 22. A non-transitory computer-readable medium having non-transitory computer-readable instructions encoded thereon that, when executed by control circuitry, adaptively modify presentation of content to cause the control circuitry to perform a method according to any of items 1-21. [Brief description of the drawings]
[0013] The above and other objects and advantages of the present disclosure will become apparent upon consideration of the following detailed description taken in conjunction with the accompanying drawings in which like reference characters refer to like parts throughout.
[0014] [Figure 1] FIG. 1 is an illustrative drawing showing that users at different distances from a display screen perceive different apparent sizes of the display screen, in accordance with some embodiments of the present disclosure.
[0015] [Diagram 2] FIG. 2 illustrates a portion of a user's field of view occupied by a display screen from a given distance, according to some embodiments of the present disclosure.
[0016] [Diagram 3] FIG. 3 illustrates the difference in the portion of a user's field of view occupied by a mobile device when held at different distances from the user, according to some embodiments of the present disclosure.
[0017] [Figure 4]FIG. 4 illustrates modifying the presentation of content by modifying the zoom level of the content, according to some embodiments of the present disclosure.
[0018] [Diagram 5] FIG. 5 illustrates modifying the presentation of content by both modifying the zoom level of the content and panning the content to show only the current focus of the content, according to some embodiments of the present disclosure.
[0019] [Figure 6] FIG. 6 illustrates modifying the presentation of content by increasing the size of the content area in which the content is displayed, according to some embodiments of the present disclosure.
[0020] [Figure 7] FIG. 7 illustrates modifying the presentation of content by reducing the brightness of portions of the content that are not the focus of the content, according to some embodiments of the present disclosure.
[0021] [Figure 8] FIG. 8 illustrates two users viewing content on a single display device from different distances, according to some embodiments of the present disclosure.
[0022] [Figure 9] FIG. 9 illustrates modifying the presentation of content by displaying a PIP window that displays the content at an increased zoom level, according to some embodiments of the present disclosure.
[0023] [Figure 10] FIG. 10 illustrates modification of the presentation of content by displaying a PIP window that displays content at a default zoom level while the main content area displays content at an increased zoom level, in accordance with some embodiments of the present disclosure.
[0024] [Figure 11] FIG. 11 illustrates detection of multiple entities displayed in content according to some embodiments of the present disclosure and modifying the presentation of the content by setting the zoom level of the content in the content area to a level at which the detected entities are displayed.
[0025] [Figure 12] FIG. 12 is a block diagram representing components of a system and the data flow between them, according to some embodiments of the disclosure.
[0026] [Figure 13] FIG. 13 is a flowchart depicting a process for modifying the presentation of content in a content area of a display device according to some embodiments of the disclosure.
[0027] [Figure 14] FIG. 14 is a flowchart depicting a process for modifying the zoom level of content in a content area of a display device according to some embodiments of the disclosure.
[0028] [Figure 15] FIG. 15 is a flowchart depicting a second process for modifying the zoom level of content within a screen portion of a display device according to some embodiments of the disclosure.
[0029] [Figure 16] FIG. 16 is a flowchart depicting a process for determining a spatial portion of content in which an entity that is the current focus of the content is displayed, according to some embodiments of the disclosure.
[0030] [Figure 17]FIG. 17 is a flowchart illustrating a process for modifying the zoom level of content in a content area to accommodate multiple entities displayed in the content according to some embodiments of the disclosure.
[0031] [Figure 18] FIG. 18 is a flowchart depicting a process for modifying the presentation of content in a content area of a display device based on a current size of the content area and a maximum size of the content area according to some embodiments of the disclosure.
[0032] [Figure 19] FIG. 19 is a flowchart depicting a process for modifying the presentation of content in a content area of a display device based on ambient luminance according to some embodiments of the disclosure.
[0033] [Figure 20] FIG. 20 is a flowchart depicting a process for modifying the presentation of content within a content area of a display device based on the apparent size of the content area to a preferred user, according to some embodiments of the disclosure.
[0034] [Figure 21] FIG. 21 is a flowchart depicting a process for modifying the presentation of content within a screen portion of a display device when multiple users are viewing the display device, according to some embodiments of the disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0035] A typical display screen for a display device such as a television, smartphone, tablet, etc. is a rectangle with a side aspect ratio of 16:9. As a user moves closer to or farther from the display screen, the apparent size of the display screen to the user changes but maintains the same shape. As used herein, "apparent size" refers to the angular size or viewing angle of an object, defined as the portion of a sphere occupied by the object. As the user's distance from an object increases, the object's dimensions appear to decrease as the percentage of the user's field of view occupied by the object decreases. This difference is measured as an angle, or as an arc length relative to a spherical projection of the user's field of view. FIG. 1 shows a display device 100 and a first user 102 separated by a first distance 104. The apparent size of the display device 100 to the first user 102 is the angle 106 of the first user's field of view occupied by the display device 100. For a second user 108 who is separated from the display device 100 by a second, greater distance 110 , the apparent size of the display device 100 to the second user 108 is at an angle 112 which is less than angle 106 .
[0036] FIG. 2 is a three-dimensional diagram further illustrating a portion of a user's field of view occupied by a display device 100. The user 200 has a field of view 202. The apparent size of the display device 100 to the user 200 is a solid angle 204 that is a projection of the surface of the display device 100 as viewed by the user 200, projected onto the spherical field of view 202 of the user 200. FIG. 3 shows another three-dimensional diagram illustrating how the percentage of the user's field of view occupied by the display device decreases as the distance between the user and the display device increases. The user 300 has a field of view 302 and is holding a mobile device 304 that includes a rectangular display screen. When the mobile device 304 is closer to the user 300, the apparent size 306a of the mobile device is relatively large and occupies a significant percentage of the field of view 302 of the user 300. However, when the mobile device 304 is at a greater distance from the user 300 , the apparent size 306 b of the mobile device 304 is much smaller and occupies a reduced proportion of the field of view 302 of the user 300 .
[0037] As the apparent size of a display device decreases, i.e., the display content area occupies an increasingly smaller percentage of the field of view, the user's ability to see details of the media content decreases. To improve the user's viewing experience, the presentation of the content may be modified based on the apparent size of the content as determined by the distance between the user and the device. Figures 4-7 illustrate various modifications of the presentation of the content in response to a decrease in apparent size. Although not shown, one skilled in the art will understand that the modifications shown in Figures 4-7 and described below may be implemented in reverse in response to an increase in apparent size, at least until the presentation of the content returns to its default state.
[0038] FIG. 4 illustrates a first modification of the presentation of content. Content 400 is displayed in a content area of a display device. In response to a detected increase in the distance between the display device and the user, an apparent size of the content area on the display device is calculated. If the apparent size of the content area falls below a threshold size or below a threshold percentage of the actual size of the content area, a zoom factor is calculated so that features in the content occupy a larger percentage of the user's field of view and appear larger. The zoom factor is then applied to the content, and the modified content 402 is then presented in the content area. However, the content can only be zoomed a finite amount before the video resolution is affected. As illustrated in FIG. 5, the presentation of the content can be further modified to pan the content. In other words, spatial portions of the content can be selectively output or cropped to show only the focus of the content at a given time. For example, content 500 showing two characters having a conversation may be displayed in the content area. In response to the apparent size of the content area falling below a second threshold, the content is panned so that a first spatial portion 502 is shown when a character depicted in the first spatial portion is speaking and a second spatial portion 504 is shown when a character depicted in the second spatial portion is speaking.
[0039] In some cases, the content area may not occupy the entirety of the screen area on a display device. For example, as shown in FIG. 6, the display device 600 may be a mobile device. Many mobile devices allow users to multitask by minimizing the area of the display screen 602 occupied by a content application (e.g., Netflix, Hulu, YouTube®) while interacting with another application. In another example, a user may activate an interactive program guide while watching content on a television where the guide is presented on most of the screen while the currently playing content is shown in a small area of the screen. If the apparent size of the content area 604 falls below a threshold size or below a threshold percentage of the actual size of the content area, the size of the content area may be increased 606 and the content may be zoomed proportionately to maintain the apparent size of the content area at least at the actual size of the content area until the content area occupies the entirety of the display screen.
[0040] Increasing the size of the content area and the corresponding zoom operation may be limited based on the quality of the content. For example, if the content is high definition (HD) video with a resolution of 1,080 x 720 pixels, a zoom level of 2.5 may begin to distort, pixelate, or otherwise degrade the content's video. However, if the content is ultra high definition (UHD) video with a resolution of 3,840 x 2,160 pixels, the content may still be acceptably clear or undistorted at a zoom level of 2.5 or higher. For streaming content, the quality of the content may vary depending on network conditions such as available bandwidth. If a zoom level higher than the maximum zoom level for video quality is required, other modifications of the content may also be used in combination with the maximum zoom level.
[0041] In another example illustrated in Figure 7, the presentation of the content 700 may be modified by reducing the luminance of spatial portions of the content that do not contain the content focus. If the apparent size of the content area is below a threshold size or below a threshold percentage of the actual size of the content window, an ambient luminance level is determined. If the ambient luminance level is below the luminance threshold, the spatial portion of the content that contains the current focus of the content is identified and the presentation of the content is modified 702 by reducing the luminance of all spatial portions of the content that do not contain the current focus of the content.
[0042] FIG. 8 illustrates an embodiment in which more than one user is viewing content simultaneously on a single display device 800. User P1 802 may be located at a distance 804 from the display device 800, while user P2 806 may be located at a greater distance 808 from the display device 800. Thus, the display device 800, and therefore the content area displayed thereon, will have a larger apparent size for P1 802 than for P2 806. Modification of the presentation of the content may take into account both apparent sizes. For example, the presentation of the content may be modified based on an average apparent size between users P1 802 and P2 806. Alternatively, one of the users may have a higher priority than the other. For example, P1 may be the primary user of the display device 800, while P2 is a guest. Thus, P1 may have a higher priority than P2. As another example, P1 may be the parent of P2 and therefore have a higher priority than P2. The apparent size of the display device 800 to user P1 802 may therefore be given more weighting than that of P2 806 even though P2 806 is further away from the display device 800. In some cases, the apparent size of the display device 800 for the highest priority user may be the only apparent size considered in modifying the presentation of content.
[0043] Another example of modifying the presentation of content for more than one user to view simultaneously on the same display device is the use of a PIP window. FIG. 9 shows a content area 900 that normally displays content. If the apparent size of the content area 900 is below a threshold size or below a threshold percentage of the actual size of the content area 900 for one of the multiple users viewing the content, a PIP window 904 may be generated for display. While a composite display is presented in the content area 902 that continues to display the content without modification, the PIP window 904 displays the content with a zoom ratio applied. FIG. 10 shows a content area 1000 that normally displays content, and in response to the apparent size of the content area being below the threshold, the presentation of the content is modified within the content area 1002 where the zoom ratio is applied to the content while a PIP window 1004 is generated for display and presents the content without modification.
[0044] If one or more entities depicted in the content are the current focus of the content, the zoom factor may be calculated so that as many of those entities as possible can fit within the content area. The content may also be panned to center the entities within the content area. FIG. 11 illustrates detection of multiple entities displayed in the content and modifying the presentation of the content by setting the zoom level of the content area to a level at which the detected entities are displayed. The content is displayed in a content area 1100, and entities 1102, 1104, and 1106 are depicted therein. Using image processing techniques (e.g., edge detection, object recognition), a set of coordinates is determined that identifies bounding boxes 1108, 1110, and 1112 that correspond to the location of each depicted entity. The smallest area 1114 that contains the entities 1102, 1104, and 1106 is determined. A small buffer zone is added to each side of the area 1114, resulting in a space portion 1116. A zoom factor is then calculated to fit the spatial portion 1116 to the size of the content area. The actual size of the spatial portion 1116 may be adjusted to maintain the original proportions or aspect ratio of the content so as not to distort the content. The spatial portion 1116 is then displayed in the content area 1118.
[0045] FIG. 12 is a block diagram depicting components of a system and data flows therebetween, according to some embodiments of the disclosure. Media content is received 1200 from a content source by control circuitry 1202. Control circuitry 1202 comprises control circuitry and memory circuitry, which may be based on any suitable processing circuitry and may be located on a single integrated circuit or may be discrete components. As referred to herein, processing circuitry should be understood to mean circuitry based on one or more microprocessors, microcontrollers, digital signal processors, programmable logic devices, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), etc., and may include multi-core processors (e.g., dual-core, quad-core, hexa-core, or any suitable number of cores). In some embodiments, the processing circuitry may be distributed across multiple separate processors or processing units, for example multiple processing units of the same type (e.g., two Intel Core i7 processors) or multiple different processors (e.g., an Intel Core i5 processor and an Intel Core i7 processor).
[0046] Media circuitry 1204 of control circuitry 1202 receives, decodes, and otherwise processes the media content for output. Audio data of the content is extracted 1206 from the media content and forwarded to output circuitry 1208 for output to an audio output device, such as a speaker. Video data of the content is separately transmitted 1210 to video processing circuitry 1212. Video processing circuitry 1212 may include any suitable video decoding and encoding circuitry, as well as image processing and editing circuitry for affecting modifications to the presentation of the video content.
[0047] The user detection circuit 1214 detects users viewing the media content. The user detection circuit may include a camera, one or more infrared sensors, one or more ultraviolet sensors, or any other suitable sensor. The user detection circuit 1214 further determines the distance between the sensor and each user. For example, the user detection circuit 1214 may include an infrared emitter and an infrared receiver configured to determine the distance of an object based on the time required for an emitted pulse to be reflected back toward the receiver and detected thereby. Once the distance of each user is determined, the distance is transmitted 1216 to the apparent size calculation circuit 1218. The apparent size calculation circuit 1218 calculates the apparent size S of the content area for each user using the following formula: [ka] where d is the actual size of the content area and D is the distance to the user. Thus, the apparent size of the content area to a given user is a function of that user's distance from the content area and the actual size of the content area. To determine the actual size of the content area, the apparent size calculation circuit 1218 transmits 1220 a request to memory 1222 to retrieve the specifications of the display screen associated with the content area and the current size of the content area. Typically, this would be a pair of dimensions of a rectangular display with a 16:9 aspect ratio or a diagonal dimension across the screen. Other methods of defining the actual size of the content area, such as the area it occupies, can also be used. The apparent size calculation circuit 1218 receives 1224 the size information from memory 1222 and performs an apparent size calculation for each user based on the received size information. If the apparent size of the content area to the user falls below a threshold size or falls below a threshold percentage of the actual size of the content area, the apparent size calculation circuit 1218 transmits 1226 a signal to the video processing circuit 1212 to modify the presentation of the content based on the apparent size of the content area. The video processing circuit 1212 may modify the presentation of the content by applying a zoom factor to the content, or by selecting a spatial portion of the content for display, or both. Methods for modifying the presentation of the content are described in detail below in connection with FIGS. 13-25.
[0048] The apparent size calculation circuit 1218 may also transmit 1230 a signal to the content area control circuit 1232 to change the size of the content area. The content area control circuit 1232 manages the size of the content area relative to the size of the entire display screen on which the content area is displayed. In response to receiving a signal from the apparent size calculation circuit 1218, the content area control circuit 1232 may modify the size and / or position of the content area within the display screen on which it is displayed. The content area control circuit 1232 may transmit a request 1234 to the memory 1222 to read the specifications of the display screen associated with the content area. The content area control circuit 1232 receives 1236 the specifications from the memory 1222 and compares the current size of the content area with the size of the display screen. If the current size of the content area is smaller than the size of the display screen, the content area control circuit 1232 may increase the size of the content area as necessary until at least one dimension of the content area reaches the maximum corresponding dimension of the display screen.
[0049] The content area control circuit 1232 transmits 1238 the content area size parameters to the output circuit 1208. The output circuit 1208 combines the video of the content as processed by the video processing circuit 1212 with the content area parameters received from the content area control circuit 1232 to generate a video signal for output to a display screen. The output circuit 1208 then outputs 1240 the audio of the content to an audio output device and the modified video of the content to the display screen.
[0050] 13 is a flow chart depicting an illustrative process 1300 for modifying the presentation of content in a content area of a display device in accordance with some embodiments of the disclosure. The process 1300 may be implemented on the control circuitry 1202. In addition, one or more actions of the process 1300 may be incorporated into or combined with one or more actions of any other process or embodiment described herein.
[0051] At 1302, the control circuitry 1202 presents content on a screen of a display device. Media content is received by the control circuitry 1202 using the media circuitry 1204. The media data is passed unaltered to the output circuitry 1208 where it is generated for output to a user. Audio is output to a speaker or other audio device and video is output to a display screen.
[0052] At 1304, the control circuit 1202 determines a distance between the first user and the display device. The control circuit 1202 detects the first user using the user detection circuit 1214. The user detection circuit 1214 detects the presence of the first user and determines the distance between the first user and the display device using an infrared sensor, an ultraviolet sensor, a camera, or the like. At 1306, the control circuit 1202 determines an actual size of a content area in which content is presented on the display screen. The content area may not occupy the entire screen. The control circuit 1202 reads from the memory 1222 the current settings for the content area, including the specifications of the display screen and its dimensions. At 1308, the control circuit 1202 calculates an apparent size of the content area using the distance between the first user and the display device and the actual size of the content area. The apparent size calculation circuit 1218 may input the determined distance and actual size into Equation 1 above to calculate the apparent size of the content area. At 1310, based on the apparent size of the content area, the control circuit 1202 uses the video processing circuit 1212 and the content area control circuit 1232 to modify the presentation of the content using methods described below.
[0053] The actions or descriptions of Figure 13 may be used in conjunction with any other embodiment of the present disclosure. In addition, the actions and descriptions described in connection with Figure 13 may be performed in any suitable alternate order or in parallel so as to further the objectives of the present disclosure.
[0054] 14 is a flow chart depicting an illustrative process 1400 for modifying a zoom level of content in a content area of a display device in accordance with some embodiments of the disclosure. The process 1400 may be implemented on the control circuitry 1202. In addition, one or more actions of the process 1400 may be incorporated into or combined with one or more actions of any other process or embodiment described herein.
[0055] At 1402, the control circuit 1202 calculates a ratio between the zoom level of the content area and the apparent size of the content area. For example, the content area may be the entirety of a 50-inch television screen. The content area may also have a default zoom level of 1. If the user is positioned at a distance of 10 feet from the display screen, the content area will have an apparent size of approximately 0.41 radians. Thus, the ratio of zoom level to content area is 1:0.41. The zoom level is also inversely related, e.g., inversely proportional, to the apparent size of the content area. In this embodiment, the control circuit 1202 calculates a proportionality constant based on this ratio using the following formula: [ka] where z is the zoom level and a is the apparent size of the content area. In this embodiment, the proportionality constant K has a value of 0.41. At 1404, the control circuit 1202 determines whether the distance between the first user and the display screen has changed. For example, the control circuit 1202 may receive a signal from the user detection circuit 1214 indicating that the user has moved. If so, then at 1406, the control circuit 1202 determines a second distance between the first user and the display device, and at 1408, calculates a second apparent size of the content area based on the actual size of the content area and the second distance. At 1410, the control circuit 1202 modifies the zoom level of the content in the content area by an amount determined to maintain the ratio between the zoom level and the apparent size of the content area. The control circuit 1410 uses the proportionality constant K to determine a zoom level at which the apparent size of the content displayed in the content area will remain the same. For example, if a first user moves farther from the display screen, from 10 feet to 12 feet, the apparent size of the content area at this distance will be approximately 0.34 radians. The zoom level required to maintain the previous apparent size of 0.41 radians can be calculated using the following rearrangement of Equation 2 above: [ka] Using a previously calculated proportionality constant K of 0.41 and a new apparent size a of the content area of 0.34, control circuit 1202 calculates that a zoom level z of 1.2 is required to maintain the apparent size of the content displayed in the content area.
[0056] The actions or descriptions of Figure 14 may be used in conjunction with any other embodiment of the present disclosure. In addition, the actions and descriptions described in connection with Figure 14 may be performed in any suitable alternate order or in parallel so as to further the objectives of the present disclosure.
[0057] FIG. 15 is a flowchart depicting a second illustrative process 1500 for modifying the zoom level of content within a screen portion of a display device, according to some embodiments of the present disclosure. Process 1500 may be implemented on control circuit 1202. Additionally, one or more actions of process 1500 may be incorporated into, or combined with, one or more actions of any other process or embodiment described herein.
[0058] At 1502, the control circuitry 1202 determines whether the apparent size of the content area is less than a first threshold size. A slight change in the distance between the first user and the display screen may not warrant a modification to the presentation of the content. The apparent size of the content is therefore compared to the threshold size. For example, the threshold size may be 0.4 radians. If the content area is the entirety of a 50-inch television screen and the user is positioned 8 feet from the television screen, the apparent size of the television screen will be approximately 0.51 radians, which is above the threshold. If the user moves to a distance of 10 feet, the apparent size of the television screen will be approximately 0.41 radians, which is above the threshold size. If the current apparent size of the content area is at or above the threshold size ("No" at 1502), at 1504, the control circuitry 1202 sets the zoom level of the content in the content area to a default zoom level, such as a zoom level of 1. If the user moves further away from the television screen, such as to a distance of 10.5 feet, the apparent size of the television screen will be below the threshold size, approximately 0.39 radians. If this occurs, at 1506, the control circuit 1202 compares the apparent size of the content area to a second threshold size, such as 0.25 radians, which is less than the first threshold size. If the apparent size is at or above the second threshold size, as in this example ("No" at 1506), at 1508, the control circuit 1202 determines the difference between the apparent size and the first threshold size, and at 1510 increases the zoom level of the content in the content area by a zoom factor that corresponds to the difference in size. In this example, the difference between the first threshold size and the apparent size is 0.01 radians. The control circuit 1202 may calculate a zoom factor that increases the apparent size of the content area by the same amount.
[0059] If the apparent size is less than the second threshold size ("Yes" at 1506), then at 1512 the control circuit 1202 identifies the spatial portion of the content that contains the current focus of the content. This may be accomplished using the methods described below in connection with Figures 16 and 17. At 1514, the control circuit 1202 generates the spatial portion of the content within the content area for display. For example, the control circuit 1202 may use the video processing circuit 1212 to crop each frame of the video to contain only the identified spatial portion. At 1516, the control circuit 1202 determines a zoom factor at which the spatial portion of the content fills the content area. This may be accomplished in a manner similar to that in which the zoom level is calculated above in connection with Figure 14. For example, a proportionality constant may be calculated based on the actual size of the content area and the actual size of the spatial portion. This constant is then used to determine a zoom level at which the spatial portion fills the content area. At 1518, the control circuit 1202 modifies the zoom level of the content in the content area by the determined zoom factor.
[0060] The actions or descriptions of Figure 15 may be used in conjunction with any other embodiment of the present disclosure. In addition, the actions and descriptions described in connection with Figure 15 may be performed in any suitable alternate order or in parallel so as to further the objectives of the present disclosure.
[0061] 16 is a flowchart depicting an illustrative process 1600 for determining a spatial portion of content in which an entity that is a current focus of the content is displayed, according to some embodiments of the disclosure. Process 1600 may be implemented on control circuitry 1202. In addition, one or more actions of process 1600 may be incorporated into or combined with one or more actions of any other process or embodiment described herein.
[0062] At 1602, the control circuitry 1202 identifies a plurality of entities appearing in the content. For example, the control circuitry 1202 uses the video processing circuitry 1212 to perform edge detection, object recognition, face recognition, or any other image processing technique to identify the entities appearing in the content. At 1604, the control circuitry 1202 determines, for each entity of the plurality of entities, a timestamp within the content at which the respective entity is a focus of the content. For example, the control circuitry 1202 may access metadata for the content item that describes each entity within the content and includes a timestamp at which each entity is a focus of the content.
[0063] At 1606, the control circuitry 1202 monitors the current timestamp of the content. For example, the control circuitry 1202 may keep a counter running from the beginning of the content item. Alternatively, the content item may contain a timestamp that may be accessed and / or read by the control circuitry 1202. At 1608, the control circuitry 1202 determines whether the current timestamp of the content matches a timestamp at which an individual entity of the plurality of entities is the focus of the content. For example, the control circuitry 1202 may compare the current timestamp to the timestamp determined above. If the current timestamp matches a timestamp at which the entity is the focus of the content, at 1610, the control circuitry 1202 selects a spatial portion of the content in which the individual entity is to be displayed. For example, the control circuitry 1202 may perform object or face recognition to determine a spatial portion of the content in which the entity is to be displayed. Alternatively, the metadata of the content may include coordinates and / or motion vectors for each entity in the content along with the timestamp information. Control circuitry 1202 may access the metadata, determine the coordinates of the entity, and select a portion of space that, at a minimum, contains the coordinates of the entity.
[0064] The actions or descriptions of Figure 16 may be used in conjunction with any other embodiment of the present disclosure. In addition, the actions and descriptions described in connection with Figure 16 may be performed in any suitable alternate order or in parallel so as to further the objectives of the present disclosure.
[0065] 17 is a flow chart depicting an illustrative process 1700 for modifying the zoom level of content in a content area to accommodate multiple entities displayed in the content, in accordance with some embodiments of the disclosure. Process 1700 may be implemented on control circuitry 1202. Additionally, one or more actions of process 1700 may be incorporated into or combined with one or more actions of any other process or embodiment described herein.
[0066] At 1702, the control circuitry 1202 identifies a plurality of entities that appear in the content. This may be accomplished using the method described above in connection with FIG. 16. At 1704, the control circuitry 1202 determines an individual importance level for each entity of the plurality of entities. For example, the control circuitry 1202 may determine whether an entity appears in the background or foreground of the content. Foreground entities may have higher importance than background entities. Additionally or alternatively, the control circuitry 1202 may determine whether an entity is in focus or out of focus and determine the sharpness of the entity's edges, for example, by using edge detection techniques. In-focus entities may have higher importance than out-of-focus entities. Entity size, color variation, level of detail, and entity movement may also be considered in determining the importance of each entity. The control circuitry 1202 may also access metadata of the content that describes the importance of each entity at a given timestamp within the content, or that describes a storyline of the content that includes mention of a particular entity. Another method of determining entity importance is through the use of audio recognition. If an entity does not make any sounds it is likely to be of low importance, whereas an entity that makes an audible sound is likely to be of at least some importance. This importance level will be increased if the same entity makes sounds in more than one piece of content.
[0067] At 1706, the control circuit 1202 initializes a counter variable N and sets its value to 1, a variable T represents the total number of entities currently displayed in the content, and a list, array, or other data structure {K} holds a list of important entities. At 1708, the control circuit 1202 determines whether the importance level of the Nth entity is higher than a threshold importance level. For example, each entity may have an importance level from 1 to 10, and the threshold importance level may be 7. If the entity has an importance level higher than the threshold importance level ("Yes" at 1708), then at 1710, the control circuit 1202 adds the Nth entity to {K}. After adding the Nth entity to {K}, or if the importance level of the Nth entity is not higher than the threshold importance level, at 1712, the control circuit 1202 determines whether N is equal to T, meaning that all currently displayed entities have been processed. If N is not equal to T (“NO” at 1712 ), then at 1714 the control circuit increments the value of N by 1 and processing returns to step 1708 .
[0068] If N is equal to T (YES at 1712), then at 1716 the control circuit 1202 initializes a second counter variable M and sets its value to 1, and the control circuit 1202 increments the second counter variable T Krepresents the number of entities in {K}. At 1718, the control circuit 1202 determines a set of coordinates describing the position, width, and height of the Mth entity in {K}. For example, the control circuit 1202 may use object recognition, face recognition, edge detection, or other image processing techniques to identify the top, bottom, leftmost, and rightmost pixels of the Mth entity. By taking the smallest vertical coordinate of any pixel and the smallest horizontal coordinate of any pixel, the control circuit 1202 can identify the top left corner of a box that encloses the Mth entity. The largest vertical and horizontal coordinates taken together can be used to identify the bottom right corner of the box, the smallest horizontal coordinate together with the largest vertical coordinate can identify the bottom left corner of the box, and the smallest vertical coordinate together with the largest horizontal coordinate can identify the top right corner of the box. At 1720, the control circuit 1202 determines whether M is T, meaning that coordinates have been determined for all entities in {K}. K Determine whether M is equal to T K If not (NO at 1720 ), then at 1722 , the control circuit 1202 increments the value of M by 1 and processing returns to step 1718 .
[0069] M, T KIf so ("Yes" at 1720), then at 1724 the control circuit 1202 identifies the smallest spatial portion of the content that will contain all of the entities in {K}. For example, the control circuit may use the most extreme horizontal and vertical coordinates of each entity in {K} to define a spatial portion that includes all of the entities in {K}. A buffer area may be added to the spatial portion in each direction to ensure that none of the entities are partially clipped from the spatial portion. At 1726, the control circuit 1202 determines a zoom factor at which the smallest spatial portion of the content will fill the content area. For example, the control circuit 1202 may calculate a zoom factor that increases the size of the spatial portion to match the size of the content area. If the spatial portion does not have the same aspect ratio as the content area, a zoom factor may be calculated such that the largest dimension of the spatial portion fills the corresponding dimension of the content area. At 1728, the control circuit 1202 modifies the zoom level of the content in the content area by the determined zoom factor.
[0070] The actions or descriptions of Figure 17 may be used in conjunction with any other embodiment of the present disclosure. In addition, the actions and descriptions described in connection with Figure 17 may be performed in any suitable alternate order or in parallel so as to further the objectives of the present disclosure.
[0071] 18 is a flowchart depicting an illustrative process 1800 for modifying presentation of content in a content area of a display device based on a current size of the content area and a maximum size of the content area, in accordance with some embodiments of the disclosure. Process 1800 may be implemented on control circuitry 1202. Additionally, one or more actions of process 1800 may be incorporated into or combined with one or more actions of any other process or embodiment described herein.
[0072] At 1802, the control circuit 1202 determines the maximum size of the content area. For example, the control circuit 1202 reads from the memory 1222 the specifications of the display screen on which the content area is to be displayed. The control circuit 1202 may also read information regarding other on-screen elements that are configured to remain visible at all times. From the read information, the control circuit 1202 may determine the portion of the display screen that may be occupied by the content area, whether all or less than all of it may be occupied by the content area. At 1804, the control circuit 1202 detects the current size of the content area. For example, the control circuit 1202 may read from the memory 1222 the settings for a video application through which a content window is currently being generated. The control circuit 1202 may alternatively or additionally request size information from the content area control circuit 1232. At 1806, the control circuit 1202 determines whether the current size of the content area is less than the maximum size of the content area, for example, by subtracting the current size from the maximum size. If the difference between the maximum size and the current size is greater than zero, the current size of the content area is less than the maximum size of the content area.
[0073] If the current size is less than the maximum size ("Yes" at 1806), then at 1808 the control circuitry 1202 determines a size of the content area where the apparent size of the content area matches the current actual size of the content area. For example, the control circuitry 1202 may determine the current actual size of the content area in radians by calculating a theoretical apparent size from an optimal viewing distance. The control circuitry 1202 may then calculate a new size of the content area where the apparent size of the content area at the user's current distance matches the apparent size of the content area at the optimal viewing distance. If the current size of the content area occupies a portion of a television screen with the same aspect ratio as a television screen and a diagonal of 50 inches, and the optimal viewing distance is 10 feet, then the apparent size at the optimal viewing distance is 0.41 radians. By manipulating Equation 1 above, the sizes at which the content area would have the same apparent size at different distances can be determined as follows: [ka] In the formula, d target is the apparent size relative to the actual size at the optimal viewing distance (a optimal ), where D is the user's current distance from the display screen. Thus, if the user is currently 12 feet from the display screen, the content area would need to have a diagonal dimension of approximately 60 inches to maintain an apparent size of 0.41 radians. At 1810, control circuit 1202 increases the size of the content area to the determined target size using content area control circuit 1232. At 1812, control circuit 1202 modifies the zoom level of the content within the content area by a magnification factor corresponding to the increased size of the content area. This may be accomplished using the method described above in connection with FIG. 17.
[0074] If the current size of the content area is already at the maximum size of the content area ("NO" at 1806), then the control circuitry 1202 identifies at 1814 a plurality of entities to be displayed in the content, and for each entity of the plurality of entities, determines at 1816 a timestamp within the content at which the respective entity is a focus of the content. The control circuitry 1202 then monitors at 1818 the current timestamp of the content, and if at 1820 it is determined that the current timestamp of the content matches a timestamp at which the entity is a focus of the content, then at 1822 the control circuitry 1202 generates for display the spatial portion of the content in which the identified entity is displayed. This may be accomplished using the method described above in connection with FIG.
[0075] The actions or descriptions of Figure 18 may be used in conjunction with any other embodiment of the present disclosure. In addition, the actions and descriptions described in connection with Figure 18 may be performed in any suitable alternate order or in parallel so as to further the objectives of the present disclosure.
[0076] 19 is a flow chart depicting an illustrative process 1900 for modifying the presentation of content in a content area of a display device based on ambient luminance, according to some embodiments of the disclosure. Process 1900 may be implemented on control circuitry 1202. In addition, one or more actions of process 1900 may be incorporated into or combined with one or more actions of any other process or embodiment described herein.
[0077] At 1902, the control circuitry 1202 determines an ambient brightness level. For example, the control circuitry may include or communicate with a light sensor or other component that generates a variable signal based on the amount of light received by the component. At 1904, the control circuitry 1202 determines whether the ambient brightness level is below a brightness threshold, such as 50 lux. If the ambient brightness is below the brightness threshold, at 1906, the control circuitry 1202 identifies multiple entities displayed in the content. This may be accomplished using the methods described above in connection with FIG.
[0078] At 1908, the control circuit 1202 initializes a counter variable N and sets its value to 1, and the variable T represents the number of entities displayed in the content. At 1910, the control circuit 1202 determines the spatial portion of the content in which the Nth entity is displayed. For example, the control circuit 1202 may use edge detection and generate a path that encompasses the Nth entity. At 1912, the control circuit 1202 determines whether N is equal to T, meaning that all entities displayed in the content have been processed. If N is not equal to T ("No" at 1912), then at 1914 the control circuit 1202 increments the value of N by 1 and processing returns to step 1910. If N is equal to T ("Yes" at 1912), then at 1916 the control circuit 1202 identifies an entity of the plurality of entities that is currently the focus of the content. This may be accomplished using the method described above in connection with FIG. 16. At 1918, control circuitry 1202 reduces the brightness of spatial portions of the content in which the identified entity is not currently displayed. For example, control circuitry 1202 may use video processing circuitry 1212 to alter the brightness data for each pixel of the content that does not fall within an area bounded by the path representing the entity that is the current focus of the content.
[0079] The actions or descriptions of Figure 19 may be used in conjunction with any other embodiment of the present disclosure. In addition, the actions and descriptions described in connection with Figure 19 may be performed in any suitable alternate order or in parallel so as to further the objectives of the present disclosure.
[0080] 20 is a flowchart depicting an illustrative process 2000 for modifying the presentation of content in a content area of a display device based on the apparent size of the content area to a preferred user, according to some embodiments of the disclosure. Process 2000 may be implemented on control circuitry 1202. In addition, one or more actions of process 2000 may be incorporated into or combined with one or more actions of any other process or embodiment described herein.
[0081] At 2002, the user detection circuit 1214 detects multiple users viewing content on a single display device. The control circuit 1202 may detect and determine the distance of more than one user at a time using the method described above in connection with FIG. 13. At 2004, the control circuit 1202 determines a preference level for each user of the multiple users. For example, the control circuit 1202 may identify each user through face recognition or through a device associated with each user detected in the vicinity of the display device. The control circuit 1202 may access a user database containing multiple entries each associated with a different user and including a preference level for each known user. The control circuit 1202 may retrieve the entries for the identified users and determine a preference level for each user from the retrieved entries. At 2006, the control circuit 1202 identifies a preferred user having the highest preference level. For example, the control circuit 1202 may compare the preference level of each user with that of each other user and determine the user having the highest preference level. At 2008, control circuitry 1202 modifies the presentation of the content based on the apparent size of the content area to the preferred user.
[0082] The actions or descriptions of Figure 20 may be used in conjunction with any other embodiment of the present disclosure. In addition, the actions and descriptions described in connection with Figure 20 may be performed in any suitable alternate order or in parallel so as to further the objectives of the present disclosure.
[0083] 21 is a flow chart depicting an illustrative process 2100 for modifying the presentation of content within a screen portion of a display device when multiple users are viewing the display device, according to some embodiments of the disclosure. Process 2100 may be implemented on control circuitry 1202. Additionally, one or more actions of process 2100 may be incorporated into or combined with one or more actions of any other process or embodiment described herein.
[0084] At 2102, the user detection circuit 1214 detects multiple users viewing content on a single display device, which may be accomplished using the methods described above in connection with FIGS. 13 and 20. At 2104, the control circuit 1202 initializes a counter variable N and sets its value to 1 and a variable T U N represents the total number of detected users. At 2106, the control circuit 1202 determines the distance between the Nth user and the display device, and at 2108, calculates the apparent size of the content area for the Nth user. This may be accomplished using the method described above in connection with FIG. 13. At 2110, the control circuit 1202 calculates N for T, meaning that the apparent sizes have been calculated for all detected users. U Determine whether N is equal to T U If N is not equal to T (NO in 2110), then in 2112 the control circuit 1202 increments the value of N by 1 and the process returns to step 2106. UIf so ("YES" at 2110), then at 2114 the control circuitry 1202 determines whether the apparent size for at least one user is less than the threshold size. This may be accomplished using the method described above in connection with FIG. 13. If the apparent size for at least one user is less than the threshold size, then at 2116 the control circuitry 1202 modifies the presentation of the content. For example, the control circuitry 1202 may determine the smallest individual apparent size of the content area among the individual apparent sizes for each detected user and modify the zoom level of the content in the content area based on the smallest apparent size. As another example, the control circuitry 1202 may calculate an average apparent size of the content area based on the individual apparent sizes for all detected users and modify the zoom level of the content in the content area based on the average apparent size. In some embodiments, the control circuitry 1202 may either generate a PIP window and display a modified version of the content in the PIP window while continuing to display a default version of the content in the main content area, or display the default version of the content in the PIP window and a modified version of the content in the main content area.
[0085] The actions or descriptions of Figure 21 may be used in conjunction with any other embodiment of the present disclosure. In addition, the actions and descriptions described in connection with Figure 21 may be performed in any suitable alternate order or in parallel so as to further the objectives of the present disclosure.
[0086] The processes described above are intended to be illustrative, not limiting. Those skilled in the art will understand that the actions of the processes discussed herein may be omitted, modified, combined, and / or rearranged, and any additional actions may be performed without departing from the scope of the present invention. More generally, the above disclosure is intended to be illustrative, not limiting. Only the claims that follow are intended to set boundaries as to what the present invention includes. Furthermore, it should be noted that the features and limitations described in any one embodiment may be applied to any other embodiment herein, and that the flow charts or examples for one embodiment may be combined with any other embodiment in a suitable manner, performed in a different order, or performed in parallel. In addition, the systems and methods described herein may be performed in real time. It should also be noted that the systems and / or methods described above may be applied to or used in accordance with other systems and / or methods. The present disclosure is directed to a variety of embodiments, including but not limited to the items listed below. 1. A method for adaptively modifying a presentation of content, comprising: Presenting content within a content area of a display device; determining a distance between a first user and the display device; determining an actual size of a content area in which the content is presented; calculating an apparent size of the content area based on an actual size of the content area and a distance between the first user and the display device; modifying the presentation of the content based on the apparent size of the content area; A method comprising: 2. The method of claim 1, wherein modifying the presentation of the content based on the apparent size includes modifying the zoom level of the content. 3. The method of item 2, wherein the amount by which the zoom level is modified is inversely proportional to the apparent size of the content area. 4. Calculating the ratio between the zoom level and the apparent size of the content area; detecting a change in distance between a first user and the display device; In response to detecting a change in distance, determining a second distance between the first user and the display device; calculating a second apparent size of the content area based on the actual size of the content area and the second distance; modifying the zoom level of the content by an amount determined to maintain a ratio between the zoom level and the apparent size of the content area; The method according to item 2 or 3, further comprising: 5. Steps to fix the zoom level of the content: comparing the apparent size of the content area to a first threshold size; in response to determining that the apparent size is greater than or equal to a first threshold size, setting a zoom level of the content to a default zoom level; In response to determining that the apparent size is less than a first threshold size, determining a difference between the apparent size and a first threshold size; increasing the zoom level of the content by a zoom factor corresponding to the difference; The method according to any one of Items 2 to 5, comprising: 6. Steps to increase the zoom level of the content determining a zoom level at which the apparent size of the content matches the actual size of the content; modifying the zoom level of the content according to the zoom factor; The method according to item 5, comprising: 7. Comparing the apparent size of the content area to a second threshold size that is smaller than the first threshold size; panning the content within the content area in response to determining, based on the comparison, that the apparent size is less than a second threshold size; 7. The method according to item 5 or 6, further comprising: 8. Steps to pan content within a content area: identifying a spatial portion of the content that contains a current focus of the content; generating a spatial portion of the content within the content area for display; 8. The method according to item 7, comprising: 9. Determining a zoom factor such that the spatial portion of the content fills the content area; modifying the zoom level of the content according to the zoom factor; The method according to any one of items 2 to 8, further comprising: 10. The method of any of items 8-9, wherein the current focus comprises one of a character, an actor, a location, or a sound source. 11. Identifying a spatial portion of the content that contains a current focus of the content comprises: identifying a plurality of entities that appear in the content; determining, for each entity of the plurality of entities, a timestamp within the content at which the respective entity is a focus of the content; monitoring a current timestamp of the content; selecting a spatial portion of the content in which the individual entity is to be displayed in response to determining that the current timestamp matches a timestamp in which the individual entity of the plurality of entities is a focus of the content; 11. The method according to any one of items 8 to 10, comprising: 12. Steps to fix the zoom level of the content: identifying a plurality of entities that appear in the content; determining an individual importance level for each of the plurality of entities; selecting a subset of entities of the plurality of entities having an importance level above an importance threshold; determining a set of coordinates describing a position, width, and height of each entity in the subset of entities; identifying a smallest spatial portion of the content that contains all of the entities in the subset of entities; determining a zoom factor such that the smallest spatial portion of the content fills the content area; modifying the zoom level of the content according to the zoom factor; 12. The method according to any one of items 2-11, comprising: 13. Modifying the presentation of the content based on the apparent size includes: determining a maximum size of a content area; detecting a current size of a content area; comparing a current size of the content area with a maximum size of the content area; In response to determining, based on the comparison, that the current size of the content area is less than the maximum size of the content area, determining a size of the content area, such that the apparent size of the content area matches the actual size of the content area; increasing the size of the content area to the determined size; modifying the zoom level of the content by a zoom factor corresponding to the increased size of the content area; 13. The method according to any one of items 1 to 12, comprising: 14. In response to determining that the current size of the content area is equal to the maximum size of the content area based on the comparison, identifying a plurality of entities that appear in the content; determining, for each entity of the plurality of entities, a timestamp at which the respective entity is a focus of content; monitoring a current timestamp of the content; identifying the individual entity and a current focus of the content in response to determining that the current timestamp matches a timestamp for which the individual entity of the plurality of entities is a focus of the content; determining a current focus of the content item by generating for display only the spatial portion of the content in which the identified entities are displayed; Item 14. The method of item 13, further comprising: 15. Modifying the presentation of the content in the content area based on the apparent size includes: determining an ambient luminance level; comparing the ambient luminance level to a luminance threshold; In response to determining based on the comparison that the ambient luminance level is below the luminance threshold, identifying a plurality of entities that appear in the content; determining, for each entity of the plurality of entities, a spatial portion of the content in which the respective entity is displayed; identifying an entity of a plurality of entities that is currently a focus of content; reducing the luminance of spatial portions of the content in which the identified entity is not currently displayed; 15. The method according to any one of items 1 to 14, comprising: 16. Multiple users are viewing content on a single display device, and the method further comprises: determining a preference level for each of the plurality of users; identifying preferred users having the highest preference level; and the user is a preferred user. 16. The method according to any one of items 1 to 15. 17. Multiple users are viewing content on a single display device, and the method further comprises: determining, for each user of the plurality of users, an individual distance between the individual user and the display device; calculating, for each user, an individual apparent size of the content area based on the actual size of the content area and the individual distance of the individual user; comparing each user's individual apparent size to a size threshold; and modifying the presentation of the content is responsive to determining that the apparent size for the at least one user is less than a size threshold. 17. The method according to any one of items 1 to 16. 18. Modifying the presentation of content includes: determining, for each individual user of the plurality of users, a smallest individual apparent size of a content area among the individual apparent sizes; modifying the zoom level of the content by a zoom factor corresponding to the smallest apparent size of the content area; Item 18. The method according to item 17, comprising: 19. The step of modifying the presentation of the content includes: calculating, for each individual user of the plurality of users, an average apparent size of the content area based on the individual apparent sizes; modifying the zoom level of the content based on an average apparent size of the content area; 19. The method according to item 17 or 18, comprising: 20. Modifying the presentation of content includes: generating at least a spatial portion of the content for display within a picture-in-picture window; modifying a zoom level of at least a spatial portion of the content by a zoom factor corresponding to an apparent size of the picture-in-picture window; 20. The method according to any one of items 17-19, comprising: 21. The step of modifying the presentation of content includes: generating content for display within a picture-in-picture window; modifying the zoom level of the content by a zoom factor corresponding to the apparent size of the content area; 21. The method according to any one of items 17-20, comprising: 22. A system for adaptively modifying a presentation of content, comprising: A display device; Presenting content within a content area of a display device; determining a distance between a first user and the display device; Determine the actual size of the content area in which the content is presented, calculating an apparent size of the content area based on an actual size of the content area and a distance between the first user and the display device; Modifying the presentation of content based on the apparent size of the content area; A control circuit configured as follows: A system comprising: 23. The system of item 22, wherein the control circuitry configured to modify the presentation of the content based on the apparent size is further configured to modify a zoom level of the content. 24. The system of item 23, wherein the amount by which the zoom level is modified is inversely proportional to the apparent size of the content area. 25. The control circuit further comprises: Calculate the ratio between the zoom level and the apparent size of the content area, Detecting a change in distance between a first user and the display device; In response to detecting a change in distance, determining a second distance between the first user and the display device; calculating a second apparent size of the content area based on the actual size of the content area and the second distance; modifying the zoom level of the content by an amount determined to maintain a ratio between the zoom level and the apparent size of the content area; 25. The system according to item 23 or 24, configured as follows: 26. The control circuit configured to modify a zoom level of the content further comprises: comparing the apparent size of the content area to a first threshold size; in response to determining that the apparent size is greater than or equal to a first threshold size, setting a zoom level of the content to a default zoom level; In response to determining that the apparent size is less than a first threshold size, determining a difference between the apparent size and a first threshold size; Increase the zoom level of the content by a zoom factor that corresponds to the difference, 26. The system according to any one of items 23 to 25, configured as follows: 27. The control circuit configured to increase a zoom level of the content further comprises: Determine the zoom level at which the apparent size of the content matches the actual size of the content; Modify the zoom level of the content by the zoom factor, 27. The system according to item 26, configured as follows: 28. The control circuit further comprises: comparing the apparent size of the content area to a second threshold size that is smaller than the first threshold size; panning the content within the content area in response to determining, based on the comparison, that the apparent size is less than a second threshold size; 28. The system according to item 26 or 27, configured as follows: 29. The control circuit configured to pan content within the content area further comprises: Identifying a spatial portion of the content that contains a current focus of the content; Generate a spatial portion of the content within the content area for display; 29. The system according to item 28, configured as follows: 30. The control circuit further comprises: Determine the zoom factor at which the spatial portion of the content fills the content area; Modify the zoom level of the content by the zoom factor, 30. The system according to item 29, configured as follows: 31. The system of item 29 or 30, wherein the current focus comprises one of a character, an actor, a location, or a sound source. 32. The control circuitry configured to identify a spatial portion of the content that contains a current focus of the content, further comprising: Identify multiple entities that appear in the content; determining, for each entity of the plurality of entities, a timestamp within the content at which the respective entity is a focus of the content; Monitor the current timestamp of the content, selecting a spatial portion of the content in which the individual entity is to be displayed in response to determining that the current timestamp matches a timestamp in which the individual entity of the plurality of entities is a focus of the content; 32. The system according to any one of items 29-31, configured as follows: 33. The control circuit configured to modify a zoom level of the content further comprises: Identify multiple entities that appear in the content; determining a respective importance level for each of the plurality of entities; Selecting a subset of entities of the plurality of entities having an importance level greater than an importance threshold; determining a set of coordinates describing a position, a width, and a height of each entity in the subset of entities; Identifying a smallest spatial portion of the content that contains all of the entities in the subset of entities; Determine the zoom factor at which the smallest spatial portion of the content will fill the content area; Modify the zoom level of the content by the zoom factor, 33. The system according to any one of items 23-32, configured as follows: 34. The control circuitry configured to modify the presentation of the content based on the apparent size further comprises: Determine the maximum size of the content area, Detect the current size of the content area, Compare the current size of the content area to the maximum size of the content area, In response to determining, based on the comparison, that the current size of the content area is less than the maximum size of the content area, determining a size of the content area such that the apparent size of the content area matches the actual size of the content area; Increase the size of the content area to the determined size, Modify the zoom level of the content by a zoom factor that corresponds to the increased size of the content area; 33. The system according to any one of items 22-32, configured as follows: 35. The control circuitry further comprises, in response to determining, based on the comparison, that the current size of the content area is equal to the maximum size of the content area: identifying a plurality of entities that appear in the content; determining, for each entity of the plurality of entities, a timestamp at which the respective entity is a focus of content; monitoring a current timestamp of the content; identifying the individual entity and a current focus of the content in response to determining that the current timestamp matches a timestamp for which the individual entity of the plurality of entities is a focus of the content; Determine the current focus of the content item by causing only the spatial portion of the content in which the identified entities are displayed to be generated for display; Item 35. The system according to item 34, configured as follows: 36. The control circuitry configured to modify the presentation of the content in the content area based on the apparent size further comprises: determining an ambient brightness level; Comparing the ambient luminance level to a luminance threshold; In response to determining based on the comparison that the ambient luminance level is below the luminance threshold, Identify multiple entities that appear in the content; determining, for each entity of the plurality of entities, a spatial portion of the content in which the respective entity is to be displayed; Identifying an entity of multiple entities that is currently the focus of the content; reducing the brightness of spatial portions of the content where the identified entity is not currently displayed; Item 22-35. The system according to any one of items 22-35, 37. Multiple users are viewing content on a single display device, and the control circuitry further comprises: determining a preference level for each of the plurality of users; identifying preferred users having the highest preference level; and the user is a preferred user. 37. The system according to any one of items 22-36. 38. Multiple users are viewing content on a single display device, and the control circuitry further comprises: determining, for each user of the plurality of users, a respective distance between the respective user and the display device; calculating, for each user, a respective apparent size of the content area based on the actual size of the content area and the respective distance of the respective user; comparing each user's individual apparent size to a size threshold; and wherein the control circuitry is configured to modify presentation of the content in response to determining that the apparent size for the at least one user is less than a size threshold. Item 22-37. A system according to any one of items 22-37. 39. The control circuit configured to modify the presentation of the content further comprises: determining, for each individual user of the plurality of users, a smallest individual apparent size of a content area among the individual apparent sizes; Fix the zoom level of the content by the zoom factor that corresponds to the smallest apparent size of the content area, Item 39. The system according to item 38, configured as follows: 40. The control circuit configured to modify the presentation of the content further comprises: calculating, for each individual user of the plurality of users, an average apparent size of the content area based on the individual apparent size; Fix the content zoom level based on the average apparent size of the content area, 40. The system according to item 38 or 39, configured as follows: 41. The control circuit configured to modify the presentation of the content further comprises: causing at least a spatial portion of the content to be displayed within a picture-in-picture window; modifying the zoom level of at least a spatial portion of the content by a zoom factor corresponding to the apparent size of the picture-in-picture window; The system according to any one of items 38-40, configured as follows: 42. The control circuit configured to modify the presentation of the content further comprises: Causes content to be displayed within a picture-in-picture window, Modify the zoom level of the content by a zoom factor that corresponds to the apparent size of the content area, 42. The system according to any one of items 38-41, configured to: 43. A system for adaptively modifying a presentation of content, comprising: means for presenting content within a content area of a display device; means for determining a distance between a first user and the display device; means for determining the actual size of a content area in which content is presented; means for calculating an apparent size of the content area based on an actual size of the content area and a distance between the first user and the display device; means for modifying the presentation of the content based on the apparent size of the content area; A system comprising: 44. The system of item 43, wherein the means for modifying the presentation of the content based on the apparent size comprises means for modifying a zoom level of the content. 45. The system of item 44, wherein the amount by which the zoom level is modified is inversely proportional to the apparent size of the content area. 46. A means for calculating a ratio between the zoom level and the apparent size of the content area; means for detecting a change in distance between a first user and the display device; In response to detecting a change in distance, means for determining a second distance between the first user and the display device; means for calculating a second apparent size of the content area based on the actual size of the content area and the second distance; means for modifying the zoom level of the content by an amount determined to maintain a ratio between the zoom level and the apparent size of the content area; 46. The system of claim 44 or 45, further comprising: 47. The means to modify the zoom level of the content means for comparing the apparent size of the content area to a first threshold size; means for setting a zoom level of the content to a default zoom level in response to determining that the apparent size is greater than or equal to a first threshold size; In response to determining that the apparent size is less than a first threshold size, means for determining a difference between the apparent size and a first threshold size; means for increasing the zoom level of the content by a zoom factor corresponding to the difference; 47. The system according to any one of items 44-46, comprising: 48. The means to increase the zoom level of the content means for determining a zoom level at which the apparent size of the content matches the actual size of the content; means for modifying the zoom level of the content according to the zoom factor; Item 48. The system of item 47, comprising: 49. Means for comparing the apparent size of the content area with a second threshold size that is smaller than the first threshold size; means for panning the content within the content area in response to determining based on the comparison that the apparent size is less than a second threshold size; 49. The system of claim 47 or 48, further comprising: 50. The means to pan content within the content area is means for identifying a spatial portion of the content that contains a current focus of the content; means for generating a spatial portion of the content within the content area for display; 50. The system of item 49, comprising: 51. A means for determining a zoom factor such that a spatial portion of the content fills the content area; and means for modifying the zoom level of the content according to the zoom factor; 51. The system of any of items 44-50, further comprising: 52. The system of item 50 or 51, wherein the current focus comprises one of a character, an actor, a location, or a sound source. 53. The means for identifying a spatial portion of content that contains a current focus of the content comprises: A means for identifying a plurality of entities appearing in the content; means for determining, for each of the plurality of entities, a timestamp within the content at which the respective entity is a focus of the content; means for monitoring a current timestamp of the content; means for selecting a spatial portion of the content in which the individual entity is to be displayed in response to determining that the current timestamp matches a timestamp in which the individual entity of the plurality of entities is a focus of the content; 53. The system according to any one of items 50-52, comprising: 54. The means to modify the zoom level of the content A means for identifying a plurality of entities appearing in the content; means for determining an individual importance level for each of the plurality of entities; means for selecting a subset of entities of the plurality of entities having an importance level above an importance threshold; means for determining a set of coordinates describing a position, a width, and a height of each entity in the subset of entities; means for identifying a smallest spatial portion of the content that contains all of the entities in the subset of entities; means for determining a zoom factor such that the smallest spatial portion of the content fills the content area; means for modifying the zoom level of the content according to the zoom factor; 54. The system according to any one of items 44-53, comprising: 55. The means for modifying the presentation of content based on apparent size include: means for determining a maximum size of a content area; means for detecting the current size of the content area; means for comparing a current size of the content area with a maximum size of the content area; In response to determining, based on the comparison, that the current size of the content area is less than the maximum size of the content area, means for determining a size of the content area, such that the apparent size of the content area matches the actual size of the content area; means for increasing the size of the content area to a determined size; means for modifying the zoom level of the content by a zoom factor corresponding to the increased size of the content area; 55. The system according to any one of items 43-54, comprising: 56. In response to determining, based on the comparison, that the current size of the content area is equal to the maximum size of the content area; identifying a plurality of entities that appear in the content; determining, for each entity of the plurality of entities, a timestamp at which the respective entity is a focus of content; monitoring a current timestamp of the content; identifying the individual entity and a current focus of the content in response to determining that the current timestamp matches a timestamp for which the individual entity of the plurality of entities is a focus of the content; means for determining a current focus of a content item by means for generating for display only the spatial portion of the content in which the identified entity is displayed; Item 56. The system of item 55, further comprising: 57. The means for modifying the presentation of content within a content area based on the apparent size includes: means for determining an ambient brightness level; and means for comparing the ambient brightness level to a brightness threshold; In response to determining based on the comparison that the ambient luminance level is below the luminance threshold, A means for identifying a plurality of entities appearing in the content; means for determining, for each of the plurality of entities, a spatial portion of the content in which the respective entity is to be displayed; means for identifying an entity of a plurality of entities that is currently the focus of the content; means for reducing the luminance of spatial portions of the content in which the identified entity is not currently being displayed; 57. The system according to any one of items 43-56, comprising: 58. Multiple users are viewing content on a single display device, and the system further comprises: means for determining a preference level for each of the plurality of users; means for identifying preferred users, the preferred users having the highest preference level; and the user is a preferred user. Item 43-57. The system according to any one of items 43-57. 59. Multiple users are viewing content on a single display device, and the system further comprises: means for determining, for each of the plurality of users, a respective distance between the respective user and the display device; means for calculating, for each user, an individual apparent size of the content area based on the actual size of the content area and the individual user's individual distance; means for comparing each user's individual apparent size to a size threshold; the means for modifying the presentation of the content does so in response to determining that the apparent size for the at least one user is less than a size threshold. Item 43-58. The system of any of items 43-58. 60. Means for modifying the presentation of content include: means for determining, for each individual user of the plurality of users, a smallest individual apparent size of a content area among the individual apparent sizes; means for modifying the zoom level of the content by a zoom factor corresponding to the smallest apparent size of the content area; Item 59. The system of item 59, comprising: 61. The means to modify the presentation of content are: means for calculating, for each individual user of the plurality of users, an average apparent size of the content area based on the individual apparent sizes; means for modifying the zoom level of the content based on an average apparent size of the content area; 61. The system according to item 59 or 60, comprising: 62. Means for modifying the presentation of content include: means for generating at least a spatial portion of the content for display within a picture-in-picture window; means for modifying a zoom level of at least a spatial portion of the content by a zoom factor corresponding to an apparent size of the picture-in-picture window; 62. The system according to any one of items 59-61, comprising: 63. Means for modifying the presentation of content include: means for generating content for display within a picture-in-picture window; means for modifying the zoom level of the content by a zoom factor corresponding to the apparent size of the content area; 63. The system according to any of items 59-62, comprising: 64. A non-transitory computer-readable medium that, when executed by a control circuit, causes the control circuit to: Presenting content within a content area of a display device; determining a distance between a first user and the display device; Determine the actual size of the content area in which the content is presented, calculating an apparent size of the content area based on an actual size of the content area and a distance between the first user and the display device; Modifying the presentation of content based on the apparent size of the content area; A non-transitory computer readable medium having encoded thereon non-transitory computer readable instructions for adaptively modifying a presentation of content. 65. The non-transitory computer-readable medium of item 64, wherein execution of the instructions to modify the presentation of the content based on the apparent size further causes the control circuitry to modify a zoom level of the content. 66. The non-transitory computer-readable medium of item 65, wherein the amount by which the zoom level is modified is inversely proportional to the apparent size of the content area. 67. Execution of the instructions further includes: Calculate the ratio between the zoom level and the apparent size of the content area, detecting a change in distance between a first user and the display device; In response to detecting a change in distance, determining a second distance between the first user and the display device; calculating a second apparent size of the content area based on the actual size of the content area and the second distance; causing the zoom level of the content to be modified by an amount determined to maintain the ratio between the zoom level and the apparent size of the content area; Item 67. The non-transitory computer-readable medium of item 65 or 66. 68. Execution of the instructions to modify the zoom level of the content further includes a control circuit: comparing the apparent size of the content area to a first threshold size; in response to determining that the apparent size is greater than or equal to a first threshold size, causing a zoom level of the content to be set to a default zoom level; In response to determining that the apparent size is less than a first threshold size, determining a difference between the apparent size and a first threshold size; Increase the zoom level of the content by a zoom factor that corresponds to the difference, Any of items 65-67, wherein the non-transitory computer readable medium. 69. Execution of the instructions to increase the zoom level of the content further includes a control circuit: Determine the zoom level at which the apparent size of the content area matches the actual size of the content area, Modify the zoom level of the content depending on the zoom factor, Item 70. The non-transitory computer-readable medium of item 68. 70. Execution of the instructions further includes: comparing the apparent size of the content area to a second threshold size that is smaller than the first threshold size; panning the content within the content area in response to determining, based on the comparison, that the apparent size is less than a second threshold size; 70. The non-transitory computer-readable medium of item 68 or 69. 71. Execution of the instruction to pan the content within the content area further includes a control circuit: Identifying a spatial portion of the content that contains the content's current focus; Generate a spatial portion of the content within the content area for display; Item 71. The non-transitory computer-readable medium of item 70. 72. Execution of the instructions further comprises: Determines the zoom factor at which the spatial portion of the content fills the content area; Modify the zoom level of the content depending on the zoom factor, Any of items 64-71, a non-transitory computer readable medium. 73. The non-transitory computer-readable medium of item 71 or 72, wherein the current focus comprises one of a character, an actor, a location, or a sound source. 74. Execution of the instructions to identify a spatial portion of the content that contains a current focus of the content further includes the control circuitry: Identify multiple entities appearing in the content; determining, for each of the plurality of entities, a timestamp within the content at which the respective entity is a focus of the content; Monitor the current timestamp of the content, selecting a spatial portion of the content in which the individual entity is to be displayed in response to determining that the current timestamp matches a timestamp in which the individual entity of the plurality of entities is a focus of the content; Item 74. The non-transitory computer-readable medium of any one of items 71-73. 75. Execution of the instructions to modify the zoom level of the content further includes a control circuit: Identify multiple entities appearing in the content; determining an individual importance level for each of the plurality of entities; selecting a subset of entities of the plurality of entities having an importance level above an importance threshold; determining a set of coordinates describing a position, a width, and a height of each entity in the subset of entities; identifying a smallest spatial portion of the content that contains all of the entities in the subset of entities; Determine the zoom factor at which the smallest spatial portion of the content fills the content area; Modify the zoom level of the content depending on the zoom factor, Item 65-74. The non-transitory computer-readable medium of any one of items 65-74. 76. Execution of the instructions to modify the presentation of the content based on the apparent size further includes the control circuitry: Determine the maximum size of the content area, Detect the current size of the content area, Compare the current size of the content area to the maximum size of the content area, In response to determining, based on the comparison, that the current size of the content area is less than the maximum size of the content area, determining a size of the content area such that the apparent size of the content area matches the actual size of the content area; Increase the size of the content area to the determined size, Modify the zoom level of the content by a zoom factor that corresponds to the increased size of the content area, Item 64-75. The non-transitory computer-readable medium of any one of items 64-75. 77. Execution of the instructions further includes causing the control circuit to, in response to determining, based on the comparison, that the current size of the content area is equal to the maximum size of the content area: identifying a plurality of entities that appear in the content; determining, for each entity of the plurality of entities, a timestamp at which the respective entity is a focus of content; monitoring a current timestamp of the content; identifying the individual entity and a current focus of the content in response to determining that the current timestamp matches a timestamp for which the individual entity of the plurality of entities is a focus of the content; determines the current focus of the content item, causing only the spatial portion of the content in which the identified entities are displayed to be generated for display; Item 77. The non-transitory computer-readable medium according to item 76. 78. Execution of the instructions to modify the presentation of the content in the content area based on the apparent size further includes causing the control circuit to: Determine the ambient brightness level, Comparing the ambient luminance level to a luminance threshold; In response to determining based on the comparison that the ambient luminance level is below the luminance threshold, Identify multiple entities appearing in the content; determining, for each entity of the plurality of entities, a spatial portion of the content in which the respective entity is displayed; Identifying the entity of multiple entities that is currently the focus of the content; reducing the brightness of spatial portions of the content where the identified entity is not currently displayed; Item 66-77. The non-transitory computer-readable medium of any one of items 66-77. 79. Multiple users are viewing content on a single display device, and execution of the instructions further includes controlling a control circuit to: determining a preference level for each of the plurality of users; identifying preferred users having the highest preference level; The user is a preferred user, Item 64-78. The non-transitory computer-readable medium of any of items 64-78. 80. Multiple users are viewing content on a single display device, and execution of the instructions further includes controlling a control circuit to: determining, for each user of the plurality of users, a respective distance between the respective user and the display device; calculating, for each user, a respective apparent size of the content area based on the actual size of the content area and the respective distance of the respective user; Comparing each user's individual apparent size to a size threshold; the control circuitry is configured to modify presentation of the content in response to determining that the apparent size for the at least one user is less than a size threshold; 80. The non-transitory computer-readable medium of any of items 64-79. 81. Execution of the instructions to modify the presentation of the content further includes a control circuit: determining, for each individual user of the plurality of users, a smallest individual apparent size of a content area among the individual apparent sizes; Modify the zoom level of the content by the zoom factor that corresponds to the smallest apparent size of the content area, Item 81. The non-transitory computer-readable medium of item 80. 82. Execution of the instructions to modify the presentation of content further includes a control circuit: calculating an average apparent size of the content area for each individual user of the plurality of users based on the individual apparent size; Modify the content zoom level based on the average apparent size of the content area, 82. The non-transitory computer-readable medium of item 80 or 81. 83. Execution of the instructions to modify the presentation of the content further includes a control circuit: causing at least a spatial portion of the content to be displayed within a picture-in-picture window; modifying the zoom level of at least a spatial portion of the content by a zoom factor corresponding to an apparent size of the picture-in-picture window; 83. The non-transitory computer-readable medium of any of items 80-82. 84. Execution of the instructions to modify the presentation of the content further includes a control circuit: Causes content to be displayed within a picture-in-picture window, Modify the zoom level of the content by a zoom factor that corresponds to the apparent size of the content area, 84. The non-transitory computer-readable medium of any of items 80-83. 85. A method for adaptively modifying a presentation of content, comprising: receiving a selection of content at a display device; Presenting content within a content area of a display device; determining a distance between a first user and the display device; and determining an actual size of a content area in which the content is presented; calculating an apparent size of the content area based on an actual size of the content area and a distance between the first user and the display device; modifying the presentation of the content based on the apparent size of the content area; A method comprising: 86. The method of item 85, wherein modifying the presentation of the content based on the apparent size includes modifying the zoom level of the content. 87. The method according to item 86, wherein the amount by which the zoom level is modified is inversely proportional to the apparent size of the content area. 88. Calculating a ratio between the zoom level and the apparent size of the content area; detecting a change in distance between a first user and the display device; In response to detecting a change in distance, determining a second distance between the first user and the display device; calculating a second apparent size of the content area based on the actual size of the content area and the second distance; modifying the zoom level of the content by an amount determined to maintain a ratio between the zoom level and the apparent size of the content area; 88. The method of claim 86 or 87, further comprising: 89. Steps to fix the zoom level of the content: comparing the apparent size of the content area to a first threshold size; in response to determining that the apparent size is greater than or equal to a first threshold size, setting a zoom level of the content to a default zoom level; In response to determining that the apparent size is less than a first threshold size, determining a difference between the apparent size and a first threshold size; increasing the zoom level of the content by a zoom factor corresponding to the difference; 89. The method according to any of items 86-88, comprising: 90. Steps that increase the zoom level of the content: determining a zoom level at which the apparent size of the content area matches the actual size of the content area; modifying the zoom level of the content according to the zoom factor; 89. The method according to claim 89, comprising: 91. Comparing the apparent size of the content area to a second threshold size that is smaller than the first threshold size; panning the content within the content area in response to determining, based on the comparison, that the apparent size is less than a second threshold size; 91. The method of claim 89 or 90, further comprising: 92. Steps that pan content within a content area: identifying a spatial portion of the content that contains a current focus of the content; generating a spatial portion of the content within the content area for display; Item 92. The method according to item 91, comprising: 93. Determining a zoom factor such that a spatial portion of the content fills the content area; modifying the zoom level of the content according to the zoom factor; 93. The method according to any of items 90-92, further comprising: 94. The method of any of items 92-93, wherein the current focus comprises one of a character, an actor, a location, or a sound source. 95. The step of identifying a spatial portion of the content that contains a current focus of the content includes: identifying a plurality of entities that appear in the content; determining, for each entity of the plurality of entities, a timestamp within the content at which the respective entity is a focus of the content; monitoring a current timestamp of the content; selecting a spatial portion of the content in which the individual entity is to be displayed in response to determining that the current timestamp matches a timestamp in which the individual entity of the plurality of entities is a focus of the content; The method according to any one of items 92-94, comprising: 96. Steps to fix the zoom level of the content: identifying a plurality of entities that appear in the content; determining an individual importance level for each of the plurality of entities; selecting a subset of entities of the plurality of entities having an importance level above an importance threshold; determining a set of coordinates describing a position, width, and height of each entity in the subset of entities; identifying a smallest spatial portion of the content that contains all of the entities in the subset of entities; determining a zoom factor such that the smallest spatial portion of the content fills the content area; modifying the zoom level of the content according to the zoom factor; The method according to any of items 86-95, comprising: 97. The step of modifying the presentation of the content based on the apparent size includes: determining a maximum size of a content area; detecting a current size of a content area; comparing a current size of the content area with a maximum size of the content area; In response to determining, based on the comparison, that the current size of the content area is less than the maximum size of the content area, determining a size of the content area, such that the apparent size of the content area matches the actual size of the content area; increasing the size of the content area to the determined size; modifying the zoom level of the content by a zoom factor corresponding to the increased size of the content area; 97. The method according to any of items 85-96, comprising: 98. In response to determining, based on the comparison, that the current size of the content area is equal to the maximum size of the content area; identifying a plurality of entities that appear in the content; determining, for each entity of the plurality of entities, a timestamp at which the respective entity is a focus of content; monitoring a current timestamp of the content; identifying the individual entity and a current focus of the content in response to determining that the current timestamp matches a timestamp for which the individual entity of the plurality of entities is a focus of the content; determining a current focus of the content item by generating for display only the spatial portion of the content in which the identified entities are displayed; Item 98. The method of item 97, further comprising: 99. The step of modifying the presentation of the content in the content area based on the apparent size includes: determining an ambient luminance level; comparing the ambient luminance level to a luminance threshold; In response to determining based on the comparison that the ambient luminance level is below the luminance threshold, identifying a plurality of entities that appear in the content; determining, for each entity of the plurality of entities, a spatial portion of the content in which the respective entity is displayed; identifying an entity of a plurality of entities that is currently a focus of content; reducing the luminance of spatial portions of the content in which the identified entity is not currently displayed; The method according to any of items 85-98, comprising: 100. Multiple users are viewing content on a single display device, the method further comprising: determining a preference level for each of the plurality of users; identifying preferred users having the highest preference level; and the user is a preferred user. The method according to any one of items 85-99. 101. Multiple users are viewing content on a single display device, and the method further comprises: determining, for each user of the plurality of users, an individual distance between the individual user and the display device; calculating, for each user, an individual apparent size of the content area based on the actual size of the content area and the individual distance of the individual user; comparing each user's individual apparent size to a size threshold; and modifying the presentation of the content is responsive to determining that the apparent size for the at least one user is less than a size threshold. The method according to any one of items 85-100. 102. Modifying the presentation of content includes: determining, for each individual user of the plurality of users, a smallest individual apparent size of a content area among the individual apparent sizes; modifying the zoom level of the content by a zoom factor corresponding to the smallest apparent size of the content area; Item 102. The method according to item 101, comprising: 103. Modifying the presentation of content includes: calculating, for each individual user of the plurality of users, an average apparent size of the content area based on the individual apparent sizes; modifying the zoom level of the content based on an average apparent size of the content area; The method according to any one of items 101-102, comprising: 104. Modifying the presentation of content includes: generating at least a spatial portion of the content for display within a picture-in-picture window; modifying a zoom level of at least a spatial portion of the content by a zoom factor corresponding to an apparent size of the picture-in-picture window; The method according to any one of items 101 to 103, comprising: 105. Modifying the presentation of content includes: generating content for display within a picture-in-picture window; modifying the zoom level of the content by a zoom factor corresponding to the apparent size of the content area; The method according to any one of items 101 to 104, comprising:
[0087] It is to be understood that, although particular combinations of the various items listed above are often illustrative and expressly intended as mutually exclusive, any other possible combinations of such embodiments and features are also contemplated.
Claims
1. 1. A method for adaptively modifying a presentation of content, the method comprising: Presenting content within a content area of a display device, the content area being associated with a brightness level; determining a distance between a first user and the display device; determining an actual size of the content area in which the content is presented; calculating an apparent size of the content area based on the actual size of the content area and the distance between the first user and the display device; modifying a presentation of the content based on the apparent size of the content area, the modifying including reducing a brightness level of at least a portion of the content area that does not contain a current focus of the content; A method comprising:
2. The method of claim 1 , wherein modifying the presentation of the content based on the apparent size comprises modifying a zoom level of the content.
3. The method of claim 2 , wherein the amount by which the zoom level is modified is inversely proportional to the apparent size of the content area.
4. The method comprises: calculating a ratio between the zoom level and the apparent size of the content area; Detecting a change in distance between the first user and the display device; in response to detecting a change in the distance; determining a second distance between the first user and the display device; calculating a second apparent size of the content area based on the actual size of the content area and the second distance; modifying the zoom level of the content by an amount determined to maintain the ratio between the zoom level and the apparent size of the content area; The method of claim 2 or claim 3, further comprising:
5. Modifying the zoom level of the content includes: comparing the apparent size of the content area to a first threshold size; in response to determining that the apparent size is greater than or equal to the first threshold size, setting the zoom level of the content to a default zoom level; in response to determining that the apparent size is less than the first threshold size, determining a difference between the apparent size and the first threshold size; increasing the zoom level of the content by a zoom factor corresponding to the difference; and The method according to any one of claims 2 to 4, comprising:
6. Increasing the zoom level of the content includes: determining a zoom level at which the apparent size of the content matches the actual size of the content; modifying the zoom level of the content by the zoom factor; The method of claim 5 , comprising:
7. 1. A method for adaptively modifying a presentation of content, the method comprising: Presenting content within a content area of a display device, the content area being associated with a brightness level; determining a distance between a first user and the display device; determining an actual size of the content area in which the content is presented; calculating an apparent size of the content area based on the actual size of the content area and the distance between the first user and the display device, the apparent size corresponding to a size of a screen area perceived by the user; comparing the apparent size for the first user to a size threshold; modifying a presentation of the content based on the apparent size of the content area in response to determining that the apparent size for the first user is less than the size threshold, the modifying including reducing a brightness level of at least a portion of the content area that does not include a current focus of the content; A method comprising:
8. 1. A method, comprising: presenting content for display on a device having a display area; determining an actual size of the content on the display area, the actual size of the content being less than a size of the display area; determining a distance between a user and the device; determining an apparent size of the content, the apparent size corresponding to a size of the display area as perceived by the user; comparing the apparent size of the content to a size of the display area; in response to determining that the apparent size of the content is less than the size of the display area based on the comparing, increasing the actual size of the content such that the apparent size of the content matches the size of the display area; determining a current focus of a content item in response to increasing the actual size of the content; generating for display only that portion of the space in which the current object of focus is displayed; A method comprising:
9. A system for adaptively modifying a presentation of content, said system comprising control circuitry configured to perform a method according to any of claims 1 to 8.
10. 9. A non-transitory computer readable medium having encoded thereon non-transitory computer readable instructions for adaptively modifying a presentation of content, the instructions, when executed by control circuitry, causing the control circuitry to perform a method according to any of claims 1 to 8.
Citation Information
Patent Citations
Image display apparatus, image display method, program and recording medium
JP2009192737A
Apparatus and program for identifying position gazed
JP2014048775A
Display control device, display control method, and display control program
JP2019153145A
Content reproducing apparatus
US20160140092A1
Information processing device, information processing method, and program
US20160231809A1