Processing secure content on a virtual reality system

Abstract

To process a secure content on a satisfactory virtual reality system.SOLUTION: Described herein are techniques and technologies to identify an encrypted content within a field of view of a user of a VR / AR system and process the encrypted content appropriately. The user of the VR / AR technology may have protected content in a field of view of the user. Encrypted content is mapped to one or more protected surfaces on a display device. Contents mapped to a protected surface may be rendered on the display device but prevented from being replicated from the display device.SELECTED DRAWING: Figure 1A

Description

[Technical Field]

[0001] This application claims the benefit of priority to U.S. Provisional Patent Application No. 63 / 014,645, filed April 23, 2020, and entitled "PROCESSING SECURE CONTENT ON A VIRTUAL REALITY SYSTEM," the entire contents of which are incorporated herein by reference for all purposes. [Background technology]

[0002] Modern computing and display technology has facilitated the development of systems for so-called "virtual reality" or "augmented reality" experiences, in which digitally produced images, or portions thereof, are presented to a user within a wearable device so that they appear or may be perceived as real. Virtual reality, or "VR," scenarios typically involve the presentation of digital or virtual image information without transparency to other actual, real-world visual input, while augmented reality, or "AR," scenarios typically involve the presentation of digital or virtual image information as an extension to a user's visualization of the real world around them.

[0003] Mixed reality (e.g., VR or AR) scenarios often involve the presentation of virtual content (e.g., color images and sounds) that correspond to virtual objects related to real-world objects. For example, a user of VR / AR technology may have a real-world, physical room-like setting featuring furniture, windows, a computer screen, and a television displayed on the surface of a table. In addition to these items, users of VR / AR technology also perceive that they "see" virtual objects that do not exist in the real world. Virtual objects may take any of a wide variety of forms, comprising any variety of data, information, concepts, or logical structures capable of being represented as images. Non-limiting examples of virtual objects may include virtual text objects, virtual numeric objects, virtual alphanumeric objects, virtual tag objects, virtual field objects, virtual chart objects, virtual map objects, virtual measurement objects, or virtual visual representations of physical objects.

[0004] According to various embodiments, a user of VR / AR technology may have protected content (e.g., pay-per-view programming offered on a television in the above real-world room setting example) within the user's field of view. Such protected (e.g., encrypted) content should not be allowed to be copied (e.g., recorded, stored, or distributed) from the AR technology display device. Current VR / AR techniques do not allow for protecting encrypted content on the display device. Summary of the Invention [Means for solving the problem]

[0005] Described herein are techniques and technologies for identifying encrypted content within the field of view of a user of a VR / AR system and processing the encrypted content appropriately.

[0006] According to various embodiments, a user of VR / AR technology may have protected content (e.g., pay-per-view programming offered on a television) within the user's field of view. Such protected (e.g., encrypted) content should be protected while displayed on a display device of VR / AR technology. For example, the encrypted content may be rendered on the display device, but the encrypted content is prevented from being copied (e.g., recorded, stored, or distributed) from the display device. Embodiments provide techniques for displaying encrypted content on the display device in a protected manner. For example, embodiments enable the system to map the encrypted content onto one or more protected surfaces on the display device once the system identifies the encrypted content within the user's field of view. The content mapped to the one or more protected surfaces may be rendered on the display device and prevented from being copied from the display device.

[0007] An embodiment provides a method for displaying content components on a display device. The method includes receiving, by a processing platform, a plurality of content components. The method also includes identifying, by the processing platform, an encrypted content component among the plurality of content components. The processing platform transmits the encrypted content component to the display device. At least the encrypted content component is mapped to a protected surface.

[0008] Various embodiments provide a processing platform comprising one or more processors and one or more storage devices storing instructions that, when executed on the one or more processors, cause the one or more processors to receive a plurality of content components, identify an encrypted content component among the plurality of content components, and transmit the encrypted content component to a display device, wherein at least the encrypted content component is mapped to a protected surface.

[0009]

[0009] Embodiments further provide a system including a processing platform, a first source configured to provide unencrypted content components, a second source configured to provide encrypted content components, and a display device configured to display at least the encrypted content components on a protected surface. The processing platform includes one or more processors and one or more storage devices that store instructions that, when executed on the one or more processors, cause the one or more processors to receive a plurality of content components, identify encrypted content components among the plurality of content components, and transmit the encrypted content components to the display device. At least the encrypted content components are mapped to the protected surface.

[0010] Additional and other objects, features, and advantages of the present disclosure are set forth in the detailed description, drawings, and claims. The present invention provides, for example, the following. (Item 1) 1. A method for displaying a content component on a display device, the method comprising: receiving, by a processing platform, a plurality of content components; identifying, by the processing platform, an encrypted content component among the plurality of content components; transmitting, by the processing platform, the encrypted content component to the display device, wherein at least the encrypted content component is mapped to a protected surface; A method comprising: (Item 2) identifying, by the processing platform, an unencrypted content component among the plurality of content components; merging, by the processing platform, the encrypted content component and the unencrypted content component into a single output frame; transmitting, by the processing platform, the single output frame to the display device, wherein the single output frame is mapped to one or more protected surfaces on the display device; Item 1, the method of claim 1 further comprising: (Item 3) generating the protected surface, the encrypted content component configured to be rendered only on the protected surface; transmitting the protected surface to the display device, wherein the encrypted content component is rendered on the protected surface on the display device; Item 1, the method of claim 1 further comprising: (Item 4) In response to receiving the plurality of content components, creating a plurality of frame loops, each frame loop corresponding to one of the plurality of content components; queuing the plurality of frame loops in a frame loop pipeline; Obtaining a frame loop from the frame loop pipeline; determining whether the frame loop corresponds to the encrypted content component or the unencrypted content component based on a source of the plurality of content components; Item 1, the method of claim 1 further comprising: (Item 5) Item 10. The method of claim 1, wherein the content mapped to the protected surface is rendered on the display device and is prevented from being copied from the display device. (Item 6) Disabling recording or storing of characteristics of the processing platform relative to the protected surface. Item 1, the method of claim 1 further comprising: (Item 7) Item 10. The method of item 1, wherein the protected surface includes a texture having predetermined dimensions that is mapped to a field of view on the display device. (Item 8) identifying, by the processing platform, an unencrypted content component among the plurality of content components; merging, by the processing platform, the encrypted content component and the unencrypted content component into a single output frame; transmitting, by the processing platform, the single output frame to the display device, wherein the unencrypted content component is mapped to an unprotected surface on the display device; Item 1, the method of claim 1 further comprising: (Item 9) prior to transmitting the single output frame to the display device; distributing the encrypted content components to a protected surface on the display device and the unencrypted content components to an unprotected surface on the display device; Item 9. The method of item 8, further comprising: (Item 10) Item 9. The method of item 8, wherein the protected surface and the unprotected surface are mapped to mutually exclusive fields of view on the display device. (Item 11) Item 9. The method of item 8, wherein the protected surface and the unprotected surface are mapped to two overlapping fields of view on the display device, and the overlap between the fields of view is displayed on the display device as encrypted content such that the encrypted content is prevented from being copied from the display device while it is rendered on the display device. (Item 12) 1. A processing platform comprising: one or more processors; one or more storage devices storing instructions that, when executed on the one or more processors, cause the one or more processors to: receiving a plurality of content components; identifying an encrypted content component among the plurality of content components; transmitting the encrypted content component to a display device, wherein at least the encrypted content component is mapped to a protected surface; one or more storage devices that A processing platform comprising: (Item 13) The instructions, when executed on the one or more processors, further cause the one or more processors to: identifying an unencrypted content component among the plurality of content components; merging the encrypted content component and the unencrypted content component into a single output frame; transmitting the single output frame to a display device, wherein the single output frame is mapped to one or more protected surfaces on the display device; Item 13. The processing platform according to item 12, (Item 14) The instructions, when executed on the one or more processors, further cause the one or more processors to: generating the protected surface, the encrypted content component configured to be rendered only on the protected surface; transmitting the protected surface to the display device, wherein the encrypted content component is rendered on the protected surface on the display device; Item 13. The processing platform according to item 12, (Item 15) The instructions, when executed on the one or more processors, further cause the one or more processors to: In response to receiving the plurality of content components, creating a plurality of frame loops, each frame loop corresponding to one of the plurality of content components; queuing the plurality of frame loops in a frame loop pipeline; Obtaining a frame loop from the frame loop pipeline; determining whether the frame loop corresponds to the encrypted content component or the unencrypted content component based on a source of the plurality of content components; Item 13. The processing platform according to item 12, (Item 16) Item 13. The processing platform of item 12, wherein content mapped to the protected surface is rendered on the display device and is prevented from being copied from the display device. (Item 17) The instructions, when executed on the one or more processors, further cause the one or more processors to: Disabling recording or storing of characteristics of the processing platform relative to the protected surface. Item 13. The processing platform according to item 12, (Item 18) Item 13. The processing platform of item 12, wherein the protected surface includes a texture having predetermined dimensions that is mapped to a field of view on the display device. (Item 19) The instructions, when executed on the one or more processors, further cause the one or more processors to: identifying an unencrypted content component among the plurality of content components; merging the encrypted content component and the unencrypted content component into a single output frame; transmitting the single output frame to the display device, wherein the unencrypted content component is mapped to an unprotected surface on the display device; Item 13. The processing platform according to item 12, (Item 20) The instructions, when executed on the one or more processors, further cause the one or more processors to: prior to transmitting the single output frame to the display device; distributing the encrypted content components to a protected surface on the display device and the unencrypted content components to an unprotected surface on the display device; Item 19. A processing platform according to item 19. (Item 21) 20. The processing platform of claim 19, wherein the protected surface and the unprotected surface are mapped to mutually exclusive fields of view on the display device. (Item 22) 20. The processing platform of claim 19, wherein the protected surface and the unprotected surface are mapped to two overlapping fields of view on the display device, and the overlap between the fields of view is displayed on the display device as encrypted content such that the encrypted content is prevented from being copied from the display device while it is rendered on the display device. (Item 23) a display device configured to display at least the encrypted content component on the protected surface; Item 13. The processing platform of item 12, further comprising: (Item 24) 1. A system comprising: a processing platform according to item 12; a first source configured to provide unencrypted content components; a second source configured to provide the encrypted content component; a display device configured to display at least the encrypted content component on the protected surface; and A system comprising: [Brief explanation of the drawings]

[0011] The drawings illustrate the design and utility of various embodiments of the present disclosure. It should be noted that the drawings are not drawn to scale, and that elements of similar structure or function are represented by like reference numerals throughout the drawings. To better understand how to obtain the above-listed advantages and other advantages and objects of the various embodiments of the present disclosure, a more particular description of the present disclosure, briefly described above, will be given by reference to specific embodiments thereof, which are illustrated in the accompanying drawings. These drawings depict only exemplary embodiments of the present disclosure and therefore should not be considered limiting of its scope; the present disclosure will be described and explained with additional specificity and detail through the use of the accompanying drawings.

[0012] [Figure 1A] FIG. 1A illustrates an embodiment for rendering encrypted and unencrypted content on a protected surface of a display device, according to some embodiments.

[0013] [Figure 1B] FIG. 1B illustrates an embodiment for rendering unencrypted content onto an unprotected surface of a display device, according to some embodiments.

[0014] [Figure 1C] FIG. 1C illustrates an embodiment for rendering encrypted content on a protected surface of a display device and unencrypted content on an unprotected surface, according to some embodiments.

[0015] [Figure 2A] FIG. 2A illustrates a block diagram illustrating a content processing platform, according to some embodiments.

[0016] [Figure 2B-1] FIG. 2B illustrates a block diagram illustrating a content processing platform, according to some embodiments. [Figure 2B-2] FIG. 2B illustrates a block diagram illustrating a content processing platform, according to some embodiments.

[0017] [Figure 3A] FIG. 3A illustrates a block diagram illustrating a compositor for mapping content onto an unprotected or protected surface of a display device, according to some embodiments.

[0018] [Figure 3B] FIG. 3B illustrates a block diagram illustrating a combiner for mapping encrypted content to a protected surface of a display device and unencrypted content to an unprotected surface, according to some embodiments.

[0019] [Figure 4A] FIG. 4A is a flowchart illustrating a method for displaying encrypted content on a display device according to some embodiments.

[0020] [Figure 4B] FIG. 4B is a flowchart illustrating a method for displaying encrypted and unencrypted content on a display device according to some embodiments.

[0021] [Figure 5] FIG. 5 is a block diagram that schematically depicts an illustrative computing system, according to some embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0022] Detailed Description Embodiments provide systems, methods, and articles of manufacture for displaying encrypted content on a protected surface on a virtual reality (VR) or augmented reality (AR) display device. The encrypted content may be provided by an encrypted content source (e.g., a source that provides encrypted content). The content mapped to the protected surface may be rendered on the display device and prevented from being copied (e.g., recorded, stored, shared, or live-streamed on social media) from the display device.

[0023] In some embodiments, encrypted content (e.g., protected data) cannot be accessed by the content processing platform's central processing unit (CPU). Under protected mode, it is possible to read from both protected and unprotected surfaces. However, it is possible to write only to protected surfaces. Thus, although the encrypted content is rendered on the AR display device, the encrypted content is prevented from being accessed, shared, stored, and / or recorded.

[0024] In some embodiments, a secondary source (e.g., an unencrypted content source) may provide unencrypted content. When only unencrypted content is present, the content may be displayed on an unprotected surface on the display device. The content rendered on the unprotected surface can be stored, copied, or shared. In some embodiments, when the graphics processing platform receives both encrypted and unencrypted content, the content is displayed on a protected surface on the display device due to the presence of the encrypted content. That is, on a recording made from the display device, the protected surface appears only as an outline (e.g., an empty rectangle), while the content mapped to the unprotected surface may appear on the recording. Thus, embodiments enable the encrypted nature of protected content to be preserved in an AR experience.

[0025] In some embodiments, when the graphics processing platform receives both encrypted and unencrypted content, the content processing platform may be configured to map the encrypted content to a secured surface on the display device and to map the unencrypted content to an unsecured surface.

[0026] Various embodiments will now be described in detail with reference to the drawings, which are provided as illustrative examples of the present disclosure to enable those skilled in the art to practice the present disclosure. It should be noted that the following figures and examples are not intended to limit the scope of the present disclosure. Where certain elements of the present disclosure can be implemented partially or completely using known components (or methods or processes), only those portions of such known components (or methods or processes) necessary for understanding the present disclosure will be described, and detailed descriptions of other portions of such known components (or methods or processes) will be omitted so as not to obscure the present disclosure. Furthermore, various embodiments encompass present and future known equivalents of the components referenced herein as examples.

[0027] 1A illustrates an embodiment for rendering encrypted and unencrypted content on a protected surface of a display device, according to some embodiments. A user 100 may wear an AR headpiece including a display device 104. Within the field of view 110 of the user 100 may be an encrypted content source 106 that provides encrypted content and an unencrypted content source 108 that provides unencrypted content. In some embodiments, the encrypted content source 106 may include a television that offers subscription-based programming, and the unencrypted content source 108 may include a gaming console that displays desktop games.

[0028] A content processing platform, receiving input from encrypted content source 106 and unencrypted content source 108, may identify encrypted content components and determine that all input (both encrypted and unencrypted content) should be displayed on a protected surface on display device 104. The protected surface content displayed on display device 104 may be rendered on the display device and prevented from being copied from the display device. For example, if content displayed on the display device is recorded, the protected content may be recorded as an empty box, simply showing the outline of the box without rendering the protected surface content on the stored copy. Those skilled in the art will understand that protected content may be protected in any other suitable manner (e.g., scrambled photographs, distorted photographs, redacted content, use of substitute images, etc.).

[0029] The content processing platform may generate one or more protected surfaces 114 and may map the encrypted and unencrypted content components 124 and 126 to the protected surfaces 114. The content processing platform may then transmit the protected surfaces 114 and the encrypted and unencrypted content components 124 and 126 to the display device 104. In some embodiments, only the encrypted content components 124 may be present within the field of view 110 of the user 100 (e.g., the unencrypted content components 126 may not be present). As long as the encrypted content components 124 are within the field of view 110 of the user 100, only the protected surfaces 114 are displayed on the display device 104. Thus, all content is rendered on the display device 104 and may be prevented from being recorded, stored, or otherwise copied from the display device 104.

[0030] When the user 100 turns their gaze toward an unencrypted content source (e.g., a desktop game) providing unencrypted content such that the encrypted content source is no longer in the field of view 110, the unencrypted content will be displayed on the unprotected surface of the display device 104. That is, when the encrypted content is no longer in the field of view 110 of the user 100, the input provided to the content processing platform includes only the unencrypted content. This is illustrated in FIG. 1B.

[0031] 1B illustrates an exemplary embodiment for rendering unencrypted content on an unsecured surface of a display device, according to an exemplary embodiment of the present invention. The processing platform may generate one or more unsecured surfaces 116 and may map unencrypted content components 126 to the unsecured surfaces 116. The processing platform may then transmit the unsecured surfaces 116 and the unencrypted content components 126 to the display device 104. The unencrypted content components 126 may be rendered on the display device 104, or may be recorded, stored, or otherwise reproduced from the display device 104.

[0032] 1C illustrates another exemplary embodiment for rendering encrypted content on a protected surface and unencrypted content on an unprotected surface of a display device, according to an exemplary embodiment of the present invention. According to various embodiments, when both encrypted content component 124 and unencrypted content component 126 are within user 100's field of view 110, it may be possible to generate protected and unprotected surfaces, mapping encrypted content component 124 to protected surface 114 and unencrypted content component 126 to unprotected surface 116. Thus, both encrypted content component 124 and unencrypted content component 126 are rendered on display device 104, but only unencrypted content component 126 may be copied (e.g., stored, recorded, or shared) from display device 104. According to various embodiments, a recording generated from display device 104 may include unencrypted content component 126 and simply a box outline to represent protected surface 114, without indicating the content rendered within protected surface 114.

[0033] For example, in the above example where a user simultaneously views an encrypted content source (e.g., a television) and an unencrypted content source (e.g., a desktop game), the subscription-based programming may be mapped to a secured surface on the display device and the desktop game may be mapped to an unsecured surface on the display device. A recording made from the display device (e.g., social media posts from the display device, a live feed from the display device) may depict the desktop game, while the subscription-based programming provided by the television is not displayed (by way of example only, a box representing the television is provided on the recording).

[0034] Regardless of the details of the embodiments discussed above in connection with Figures 1A-1C, encrypted content components are prevented from being mapped to, and copied from, unprotected surfaces on a display device.

[0035] As described above, processing platform 200 may be configured to process content for display on a display device. Figure 2A illustrates a simplified exemplary block diagram illustrating processing platform 200, in accordance with an exemplary embodiment of the present invention. Exemplary processing platform 200 may include, among other elements, an encrypted content source 204, an unencrypted content source 206, a graphics processing engine 208, a shared memory 210, a surface generator 212, a compositor 214, a hardware controller 216, and a display device 218.

[0036] The graphics processing engine 208 may receive input (e.g., content components such as audio content, video content, text content, etc.) from encrypted content source 204 and unencrypted content source 206. The graphics processing engine 208 may pass the received content components to shared memory 210.

[0037] The content components from the encrypted content source 204 and the unencrypted content source 206 may also be provided to a surface generator 212. The surface generator 212 may generate one or more protected surfaces and / or one or more unprotected surfaces. The surface generator 212 may pass the generated protected and / or unprotected surfaces to a combiner 214.

[0038] The compositor 214 may receive content components from the shared memory 210. The compositor 214 may also receive generated protected and / or unprotected surfaces from the surface generator 212. The compositor 214 may determine whether the received content components are encrypted (e.g., protected) or unencrypted (e.g., unprotected). For example, the compositor 214 may determine the encryption status of a content component based on the source providing the content component and / or an identifier associated with the content component.

[0039] For embodiments in which the presence of encrypted content components results in all content being mapped to a protected surface (e.g., as discussed above in connection with FIG. 1A ), the combiner 214 may combine the encrypted and unencrypted content components into a single frame and map the single frame to one or more protected surfaces. The combiner 214 may then pass the single frame and one or more protected surfaces to the hardware controller 216. The hardware controller 216 may transmit the single frame (including the received encrypted and unencrypted content components) and one or more protected surfaces to the display device 218. The display device 218 displays the single frame on the protected surface such that the output displayed on the display device 218 cannot be duplicated from the display device 218 as long as an encrypted content component is present in the received input. Thus, the encrypted content cannot be shared, recorded, stored, or otherwise accessed from the display device 218 or the processing platform in general.

[0040] If the user modifies their field of view to include only unencrypted content, the compositor 214 will determine the content components read from the shared memory 210 as unencrypted content components. The compositor 214 may also receive generated unprotected surfaces from the surface generator 212. For embodiments in which only unencrypted content components are present (e.g., as discussed above in connection with FIG. 1B ), the compositor 214 may map the unencrypted content components to one or more unprotected surfaces. The compositor 214 may then pass the unencrypted content components and the one or more unprotected surfaces to the hardware controller 216. The hardware controller 216 may transmit the unencrypted content components and the one or more unprotected surfaces to the display device 218. The display device 218 displays the unencrypted content on the unprotected surfaces. The unencrypted content can be copied, shared, recorded, stored, or otherwise accessed from the display device 218 or the processing platform in general.

[0041] In some embodiments (e.g., as discussed above in connection with FIG. 1C ), the combiner 214 may be configured to map encrypted content components to one or more protected surfaces and map unencrypted content components to one or more unprotected surfaces. The combiner 214 may then merge the encrypted and unencrypted content components into a single frame and pass the single frame (along with the surface and mapping information) to the hardware controller 216.

[0042] 2A , there may not be a direct link between the source and the hardware controller 216. The hardware controller 216 receives only input from the compositor 214 for transmission to the display device 218. The hardware controller 216 may transmit a single frame (along with surface and mapping information) to the display device 218. The display device 218 displays encrypted content on one or more secured surfaces and unencrypted content on one or more unsecured surfaces. Thus, encrypted content cannot be copied, recorded, stored, or otherwise accessed from the display device 218, while unencrypted content can be freely copied.

[0043] 2B illustrates a detailed exemplary block diagram illustrating a processing platform according to an exemplary embodiment of the present invention. As illustrated in FIG. 2B, the graphics processing engine may generate a frame loop for each received content component. For encrypted content components, the graphics processing engine may generate an encrypted frame loop including an encrypted start frame, an encrypted render, and an encrypted end frame. For unencrypted content components, the graphics processing engine may also generate an unencrypted frame loop including an unencrypted start frame, an unencrypted render, and an unencrypted end frame. The graphics processing engine may transmit the frame loop to a compositor for further processing.

[0044] 3A illustrates an exemplary block diagram illustrating a compositor 214 for mapping content to an unprotected or protected surface of a display device, in accordance with an exemplary embodiment of the present invention. In response to receiving a content component from the shared memory, the compositor 214 may determine the encryption status of the content component (whether the content component includes encrypted or unencrypted content).

[0045] According to various embodiments, the synthesizer 214 may include a content identification module 302. The content identification module may analyze the received content components and determine the sources providing the content components. For example, the content identification module 302 may determine an identifier (ID) associated with the content components and / or the sources providing the content components.

[0046] If the content identification module 302 determines that the received content includes encrypted content, the content identification module 302 passes the processing to the encrypted content processing module 304. The encrypted content processing module 304 may map the encrypted content components to one or more protected surfaces to generate an encrypted composite surface 306.

[0047] If the content identification module 302 determines that the received content components include unencrypted content components, the content identification module 302 passes the processing to an unencrypted content processing module 308. The unencrypted content processing module 308 may map the encrypted content components to one or more unprotected surfaces to generate an unencrypted composite surface 310. The encrypted composite surface 306 and the unencrypted composite surface 310 may be passed to a final surface identification module 312.

[0048] The final surface identification module 312 may combine the received composite surfaces into a single surface (i.e., a protected surface if any encrypted content components are present, and an unprotected surface if only unencrypted content components are present). The combiner 214 may then pass the final surface 314 to the hardware controller 216 for transmission to the display device. The final surface 314 may include only a protected surface (e.g., when any encrypted content is present) or an unprotected surface (e.g., when only unencrypted content is present). Content for both the protected and unprotected surfaces may be displayed on the display device, but only content from the unprotected surface may be copied, recorded, stored, or otherwise accessed from the display device.

[0049] The combiner illustrated in FIG. 3A may be used in conjunction with the embodiments discussed above in connection with FIGS. 1A and 1B.

[0050] As described above, it may also be possible to map encrypted content components to protected surfaces and unencrypted content components to unprotected surfaces. Figure 3B illustrates an exemplary block diagram illustrating a combiner for mapping encrypted content components to protected surfaces and unencrypted content components to unprotected surfaces of a display device, according to an exemplary embodiment of the present invention.

[0051] In response to receiving the content components from the shared memory, the combiner 214 may determine the encryption status of the content components (whether the content is encrypted or unencrypted). According to various embodiments, the combiner 214 may include a content identification module 302. The content identification module may analyze the received content components and determine a source providing the content components. For example, the content identification module 302 may determine an identifier (ID) associated with the content components and / or the source providing the content components.

[0052] If the content identification module 302 determines that the received content component contains encrypted content, the content identification module 302 passes the processing to the encrypted content processing module 304. The encrypted content processing module 304 may map the encrypted content component to one or more protected surfaces to generate an encrypted composite surface 306.

[0053] If the content identification module 302 determines that the received content component includes unencrypted content, the content identification module 302 passes the processing to an unencrypted content processing module 308. The unencrypted content processing module 308 may map the encrypted content component to one or more unprotected surfaces to generate an unencrypted composite surface 310.

[0054] The encrypted composited surface 306 and the unencrypted composited surface 310 may then be merged into a single final surface 316 that includes the protected and unprotected surfaces. The compositor 214 may then pass the final surface 316 to the hardware controller 216 for transmission to a display device. Content for both the protected and unprotected surfaces may be displayed on the display device, but only content from the unprotected surface may be copied, recorded, stored, or otherwise accessed from the display device.

[0055] The combiner illustrated in FIG. 3BA may be used in conjunction with the embodiment discussed above in connection with FIG. 1C.

[0056] FIG. 4A is a simplified flowchart illustrating a method for displaying encrypted content components on a display according to some embodiments of a device of the present invention.

[0057] In step 402, the processing platform may receive multiple content components from one or more sources. According to various embodiments, the sources may provide encrypted and / or unencrypted content.

[0058] In step 404, the platform may identify encrypted content components among the plurality of content components. For example, the platform may analyze the received content components and determine an identifier associated with the source providing the content component and / or the content component itself. The platform may determine the encryption status of the content component based on the identifier.

[0059] In step 406, the platform may generate a protected surface. The encrypted content component may be configured to be rendered only on the protected surface. The protected surface may include a texture, having predetermined dimensions, that is mapped to a field of view on the display device.

[0060] In step 408, the platform may map the encrypted content component to a protected surface. Content mapped to a protected surface may be rendered on a display device but prevented from being copied from the display device. According to various embodiments, the platform may disable sharing, recording, and / or storing characteristics of the processing platform for the protected surface.

[0061] In some embodiments, the plurality of content components may also include an unencrypted content component. In optional step 410, the platform may identify an unencrypted content component among the plurality of content components. The platform may then merge the encrypted and unencrypted content components into a single output frame (step 412). Based on the presence of encrypted content, the platform may then map the single output frame to a protected surface such that when the encrypted and unencrypted content components are transmitted to a display device, both contents are mapped to a protected surface on the display device. Thus, both contents will be protected from being copied from the display device.

[0062] According to various embodiments, an encrypted content source may be provided in a first timeline, an unencrypted content source may be provided in a second timeline, and the platform may generate a third timeline with a generated single frame using content components from the encrypted and unencrypted content sources. According to various embodiments, the third timeline may be based on a refresh rate of a compositor.

[0063] In step 416, the platform may transmit the encrypted content component or single output frame mapped to the protected surface to the display device, where the encrypted content component or single output frame is rendered on the protected surface on the display device.

[0064] According to various embodiments, in response to receiving the plurality of component components, the platform may create a plurality of frame loops. Each frame loop may correspond to one of the plurality of content components. The platform may then queue the plurality of frame loops in a frame loop pipeline and retrieve a frame loop from the frame loop pipeline. Based on the source of the plurality of component components, the platform may be able to determine whether a frame loop corresponds to an encrypted or unencrypted content component.

[0065] FIG. 4B is a simplified flowchart illustrating a method for displaying encrypted and unencrypted content components on a display device according to some embodiments of the present invention.

[0066] In step 452, the processing platform may receive multiple content components from one or more sources. According to various embodiments, the sources may provide encrypted and / or unencrypted content.

[0067] In steps 454 and 456, the platform may identify encrypted and unencrypted content components, respectively, among the plurality of content components. For example, the platform may analyze the received content components and determine identifiers associated with the source providing the content components and / or the content components themselves. The platform may determine the encryption status of the content components based on the identifiers.

[0068] In step 458, the platform may generate at least one protected surface and at least one unprotected surface. The encrypted content component may be configured to be rendered only on the protected surface.

[0069] In step 460, the platform may map encrypted content components to protected surfaces and unencrypted content components to unprotected surfaces. Content mapped to protected surfaces may be rendered on a display device but may be prevented from being copied. According to various embodiments, the platform may disable sharing, recording, and / or storing processing platform characteristics for protected surfaces.

[0070] In step 462, the platform may merge the encrypted and unencrypted content components into a single output frame.

[0071] In step 464, the platform may transmit the single output frame to the display device. The encrypted content components are then rendered on a secured surface on the display device, and the unencrypted content components are rendered on an unsecured surface on the display device. Thus, encrypted content cannot be copied from the display device, but unencrypted content can be copied from the display device.

[0072] According to various embodiments, prior to transmitting a single output frame to a display device, the platform may distribute encrypted content components to a protected surface on the display device and unencrypted content components to an unprotected surface on the display device. In some embodiments, the protected and unprotected surfaces may be mapped to mutually exclusive fields of view on the display device. In other embodiments, the protected and unprotected surfaces may be mapped to two overlapping fields of view on the display device, with the overlap between the fields of view being displayed on the protected surface on the display device. System Architecture Overview

[0073] 5 is a block diagram of an illustrative computing system 500, according to some embodiments. The computer system 500 includes a bus 506 or other communication mechanism for communicating information, interconnecting subsystems and devices such as a processor 507, system memory 508 (e.g., RAM), static storage devices 509 (e.g., ROM), disk drives 510 (e.g., magnetic or optical), a communication interface 514 (e.g., modem or Ethernet card), a display 511 (e.g., CRT or LCD), input devices 512 (e.g., keyboard), and cursor control.

[0074] According to some embodiments, computer system 500 performs specific operations by processor 507 executing one or more sequences of one or more instructions contained in system memory 508. Such instructions may be read into system memory 508 from another computer-readable / usable medium, such as static storage device 509 or disk drive 510. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions to implement the present disclosure. Thus, embodiments are not limited to any specific combination of hardware circuitry and / or software. In one embodiment, the term "logic" may refer to any combination of software or hardware used to implement all or part of the present disclosure.

[0075] The terms "computer-readable medium" or "computer-usable medium," as used herein, refer to any medium that participates in providing instructions to processor 507 for execution. Such media may take many forms, including but not limited to, non-volatile media and volatile media. Non-volatile media include, for example, optical or magnetic disks, such as disk drive 510. Volatile media include dynamic memory, such as system memory 508.

[0076] Common forms of computer readable media include, for example, a floppy disk, a flexible disk, a hard disk, magnetic tape, any other magnetic medium, a CD-ROM, any other optical medium, punch cards, paper tape, any other physical medium with a pattern of holes, RAM, PROM, EPROM, FLASH-EPROM (e.g., NAND flash, NOR flash), any other memory chip or cartridge, or any other medium from which a computer can read.

[0077] In some embodiments, execution of the sequences of instructions for practicing the present disclosure is performed by a single computer system 500. According to some embodiments, two or more computer systems 500 coupled by a communications link 515 (e.g., a LAN, PTSN, or wireless network) may cooperate with each other to perform the sequences of instructions required to practice the present disclosure.

[0078] Computer system 500 may transmit and receive messages, data, and instructions, including programs, e.g., application code, through communications link 515 and communications interface 514. Received program code may be executed by processor 507 as it is received, and / or stored in disk drive 510 or other non-volatile storage for later execution. A database 532 in storage medium 531 may be used to store data accessible by system 500 via data interface 533.

[0079] The present disclosure includes methods that may be implemented using the subject devices. The methods may include the act of providing such a suitable device. Such provisioning may be performed by a user. In other words, the act of "providing" simply requires the user to obtain, access, approach, locate, configure, activate, power on, or otherwise act to provide the device required in the subject methods. The methods recited herein may occur in any order of the recited events and the recited sequence of events that is logically possible.

[0080] Exemplary aspects of the present disclosure are described above, along with details regarding material selection and manufacturing. As for other details of the present disclosure, these may be understood in connection with the aforementioned referenced patents and publications and are generally known or may be understood by those skilled in the art. The same may be true with respect to the method-based aspects of the present disclosure in terms of additional operations as commonly or logically adopted.

[0081] Additionally, while the present disclosure has been described with reference to several embodiments incorporating various features, the present disclosure is not limited to that described or illustrated, as each variation of the disclosure is discussed. Various modifications may be made to the present disclosure as described, and equivalents (whether recited herein or not included for purposes of brevity to some extent) may be substituted without departing from the spirit and scope of the present disclosure. Additionally, when a range of values ​​is provided, it is understood that all intervening values ​​between the upper and lower limits of that range, and any other stated value or intervening value within the stated range, are encompassed within the present disclosure.

[0082] It is also contemplated that any optional features of the described inventive variations may be set forth and claimed independently or in combination with any one or more of the features described herein. Reference to a singular item includes the possibility that plural identical items are present. More specifically, as used in this specification and the claims associated therewith, the singular forms "a," "an," "said," and "the" include plural references unless specifically stated otherwise. In other words, the use of articles allows for "at least one" of the items of the present subject matter in the above description and in the claims associated with this disclosure. Furthermore, it should be noted that such claims may be drafted to exclude any optional element. Accordingly, this language is intended to serve as a predicate for the use of exclusive terminology such as "solely," "only," and the like in connection with the recitation of claim elements, or the use of a "negative" limitation.

[0083] Without the use of such exclusive terminology, the term "comprising" in the claims associated with this disclosure shall be deemed to permit the inclusion of any additional elements, regardless of whether a given number of elements are recited in such claim, or the addition of features may be deemed to change the nature of the elements recited in such claim. Except as specifically defined herein, all technical and scientific terms used herein should be given the broadest possible commonly understood meaning while maintaining claim legitimacy.

[0084] The scope of the present disclosure should not be limited to the examples provided and / or this specification, but rather should be limited only by the scope of the claim language associated with this disclosure.

[0085] In the foregoing specification, the present disclosure has been described with reference to specific embodiments thereof. However, it will be apparent that various modifications and changes may be made therein without departing from the broader spirit and scope of the present disclosure. For example, the foregoing process flows are described with reference to a particular order of process actions. However, the order of many of the described process actions may be changed without affecting the scope or operation of the present disclosure. The specification and drawings are, therefore, to be regarded in an illustrative rather than a restrictive sense.

Claims

1. 1. A head mounted display system configured to display augmented reality image content, the head mounted display system comprising: a display having a protected surface; one or more processors; one or more memories storing instructions; Equipped with The instructions, when executed by the one or more processors, receiving, from a source, a plurality of content components including encrypted content components, the encrypted content components being decrypted into decrypted content components and output by the source; transmitting the plurality of content components to a synthesizer; receiving from the synthesizer the decrypted content component that is mapped to the protected surface within a field of view associated with the head mounted display system based at least on having been previously encrypted; displaying the decrypted content component on the protected surface of the display, the decrypted content component being simultaneously viewable on the source and the protected surface of the display; a head mounted display system configured to perform the steps of:

2. The head mounted display system of claim 1 , wherein the display comprises at least two protected surfaces.

3. 3. The head-mounted display system of claim 2, wherein at least one of the two protected surfaces displays at least one of (i) the encrypted content component or (ii) an unencrypted content component.

4. The plurality of content components includes an unencrypted content component, and the instructions further include: receiving from the compositor the unencrypted content components within the field of view associated with the head mounted display system and mapped to an unprotected surface of the display; displaying the decrypted content component on the unprotected surface of the display, the unencrypted content component being simultaneously viewable on the source and the display; 3. The head mounted display system of claim 2, wherein the head mounted display system is configured to perform:

5. 5. The head-mounted display system of claim 4, wherein the decrypted content component and the unencrypted content component are rendered on the display and are prevented from being copied from the display.

6. The head mounted display system of claim 5 , wherein copying is prevented through at least one of scrambling, distorting, redacting, or using alternative content.

7. 5. The head-mounted display system of claim 4, wherein at least a portion of the unencrypted content components and the decrypted content components are rendered on the display, the unencrypted content components are configured to be copied from the display, and the decrypted content components are prevented from being copied from the display.

8. The head mounted display system of claim 7 , wherein replicating the content includes at least one of (i) recording the content or (ii) storing the content.

9. 10. The head-mounted display system of claim 1, wherein the plurality of content components received from the source include at least one of: (i) audio content, (ii) video content, (iii) text content, or (iv) image content.

10. 2. The head-mounted display system of claim 1, wherein the instructions further configure the head-mounted display system to receive a single output frame from the synthesizer, the single output frame being mapped to one or more protected surfaces on the display.

11. The instructions further include: receiving the decrypted content component from the compositor, the decrypted content component configured to be rendered only on the protected surface; rendering the decrypted content component on the protected surface; and 10. The head mounted display system of claim 1, wherein the head mounted display system is configured to perform:

12. The instructions further include: In response to receiving the plurality of content components, creating a plurality of frame loops, each frame loop corresponding to one of the plurality of content components; and queuing said plurality of frame loops into a frame loop pipeline; 10. The head mounted display system of claim 1, wherein the head mounted display system is configured to perform:

13. 1. A method for displaying content components on a head mounted display, the method comprising: receiving, from a source, a plurality of content components including encrypted content components, the encrypted content components being decrypted into decrypted content components and output by the source; transmitting the plurality of content components to a synthesizer; receiving from the synthesizer the decrypted content component that is mapped to a protected surface within a field of view associated with the head mounted display based at least on having been previously encrypted; displaying the decrypted content component on the protected surface of the display, the decrypted content component being simultaneously viewable on the source and the protected surface of the display; A method comprising:

14. 14. The method of claim 13, further comprising receiving a single output frame from the combiner, the single output frame being mapped to one or more protected surfaces on the head mounted display.

15. receiving the protected surface from the compositor, the decrypted content component configured to be rendered only on the protected surface; rendering the decrypted content component on the protected surface; and 14. The method of claim 13, further comprising:

16. In response to receiving the plurality of content components, creating a plurality of frame loops, each frame loop corresponding to one of the plurality of content components; and queuing said plurality of frame loops into a frame loop pipeline; 14. The method of claim 13, further comprising:

17. The method of claim 13 , wherein the protected and unprotected surfaces are mapped to mutually exclusive fields of view on the head mounted display.

18. 14. The method of claim 13, wherein the protected and unprotected surfaces are mapped to two overlapping fields of view on the head-mounted display, the overlap between the fields of view being within a field of view associated with the head-mounted display, and the decrypted content components are displayed on the head-mounted display as decrypted content such that the decrypted content components are prevented from being copied from the head-mounted display while being rendered on the head-mounted display.

19. 14. The method of claim 13, wherein the decrypted content that is mapped to the protected surface is rendered on the head mounted display and is prevented from being copied from the head mounted display.

20. 1. A non-transitory computer-readable medium storing a set of instructions that, when executed by one or more processors of a head-mounted display system, receiving, from a source, a plurality of content components including encrypted content components, the encrypted content components being decrypted into decrypted content components and output by the source; transmitting the plurality of content components to a synthesizer; receiving from the compositor the decrypted content component that is mapped based at least in part on the previously encrypted content component to a protected surface within a field of view associated with a head-mounted display system, the protected surface being provided on a display of the head-mounted display system; displaying the decrypted content component on the protected surface of the display, the decrypted content component being simultaneously viewable on the source and the protected surface of the display; A non-transitory computer-readable medium for causing a process to be performed, including:

Images