Processing secure content on a virtual reality system

Abstract

Described herein are processes and techniques to identify encrypted content within a field of view of a user of a VR / AR system and to appropriately handle the encrypted content. A user of a VR / AR technology can have protected content within the user's field of view. Encrypted content is mapped to one or more protected surfaces on a display device. Content mapped to a protected surface can be rendered on the display device, but is prevented from being copied from the display device.

Description

[0001] Cross-reference to related applications

[0002] This application claims the benefit of priority to U.S. Provisional Patent Application No. 63 / 014,645, filed April 23, 2020, entitled “Proceeding Secure Content on Avitroal Reality System,” the entire contents of which are incorporated herein by reference for all purposes. Background Technology

[0003] Modern computing and display technologies have facilitated the development of so-called "virtual reality" or "augmented reality" experience systems, in which digitally generated images, or portions thereof, are presented to the user in a way that makes them appear real or perceptible as real in wearable devices. Virtual reality or "VR" scenarios typically involve the presentation of digital or virtual image information, but are opaque to other actual real-world visual inputs; augmented reality or "AR" scenarios typically involve the presentation of digital or virtual image information as an enhancement to the visualization of the actual world around the user.

[0004] Mixed reality (such as VR or AR) scenarios typically include the presentation of virtual content (e.g., color images and sounds) corresponding to virtual objects about real-world objects. For example, a user of VR / AR technology might be in a real-world, physical, room-like setting characterized by furniture, windows, a computer screen on a desktop, and a television. In addition to these items, the user of VR / AR technology also perceives that they are "seeing" virtual objects that do not exist in the real world. Virtual objects can take any of a wide variety of forms and have a wide range of data, information, concepts, or logical structures that can be represented as images. Non-limiting examples of virtual objects may include: virtual text objects, virtual number objects, virtual alphanumeric objects, virtual marker objects, virtual field objects, virtual chart objects, virtual map objects, virtual instrument objects, or virtual visual representations of physical objects.

[0005] According to various embodiments, VR / AR technology users may have protected content (e.g., pay-TV programming on a television in the above real-room setup example) within their field of vision. Such protected (e.g., encrypted) content should not be allowed to be copied (e.g., recorded, stored, or distributed) from the AR technology display device. Current VR / AR technologies do not allow for the protection of encrypted content on display devices. Summary of the Invention

[0006] This describes the processes and techniques for identifying encrypted content within the user's field of view in a VR / AR system and for appropriately processing that encrypted content.

[0007] According to various embodiments, VR / AR users can have protected content (e.g., pay-TV programming on a television) within their field of view. When displayed on a VR / AR display device, such protected (e.g., encrypted) content should be protected. For example, while encrypted content may be rendered on the display device, it may be prevented from being copied from the display device (e.g., recorded, stored, or distributed). Embodiments provide techniques for displaying encrypted content in a protected manner on a display device. For example, embodiments allow content to be mapped onto one or more protected surfaces on the display device when the system recognizes encrypted content within the user's field of view. Content mapped to one or more protected surfaces may be rendered on the display device and prevented from being copied from the display device.

[0008] The embodiments provide a method for displaying content components on a display device. The method includes receiving a plurality of content components by a processing platform. The method further includes identifying an encrypted content component among the plurality of content components by the processing platform. The processing platform sends the encrypted content component to the display device. At least the encrypted content component is mapped to a protected surface.

[0009] Various embodiments provide a processing platform including one or more processors; and one or more storage devices storing instructions that, when executed on the one or more processors, cause the one or more processors to: receive a plurality of content components, identify an encrypted content component among the plurality of content components, and send the encrypted content component to a display device. At least the encrypted content component is mapped to a protected surface.

[0010] A further embodiment provides a system comprising: a processing platform; a first source configured to provide unencrypted content components; a second source configured to provide encrypted content components; and a display device configured to display the encrypted content components at least on a protected surface. The processing platform includes one or more processors; and one or more storage devices storing instructions that, when executed on the one or more processors, cause the one or more processors to: receive a plurality of content components, identify an encrypted content component among the plurality of content components, and send the encrypted content component to the display device. At least the encrypted content components are mapped to the protected surface.

[0011] Additional and other objects, features and advantages disclosed are described in the detailed description, drawings and claims. Attached Figure Description

[0012] The accompanying drawings illustrate the design and practicality of various embodiments of this disclosure. It should be noted that these drawings are not to scale, and elements with similar structures or functions are indicated by similar reference numerals throughout the drawings. To better understand how other advantages and objectives of the various embodiments of this disclosure as described above are obtained, the disclosure, which has been briefly described above, will be described in more detail with reference to specific embodiments shown in the accompanying drawings. It is understood that these drawings only depict typical embodiments of the disclosure and are therefore not intended to limit its scope. This disclosure will be described and explained with additional specificity and detail using the accompanying drawings, in which:

[0013] Figure 1A Examples of rendering encrypted and unencrypted content on a protected surface of a display device are shown, according to some embodiments.

[0014] Figure 1B Examples of rendering unencrypted content on an unprotected surface of a display device are shown, according to some embodiments.

[0015] Figure 1C Examples of rendering encrypted content on a protected surface of a display device and rendering unencrypted content on an unprotected surface are shown, according to some embodiments.

[0016] Figure 2A A block diagram illustrating a content processing platform according to some embodiments is shown;

[0017] Figure 2B A block diagram illustrating a content processing platform according to some embodiments is shown;

[0018] Figure 3A A block diagram illustrating a synthesizer for mapping content to an unprotected or protected surface of a display device, according to some embodiments;

[0019] Figure 3B A block diagram is shown of a synthesizer, according to some embodiments, for mapping encrypted content to a protected surface of a display device and mapping unencrypted content to an unprotected surface of a display device;

[0020] Figure 4A This is a flowchart illustrating a method for displaying encrypted content on a display device according to some embodiments;

[0021] Figure 4B This is a flowchart illustrating a method for displaying encrypted and unencrypted content on a display device according to some embodiments; and

[0022] Figure 5 This is a block diagram illustrating an illustrative computing system based on some embodiments. Detailed Implementation

[0023] The embodiments provide systems, methods, and articles for displaying encrypted content on a protected surface of a virtual reality (VR) or augmented reality (AR) display device. The encrypted content may be provided by an encrypted content source (e.g., a source providing encrypted content). The content mapped onto the protected surface may be rendered on the display device and is protected from copying from the display device (e.g., recording, storing, sharing, or live streaming on social media).

[0024] In some embodiments, encrypted content (e.g., protected data) cannot be accessed from the central processing unit (CPU) of the content processing platform. In protected mode, it can be read from both protected and unprotected surfaces. However, it can only be written to protected surfaces. Therefore, when encrypted content is rendered on an AR display device, access, sharing, storage, and / or recording of the encrypted content is prevented.

[0025] In some embodiments, an auxiliary source (e.g., an unencrypted content source) can provide unencrypted content. When only unencrypted content is present, the content may be displayed on an unprotected surface of the display device. Content rendered on the unprotected surface can be stored, copied, or shared. In some embodiments, when the graphics processing platform receives both encrypted and unencrypted content, the content is displayed on a protected surface of the display device due to the presence of the encrypted content. That is, on a record created from the display device, the protected surface may only be displayed as an outline (e.g., an empty rectangle), while the content mapped onto the protected surface can be displayed on the record. Therefore, the embodiments allow the encrypted nature of the protected content to be maintained in AR experiences.

[0026] In some embodiments, when the graphics processing platform receives both encrypted and unencrypted content, the content processing platform may be configured to map the encrypted content onto a protected surface and the unencrypted content onto an unprotected surface on the display device.

[0027] Various embodiments will now be described in detail with reference to the accompanying drawings, which are provided as illustrative examples to enable those skilled in the art to practice the disclosure. It is important to note that the following figures and examples are not intended to limit the scope of this disclosure. If certain elements of this disclosure may be partially or fully implemented using known components (or methods or processes), only the portions of such known components (or methods or processes) necessary for understanding this disclosure will be described, while detailed descriptions of other portions of such known components (or methods or processes) will be omitted so as not to obscure this disclosure. Furthermore, by way of illustration, the various embodiments include current and future known equivalents of the components described herein.

[0028] Figure 1AThis illustration shows embodiments of rendering encrypted and unencrypted content on a protected surface of a display device, according to some examples. User 100 may be wearing an AR headset that includes display device 104. Within user 100's field of vision 110, there may be an encrypted content source 106 providing encrypted content and an unencrypted content source 108 providing unencrypted content. In some embodiments, encrypted content source 106 may include a television providing subscription-based programming, while unencrypted content source 108 may include a game console displaying tabletop games.

[0029] The content processing platform receiving input from encrypted content source 106 and unencrypted content source 108 can identify the encrypted content components and determine that all input (both encrypted and unencrypted content) will be displayed on the protected surface of display device 104. The content displayed on the protected surface of display device 104 can be rendered on the display device and is prevented from being copied from the display device. For example, if recording the content displayed on the display device, the protected content can be recorded as an empty frame, showing only the outline of the frame, without rendering the content of the protected surface on a stored copy. Those skilled in the art will understand that protected content can be protected in any other suitable manner (e.g., scrambling images, distorting images, editing content, using alternative images, etc.).

[0030] The content processing platform can generate one or more protected surfaces 114 and map encrypted content components 124 and unencrypted content components 126 onto the protected surfaces 114. The content processing platform can then send the protected surfaces 114, along with the encrypted and unencrypted content components 124 and 126, to the display device 104. In some embodiments, only the encrypted content component 124 may appear within the user 100's field of view 110 (e.g., the unencrypted content component 126 may not exist). As long as the encrypted content component 124 is within the user 100's field of view 110, only the protected surfaces 114 are displayed on the display device 104. Therefore, all content can be rendered on the display device 104 and is prevented from being recorded, stored, or otherwise copied from the display device 104.

[0031] When user 100 directs their gaze to an unencrypted content source (such as a board game) that provides unencrypted content, so that the encrypted content source is no longer in their field of vision 110, the unencrypted content will be displayed on the unprotected surface of display device 104. In other words, when the encrypted content is not within user 100's field of vision 110, the input provided to the content processing platform consists only of unencrypted content. Figure 1B This is shown.

[0032] Figure 1BAn exemplary embodiment of the invention is illustrated for rendering unencrypted content on an unprotected surface of a display device. A processing platform may generate one or more unprotected surfaces 116 and map unencrypted content components 126 onto the unprotected surfaces 116. The processing platform may then send the unprotected surfaces 116 and the unencrypted content components 126 to a display device 104. The unencrypted content components 126 may be rendered on the display device 104 and may be recorded, stored, or otherwise copied from the display device 104.

[0033] Figure 1C Another exemplary embodiment of the invention is illustrated for rendering encrypted content on a protected surface of a display device and rendering unencrypted content on an unprotected surface. According to various embodiments, when both encrypted content component 124 and unencrypted content component 126 are within the field of view 110 of user 100, a protected surface and an unprotected surface can be generated, with encrypted content component 124 mapped to the protected surface 114 and unencrypted content component 126 mapped to the unprotected surface 116. Therefore, although both encrypted content component 124 and unencrypted content component 126 are rendered on display device 104, only unencrypted content component 126 can be copied from display device 104 (e.g., stored, recorded, or shared). According to various embodiments, a record generated from display device 104 may include unencrypted content component 126 and only a frame outline representing the protected surface 114, without showing the content rendered in the protected surface 114.

[0034] For example, in the example above, a user simultaneously views encrypted content sources (e.g., television) and unencrypted content sources (e.g., board games). Subscription-based programming can be mapped to a protected surface on the display device, and board games can be mapped to an unprotected surface. Records created from the display device (e.g., social media posts from the display device, real-time feedback from the display device) can show board games, while subscription-based programming provided by the television will not be displayed (e.g., only a box representing the television will be provided in the record).

[0035] Regardless of the above combination Figure 1A-1C In the specific case of the discussed embodiments, encrypted content components are prevented from being mapped onto unprotected surfaces of the display device and from being copied therefrom.

[0036] As described above, the processing platform 200 can be configured to process content displayed on a display device. Figure 2AA simplified example block diagram of a processing platform 200 according to an exemplary embodiment of the present invention is shown. The example processing platform 200 may include an encrypted content source 204, an unencrypted content source 206, a graphics processing engine 208, a shared memory 210, a surface generator 212, a synthesizer 214, a hardware controller 216, and a display device 218, as well as other elements.

[0037] The graphics processing engine 208 can receive input (such as content components like audio content, video content, and text content) from encrypted content source 204 and unencrypted content source 206. The graphics processing engine 208 can then pass the received content components to the shared memory 210.

[0038] Content components from encrypted content source 204 and unencrypted content source 206 can also be provided to surface generator 212. Surface generator 212 can generate one or more protected surfaces and / or one or more unprotected surfaces. Surface generator 212 can then pass the generated protected and / or unprotected surfaces to synthesizer 214.

[0039] Synthesizer 214 may receive content components from shared memory 210. Synthesizer 214 may also receive generated protected and / or unprotected surfaces from surface generator 212. Synthesizer 214 may determine whether the received content components are encrypted (e.g., protected) or unencrypted (e.g., unprotected). For example, synthesizer 214 may determine the encryption state of the content components based on the source providing the content components and / or an identifier associated with the content components.

[0040] For embodiments where encrypted content components cause all content to be mapped onto the protected surface (e.g., as combined above) Figure 1A As described above, synthesizer 214 can combine encrypted and unencrypted content components into a single frame and map the single frame to one or more protected surfaces. Synthesizer 214 then passes the single frame and one or more protected surfaces to hardware controller 216. Hardware controller 216 can send the single frame (including the received encrypted and unencrypted content components) and one or more protected surfaces to display device 218. Display device 218 displays the single frame on the protected surfaces such that the output displayed on display device 218 cannot be copied from display device 218 as long as encrypted content components are present in the received input. Therefore, encrypted content is generally not shared, recorded, stored, or otherwise accessed from display device 218 or the processing platform.

[0041] When a user modifies their view to include only unencrypted content, synthesizer 214 will determine that the content component retrieved from shared memory 210 is an unencrypted content component. Synthesizer 214 may also receive generated unprotected surfaces from surface generator 212. For embodiments where only unencrypted content components exist (e.g., as combined above)... Figure 1B (As described above), synthesizer 214 can map unencrypted content components onto one or more unprotected surfaces. Synthesizer 214 can then pass the unencrypted content components and one or more unprotected surfaces to hardware controller 216. Hardware controller 216 can send the unencrypted content components and one or more unprotected surfaces to display device 218. Display device 218 displays the unencrypted content on the unencrypted surfaces. Typically, the unencrypted content can be copied, shared, recorded, stored, or otherwise accessed from display device 218 or processing platform.

[0042] In some embodiments (e.g., as combined above) Figure 1C The synthesizer 214 can be configured to map encrypted content components to one or more protected surfaces and unencrypted content components to one or more unprotected surfaces. The synthesizer 214 can then merge the encrypted and unencrypted content components into a single frame and pass that single frame (along with the surface and mapping information) to the hardware controller 216.

[0043] like Figure 2A As shown, there may not be a direct link between the source and hardware controller 216. Hardware controller 216 only receives input from synthesizer 214 for transmission to display device 218. Hardware controller 216 may send a single frame (along with surface and mapping information) to display device 218. Display device 218 displays encrypted content on one or more protected surfaces and unencrypted content on one or more unprotected surfaces. Therefore, while encrypted content cannot be copied, recorded, stored, or otherwise accessed from display device 218, unencrypted content can be freely copied.

[0044] Figure 2B The diagram illustrates a detailed example block diagram of a processing platform according to an exemplary embodiment of the present invention. As shown in 2B, the graphics processing engine can generate a frame loop for each of the received content components. The graphics processing engine can generate an encrypted frame loop for encrypted content components, including an encrypted start frame, an encrypted render frame, and an encrypted end frame. The graphics processing engine can also generate an unencrypted frame loop for unencrypted content components, including an unencrypted start frame, an unencrypted render frame, and an unencrypted end frame. The graphics processing engine can send the frame loop to the compositor for further processing.

[0045] Figure 3AAn example block diagram of a synthesizer 214, according to an exemplary embodiment of the present invention, for mapping content to an unprotected or protected surface of a display device. Upon receiving a content component from a shared memory, the synthesizer 214 can determine the encryption state of the content component (whether the content component includes encrypted or unencrypted content).

[0046] According to various embodiments, synthesizer 214 may include content recognition module 302. Content recognition module can analyze received content components and determine the source providing the content components. For example, content recognition module 302 can determine an identifier (ID) associated with the content component and / or the source providing the content component.

[0047] If the content recognition module 302 determines that the received content includes encrypted content, then the content recognition module 302 passes the processing to the encrypted content processing module 304. The encrypted content processing module 304 can map the encrypted content components to one or more protected surfaces and generate an encrypted composite surface 306.

[0048] If the content recognition module 302 determines that the received content component includes an unencrypted content component, then the content recognition module 302 passes the processing to the unencrypted content processing module 308. The unencrypted content processing module 308 can map the encrypted content component to one or more unencrypted surfaces and generate an unencrypted composite surface 310. The encrypted composite surface 306 and the unencrypted composite surface 310 can be passed to the final surface recognition module 312.

[0049] The final surface identification module 312 can combine the received synthesized surfaces into a single surface (i.e., a protected surface if any encrypted content components are present; an unprotected surface if only unencrypted content components are present). The synthesizer 214 can then pass the final surface 314 to the hardware controller 216 for transmission to the display device. The final surface 314 may include only protected surfaces (e.g., when any encrypted content is present) or unprotected surfaces (e.g., when only unencrypted content is present). While the content of both protected and unprotected surfaces can be displayed on the display device, only content from the unprotected surface can be copied, recorded, stored, or otherwise accessed from the display device.

[0050] Figure 3A The synthesizer shown can be combined with the one above. Figure 1A and Figure 1B The discussed embodiments are used in combination.

[0051] As mentioned above, encrypted content components can also be mapped to protected surfaces, and unencrypted content components can be mapped to unprotected surfaces. Figure 3BAn exemplary block diagram is shown of a synthesizer according to an exemplary embodiment of the present invention for mapping encrypted content components to a protected surface of a display device and mapping unencrypted content components to an unprotected surface.

[0052] After receiving a content component from the shared memory, synthesizer 214 can determine the encryption status of the content component (whether the content is encrypted or unencrypted). According to various embodiments, synthesizer 214 may include a content recognition module 302. The content recognition module can analyze the received content component and determine the source providing the content component. For example, content recognition module 302 can determine an identifier (ID) associated with the content component and / or the source providing the content component.

[0053] If the content recognition module 302 determines that the received content component includes encrypted content, the content recognition module 302 passes the processing to the encrypted content processing module 304. The encrypted content processing module 304 can map the encrypted content component to one or more protected surfaces and generate an encrypted composite surface 306.

[0054] If the content recognition module 302 determines that the received content component includes unencrypted content, the content recognition module 302 will pass the processing to the unencrypted content processing module 308. The unencrypted content processing module 308 can map the encrypted content component to one or more unencrypted surfaces and generate an unencrypted composite surface 310.

[0055] The encrypted composite surface 306 and the unencrypted composite surface 310 can then be merged into a single final surface 316, which includes both a protected and an unprotected surface. The compositer 214 can then pass the final surface 316 to the hardware controller 216 for transmission to a display device. While the contents of both the protected and unprotected surfaces can be displayed on the display device, only the content from the unprotected surface can be copied, recorded, stored, or otherwise accessed from the display device.

[0056] Figure 3B The synthesizer shown in A can be combined with the above. Figure 1C The discussed embodiments are used in combination.

[0057] Figure 4A This is a simplified flowchart illustrating a method for displaying encrypted content components on a display device according to some embodiments of the present invention.

[0058] At step 402, the processing platform may receive multiple content components from one or more sources. According to various embodiments, the sources may provide encrypted and / or unencrypted content.

[0059] At step 404, the platform can identify encrypted content components among multiple content components. For example, the platform can analyze the received content components and determine identifiers associated with the source providing the content components and / or with the content components themselves. The platform can determine the encryption state of the content components based on the identifiers.

[0060] At step 406, the platform may generate a protected surface. Encrypted content components may be configured to render only on the protected surface. The protected surface may include a texture with a predetermined size mapped to the field of view on the display device.

[0061] At step 408, the platform can map the encrypted content components to the protected surface. The content mapped to the protected surface is rendered on the display device but is prevented from being copied from the display device. According to various embodiments, the platform can disable sharing, recording, and / or storage features of the processing platform regarding the protected surface.

[0062] In some embodiments, the multiple content components may further include unencrypted content components. At optional step 410, the platform may identify the unencrypted content component among the multiple content components. The platform may then merge the encrypted and unencrypted content components into a single output frame (step 412). Based on the presence of encrypted content, the platform may map the single output frame to a protected surface. This ensures that when the encrypted and unencrypted content components are sent to the display device, both are mapped to a protected surface on the display device. Therefore, both contents are protected and prevented from being copied from the display device.

[0063] According to various embodiments, an encrypted content source can be provided at a first timeline, an unencrypted content source can be provided at a second timeline, and the platform can generate a single frame at a third timeline using content components from both the encrypted and unencrypted content sources. According to various embodiments, the third timeline can be based on the compositor's refresh rate.

[0064] At step 416, the platform can send a single output frame or encrypted content component mapped to the protected surface to the display device. The encrypted content component or the single output frame is rendered on the protected surface of the display device.

[0065] According to various embodiments, after receiving multiple component sources, the platform can create multiple frame cycles. Each frame cycle can correspond to one of the multiple content components. The platform can then queue the multiple frame cycles into a frame cycle pipeline and obtain frame cycles from the frame cycle pipeline. The platform can determine whether a frame cycle corresponds to an encrypted or unencrypted content component based on the multiple component source sources.

[0066] Figure 4BThis is a simplified flowchart illustrating a method for displaying encrypted and unencrypted content components on a display device according to some embodiments of the present invention.

[0067] At step 452, the processing platform may receive multiple content components from one or more sources. According to various embodiments, the sources may provide encrypted and / or unencrypted content.

[0068] At steps 454 and 456, the platform can identify encrypted and unencrypted content components among multiple content components. For example, the platform can analyze the received content components and determine identifiers associated with the source providing the content components and / or with the content components themselves. The platform can determine the encryption state of the content components based on the identifiers.

[0069] At step 458, the platform can generate at least one protected surface and at least one unprotected surface. Encrypted content components can be configured to render only on the protected surface.

[0070] At step 460, the platform can map encrypted content components to a protected surface and unencrypted content components to an unprotected surface. Content mapped to the protected surface can be rendered on a display device but is protected from copying. According to various embodiments, the platform can disable sharing, recording, and / or storage features of the processing platform regarding the protected surface.

[0071] At step 462, the platform can merge the encrypted and unencrypted content components into a single output frame.

[0072] At step 464, the platform may send a single output frame to the display device. The encrypted content component is then rendered on the protected surface of the display device, while the unencrypted content component is rendered on the unprotected surface of the display device. Therefore, encrypted content cannot be copied from the display device, but unencrypted content can be copied from the display device.

[0073] According to various embodiments, before sending a single output frame to the display device, the platform may assign encrypted content components to a protected surface on the display device and unencrypted content components to an unprotected surface on the display device. In some embodiments, the protected and unprotected surfaces may be mapped to fields of view on the display device that do not overlap with each other. In other embodiments, the protected and unprotected surfaces are mapped to two overlapping fields of view on the display device, and the overlap between the fields of view may be displayed on the protected surface on the display device.

[0074] System Architecture Overview

[0075] Figure 5This is a block diagram of an illustrative computing system 500 according to some embodiments. The computer system 500 includes a bus 506 or other communication mechanism for communicating information, which connects subsystems and devices such as a processor 507, system memory 508 (e.g., RAM), static storage device 509 (e.g., ROM), disk drive 510 (e.g., magnetic or optical), communication interface 514 (e.g., modem or Ethernet card), display 511 (e.g., CRT or LCD), input device 512, and cursor control.

[0076] According to some embodiments, computer system 500 performs a specific operation by executing one or more sequences of one or more instructions contained in system memory 508 via processor 507. Such instructions may be read into system memory 508 from other computer-readable / usable media, such as static storage device 509 or disk drive 510. In alternative embodiments, hardwired circuitry may be used instead of or in combination with software instructions to implement this disclosure. Therefore, embodiments are not limited to any particular combination of hardware circuitry and / or software. In one embodiment, the term "logic" should refer to any combination of software or hardware used to implement all or part of this disclosure.

[0077] As used herein, the terms "computer-readable medium" or "computer-usable medium" refer to any medium that participates in providing instructions for execution to processor 507. Such media can take many forms, including, but not limited to, non-volatile and volatile media. Non-volatile media include, for example, optical discs or magnetic disks, such as disk drive 510. Volatile media include dynamic memory, such as system memory 508.

[0078] Common forms of computer-readable media include, for example, floppy disks, flexible disks, hard disks, magnetic tapes, any other magnetic media, CD-ROMs, any other optical media, punched cards, paper tapes, any other physical media with perforated patterns, RAM, PROMs, EPROMs, FLASH-EPROMs (e.g., NAND flash memory, NOR flash memory), any other memory chips or cassettes, or any other media that a computer can read.

[0079] In some embodiments, the execution of the instruction sequence of this disclosure is performed by a single computer system 500. According to some embodiments, two or more computer systems 500 coupled by a communication link 515 (e.g., a LAN, PTSN, or wireless network) can coordinate with each other to execute the instruction sequence required to implement this disclosure.

[0080] Computer system 500 can send and receive messages, data, and instructions, including programs, i.e., application code, via communication link 515 and communication interface 514. Received program code can be executed by processor 507 upon receipt and / or stored in disk drive 510 or other non-volatile storage for later execution. Database 532 in storage medium 531 can be used to store data accessible to system 500 via data interface 533.

[0081] This disclosure includes methods that can be performed using this device. Such methods may include actions of providing such suitable device. Such provision may be performed by a user. In other words, the act of “providing” merely requires the user to obtain, access, approach, locate, set, activate, power, or otherwise provide the desired device within this method. The methods described herein may be performed in any logically possible order, or in the order of the events.

[0082] Exemplary aspects of this disclosure, along with details regarding material selection and manufacturing, have been set forth above. Other details of this disclosure may relate to the patents and publications referenced above and are well-known or understood by those skilled in the art. The same may be true of the method-based aspects of the disclosure in terms of additional actions typically or logically employed.

[0083] Furthermore, although this disclosure has been described with reference to several examples that optionally include various characteristics, this disclosure is not limited to what is intended to be described or indicated for each variation of this disclosure. Various changes may be made to the described disclosure, and equivalents (whether stated herein or omitted for brevity) may be substituted without departing from the true spirit and scope of the disclosure. Furthermore, if a range of values ​​is provided, it can be understood that every intermediate value between the upper and lower limits of the range and any other specified or intermediate value within the specified range is included in this disclosure.

[0084] Furthermore, any optional features of the invention variations may be stated and claimed individually or in combination with any one or more features described herein. Reference to a single item includes the possibility of multiple instances of the same item. More specifically, as used herein and in related claims, the singular forms “a,” “an,” “the,” and “the” include plural references unless otherwise specified. In other words, the use of articles allows for “at least one” subject matter item in the foregoing description and in the claims associated with this disclosure. It should be further noted that any optional elements may be excluded when drafting such claims. Therefore, this statement is intended as a basis for the use of such exclusive terms as “alone,” “only,” etc., or the use of the restrictive term “negative,” in conjunction with the statement of claim elements.

[0085] Without using such proprietary terminology, the term "comprising" in the claims associated with this disclosure shall allow for the inclusion of any additional elements—whether a given number of elements are listed in such a claim, or the addition of a feature may be considered to change the nature of an element listed in such a claim. Except as specifically defined herein, all technical and scientific terms used herein shall be given the broadest possible general meaning while preserving the validity of the claims.

[0086] The scope of this disclosure is not limited to the examples and / or subject matter provided, but only to the scope of the language of the claims associated with this disclosure.

[0087] In the foregoing specification, the disclosure has been described with reference to specific embodiments thereof. However, it will be apparent that various modifications and alterations can be made thereto without departing from the broader spirit and scope of the disclosure. For example, the process flow described above is described with reference to a specific sequence of process operations. However, the sequence of many described process operations can be changed without affecting the scope or operation of the disclosure. Therefore, the specification and drawings should be considered illustrative rather than restrictive.

Claims

1. A method for displaying content components on a display device, the method comprising: The processing platform receives multiple content components from the source, including encrypted content components. The processing platform identifies the encrypted content component among the plurality of content components, wherein at least the encrypted content component received from the source is mapped onto the protected surface of the display device; and The processing platform sends the encrypted content component to the protected surface of the display device, wherein the encrypted content component is viewed simultaneously on the protected surface of the display device and the source.

2. The method according to claim 1, further comprising: The processing platform identifies unencrypted content components among the multiple content components; as well as The processing platform merges the encrypted content components and the unencrypted content components into a single output frame; as well as The processing platform sends the single output frame to the display device, wherein the single output frame is mapped to one or more protected surfaces on the display device.

3. The method according to claim 1, further comprising: Generate the protected surface, wherein the encrypted content component is configured to be rendered only on the protected surface; and The protected surface is sent to the display device, wherein the encrypted content component is rendered on the protected surface of the display device.

4. The method according to claim 1, further comprising: After receiving the multiple content components Create multiple frame loops, where each frame loop corresponds to one of the multiple content components; The multiple frames are cyclically queued into the frame loop pipeline; Obtain a frame cycle from the frame cycle pipeline; and Based on the sources of the multiple content components, determine whether the frame cycle corresponds to the encrypted content component or the unencrypted content component.

5. The method according to claim 1, wherein, The content mapped onto the protected surface is rendered on the display device and prevented from being copied from the display device.

6. The method according to claim 1, further comprising: Disable the processing platform from recording or storing features relative to the protected surface.

7. The method according to claim 1, wherein, The protected surface includes a texture having a predetermined size that maps to the field of view on the display device.

8. The method according to claim 1, further comprising: The processing platform identifies unencrypted content components among the multiple content components; as well as The processing platform merges the encrypted content components and the unencrypted content components into a single output frame; as well as The processing platform sends the single output frame to the display device, wherein the unencrypted content component is mapped onto an unprotected surface on the display device.

9. The method according to claim 8, further comprising: Before sending the single output frame to the display device. The encrypted content component is assigned to the protected surface on the display device, and the unencrypted content component is assigned to the unprotected surface on the display device.

10. The method according to claim 8, wherein, The protected surface and the unprotected surface are mapped onto mutually exclusive fields of view on the display device.

11. The method according to claim 8, wherein, The protected surface and the unprotected surface are mapped onto two overlapping fields of view on the display device, wherein the overlap between the fields of view is displayed as encrypted content on the display device to prevent the encrypted content from being copied from the display device when it is rendered on the display device.

12. A processing platform, comprising: One or more processors; as well as One or more storage devices, which store instructions that, when executed on the one or more processors, cause the one or more processors to: Receive multiple content components from a source, the multiple content components including encrypted content components; Identifying the encrypted content component among the plurality of content components, wherein at least the encrypted content component received from the source is mapped onto a protected surface of the display device; and The encrypted content component is sent to the protected surface of the display device, wherein the encrypted content component is viewed simultaneously on the protected surface of the display device and the source.

13. The processing platform according to claim 12, wherein, When the instruction is executed on the one or more processors, the one or more processors also cause the one or more processors to: Identify unencrypted content components among the plurality of content components; and The encrypted content component and the unencrypted content component are combined into a single output frame; as well as The single output frame is sent to the display device, wherein the single output frame is mapped to one or more protected surfaces on the display device.

14. The processing platform according to claim 12, wherein, When the instruction is executed on the one or more processors, the one or more processors also cause the one or more processors to: Generate the protected surface, wherein the encrypted content component is configured to be rendered only on the protected surface; and The protected surface is sent to the display device, wherein the encrypted content component is rendered on the protected surface of the display device.

15. The processing platform according to claim 12, wherein, When the instruction is executed on the one or more processors, the one or more processors also cause the one or more processors to: After receiving the multiple content components Create multiple frame loops, where each frame loop corresponds to one of the multiple content components; The multiple frames are cyclically queued into the frame loop pipeline; Obtain a frame cycle from the frame cycle pipeline; and Based on the sources of the multiple content components, determine whether the frame cycle corresponds to the encrypted content component or the unencrypted content component.

16. The processing platform according to claim 12, wherein, The content mapped onto the protected surface is rendered on the display device and prevented from being copied from the display device.

17. The processing platform according to claim 12, wherein, When the instruction is executed on the one or more processors, the one or more processors also cause the one or more processors to: Disable the processing platform from recording or storing features relative to the protected surface.

18. The processing platform according to claim 12, wherein, The protected surface includes a texture having a predetermined size that maps to the field of view on the display device.

19. The processing platform according to claim 12, wherein, When the instruction is executed on the one or more processors, the one or more processors also cause the one or more processors to: Identify unencrypted content components among the plurality of content components; and The encrypted content component and the unencrypted content component are combined into a single output frame; as well as The single output frame is sent to the display device, wherein the unencrypted content component is mapped onto an unprotected surface on the display device.

20. The processing platform according to claim 19, wherein, When the instruction is executed on the one or more processors, the one or more processors also cause the one or more processors to: Before sending the single output frame to the display device. The encrypted content component is assigned to the protected surface on the display device, and the unencrypted content component is assigned to the unprotected surface on the display device.

21. The processing platform according to claim 19, wherein, The protected surface and the unprotected surface are mapped onto mutually exclusive fields of view on the display device.

22. The processing platform according to claim 19, wherein, The protected surface and the unprotected surface are mapped onto two overlapping fields of view on the display device, wherein the overlap between the fields of view is displayed as encrypted content on the display device to prevent the encrypted content from being copied from the display device when it is rendered on the display device.

23. The processing platform according to claim 12, further comprising: The display device is configured to display at least the encrypted content components on the protected surface.

24. A system for processing secure content, comprising: The processing platform according to claim 12; The first source is configured to provide unencrypted content components; The second source is configured to provide encrypted content components; as well as The display device is configured to display at least the encrypted content component on the protected surface.

Images