Minimizing screen blanking during mode transitions in processor-based extended reality (XR) devices

By using read-without-invalidate read requests for transition data and read-invalidate requests post-transition, the XR device minimizes screen blanking during mode changes, ensuring a continuous and immersive XR experience.

WO2024232934A1PCT designated stage expired Publication Date: 2024-11-14QUALCOMM INC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/US2023/079250
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-09
Filing Date
2023-11-09
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

Processor-based Extended Reality (XR) devices experience screen blanking during mode transitions due to the use of read-invalidate requests, which disrupt the user experience by halting the writing of XR display data to the buffer memory device, leading to a lack of data to display.

Method used

Implementing a read-without-invalidate read request for transition display data during mode transitions, allowing the display processor to continue displaying data from the cache without invalidating it, and switching to a read-invalidate request once the transition is complete to ensure seamless XR data display.

Benefits of technology

Minimizes screen blanking by maintaining a continuous display of transition data during mode changes, enhancing the user experience by preventing visual interference and maintaining an immersive XR environment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure US2023079250_14112024_PF_FP_ABST
    Figure US2023079250_14112024_PF_FP_ABST
Patent Text Reader

Abstract

Minimizing screen blanking during mode transitions in processor-based Extended Reality (XR) devices is disclosed herein. In this regard, in some exemplary aspects, a processor (104) of a processor-based XR device (100) comprises a buffer memory device (118) and a display processor device (108) communicatively coupled to the buffer memory device. The display processor device is configured to receive an indication of an upcoming transition between a non-secure mode and a secure mode. In response to receiving the indication of the upcoming transition between the non-secure mode and the secure mode, the display processor device transmits a read request (126) for transition display data to the buffer memory device, the read request comprising a read-without-invalidate read request. The display processor device is also configured to receive the transition display data (124) from the buffer memory device. The display processor device is additionally configured to display the transition display data to a user.
Need to check novelty before this filing date? Find Prior Art

Description

MINIMIZING SCREEN BLANKING DURING MODE TRANSITIONS IN PROCESSOR-BASED EXTENDED REALITY (XR) DEVICESPRIORITY APPLICATION

[0001] The present application claims priority to Indian Provisional Patent Application Serial No. 202341032725, filed May 9, 2023 and entitled “MINIMIZING SCREEN BLANKING DURING MODE TRANSITIONS IN PROCESSOR-BASED EXTENDED REALITY (XR) DEVICES,” which is incorporated herein by reference in its entirety.BACKGROUNDI. Field of the Disclosure

[0002] The technology of the disclosure relates generally to user experience enhancements in processor-based Extended Reality (XR) devices.IL Background

[0003] Extended reality (XR), as used herein, is an umbrella term that refers to computer-generated environments and interactions that range from an immersive virtual environment of a virtual reality (VR) application to a combination of real-world elements and virtual elements provided by augmented reality (AR) and mixed reality (MR) applications. An XR environment is generated by a processor-based XR device, which may comprise any computing device that provides a processor, a display device (such as a screen, a head-mounted display (HMD), eyeglasses, and / or the like, as non-limiting examples), an input device, and appropriate sensors for detecting position and movement of the computing device, the input device, and / or the HMD (e.g., accelerometers, compasses, positioning systems, and / or the like, as non-limiting examples). Such processor-based XR devices can provide an immersive experience in which a user perceives an entirely virtual, computer-generated environment (in the case of VR), or an environment in which computer-generated digital information or virtual objects are overlaid onto a non-virtual real-world environment (in the case of AR / MR).

[0004] Because the processing, sensing, and display functionalities provided by processor-based XR devices tend to be power-intensive, the optimization of powerconsumption is a challenge faced by most processor-based XR devices. One approach to managing power consumption involves streaming XR display data from static randomaccess memory (SRAM) such as a buffer memory device, rather than from dynamic random-access memory (DRAM) such as conventional system memory. This approach employs a producer / consumer model under which a producer (such as a reprojection circuit of a processor-based XR device) writes the XR display data into the buffer memory device, and a consumer (e.g., a display processor device of the processor-based XR device) streams the XR display data from the buffer memory device. The display processor device reads the XR display data from the buffer memory device using a read- invalidate request, which causes that the buffer memory device to invalidate and evict the XR display data after the read operation is complete. In this manner, processing overhead associated both with accessing system memory and with invalidating entries in the buffer memory device can be minimized.

[0005] To maintain the immersive nature of the XR environment, the processor-based XR device seeks to optimize the user experience to reduce visual interference such as artifacts, lags, stutters, and skipped display frames. However, the use of read-invalidate requests to stream XR display data from the buffer memory device may result in such visual interference under some circumstances. In particular, the processor-based XR device may need to transition between a non-secure mode and a secure mode (e.g., when switching to or from XR display data that is encrypted or associated with digital rights management (DRM), as non-limiting examples). Such transitions generally require elements of the processor-based XR device such as the reprojection circuit to be stopped and reconfigured, which temporarily halts the writing of XR display data to the buffer memory device. Because the display processor device is continuously reading XR display data that is then invalidated and evicted, the display processor device may end up with no XR display data to display to the user, which causes screen blanking to occur and disrupts the user experience.

[0006] Accordingly, a mechanism for minimizing screen blanking during mode transitions in processor-based XR devices is desirable.SUMMARY OF THE DISCLOSURE

[0007] Aspects disclosed in the detailed description include minimizing screen blanking during mode transitions in processor-based Extended Reality (XR) devices. Related apparatus, methods, and computer-readable media are also disclosed. In this regard, in some exemplary aspects disclosed herein, a processor-based XR device comprises a display processor device and a buffer memory device. The display processor device is configured to receive an indication of an upcoming transition between a nonsecure mode and a secure mode of the processor-based XR device. In response, the display processor device transmits a first read request for transition display data to the cache memory device, wherein the first read request is a read-without-invalidate read request. The transition display data comprises image data to be displayed during the transition between the non-secure mode and the secure mode, and may comprise, e.g., a solid color image, a logo image, or a last displayed frame image, as non-limiting examples. Upon receiving the transition display data from the buffer memory device, the display processor device displays the transition display data to a user. The display processor device in some aspects may perform a full display refresh cycle.

[0008] The display processor device according to some aspects subsequently receives an indication that the transition between the non-secure mode and the secure mode is complete. In response, the display processor device transmits a second read request for XR display data to the buffer memory device, wherein the second read request comprises a read-invalidate read request. Upon receiving the XR display data from the buffer memory device, the display processor device displays the XR display data to the user.

[0009] In some aspects, the buffer memory device is configured to receive the first read request for the transition display data from the display processor device, and transmit the transition display data to the display processor device from a first cache line of a plurality of cache lines of the plurality of cache lines of the buffer memory device without invalidating the first cache line. The buffer memory device is further configured to receive the second read request for the XR display data from the display processor device. In response to receiving the second read request, the buffer memory device transmits the XR display data to the display processor device from a second cache line of the plurality of cache lines, and then invalidates the second cache line.

[0010] Some aspects may provide that the processor-based XR device further comprises a reprojection circuit that is configured to receive the indication of the upcoming transition between the non-secure mode and the secure mode, and, in response, transmit the transition display data to the buffer memory device. The reprojection circuit in such aspects is also configured to subsequently receive the indication that the transition between the non-secure mode and the secure mode is complete, and then transmit the XR display data to the buffer memory device.

[0011] In another aspect, a processor-based XR device is provided. The processorbased XR device comprises a processor comprising a buffer memory device and a display processor device communicatively coupled to the buffer memory device. The display processor device is configured to receive an indication of an upcoming transition between a non-secure mode and a secure mode. The display processor device is further configured to, responsive to receiving the indication of the upcoming transition between the non- secure mode and the secure mode, transmit a first read request for transition display data to the buffer memory device, the first read request comprising a read-without-invalidate read request. The display processor device is also configured to receive the transition display data from the buffer memory device. The display processor device is additionally configured to display the transition display data to a user.

[0012] In another aspect, a processor-based XR device is provided. The processorbased XR device comprises means for receiving an indication of an upcoming transition between a non-secure mode and a secure mode. The processor-based XR device further comprises means for transmitting a first read request for transition display data to a buffer memory device, the first read request comprising a read-without-invalidate read request, responsive to receiving the indication of the upcoming transition between the non-secure mode and the secure mode. The processor-based XR device also comprises means for receiving the transition display data from the buffer memory device. The processor-based XR device additionally comprises means for displaying the transition display data to a user.

[0013] In another aspect, a method for minimizing screen blanking during mode transitions in processor-based XR devices is provided. The method comprises receiving, by a display processor device of a processor-based XR device, an indication of an upcoming transition between a non-secure mode and a secure mode. The method furthercomprises, responsive to receiving the indication of the upcoming transition between the non-secure mode and the secure mode, transmitting, by the display processor device, a first read request for transition display data to a buffer memory device of the processorbased XR device, the first read request comprising a read-without-invalidate read request. The method also comprises receiving, by the display processor device, the transition display data from the buffer memory device. The method additionally comprises displaying, by the display processor device, the transition display data to a user.

[0014] In another aspect, a non-transitory computer-readable medium is provided. The non-transitory computer-readable medium stores thereon computer-executable instructions that, when executed by a processor of a processor-based XR device, cause the processor to receive, using a display processor device of the processor-based XR device, an indication of an upcoming transition between a non-secure mode and a secure mode. The computer-executable instructions further cause the processor to, responsive to receiving the indication of the upcoming transition between the non-secure mode and the secure mode, transmit, using the display processor device, a first read request for transition display data to a buffer memory device of the processor-based XR device, the first read request comprising a read-without-invalidate read request. The computerexecutable instructions also cause the processor to receive, using the display processor device, the transition display data from the buffer memory device. The computerexecutable instructions additionally cause the processor to display, using the display processor device, the transition display data to a user.BRIEF DESCRIPTION OF THE FIGURES

[0015] Figure l is a block diagram of an exemplary processor-based Extended Reality (XR) device configured to minimize screen blanking during mode transitions, according to some aspects;

[0016] Figures 2A-2C are flowcharts illustrating exemplary operations for minimizing screen blanking during mode transitions, according to some aspects; and

[0017] Figure 3 is a block diagram of an exemplary processor-based device that can include the processor-based XR device of Figure 1.DETAILED DESCRIPTION

[0018] With reference now to the drawing figures, several exemplary aspects of the present disclosure are described. The word “exemplary” is used herein to mean “serving as an example, instance, or illustration.” Any aspect described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other aspects. The terms “first,” “second,” and the like (e.g., “first read request” and “second read request”) are used herein to distinguish between similarly named elements, and are not intended to indicate an ordinal relationship between such elements unless described as such herein.

[0019] Aspects disclosed in the detailed description include minimizing screen blanking during mode transitions in processor-based Extended Reality (XR) devices. Related apparatus, methods, and computer-readable media are also disclosed. In this regard, in some exemplary aspects disclosed herein, a processor-based XR device comprises a display processor device and a buffer memory device. The display processor device is configured to receive an indication of an upcoming transition between a nonsecure mode and a secure mode of the processor-based XR device. In response, the display processor device transmits a first read request for transition display data to the cache memory device, wherein the first read request is a read-without-invalidate read request. The transition display data comprises image data to be displayed during the transition between the non-secure mode and the secure mode, and may comprise, e.g., a solid color image, a logo image, or a last displayed frame image, as non-limiting examples. Upon receiving the transition display data from the buffer memory device, the display processor device displays the transition display data to a user. The display processor device in some aspects may perform a full display refresh cycle.

[0020] The display processor device according to some aspects subsequently receives an indication that the transition between the non-secure mode and the secure mode is complete. In response, the display processor device transmits a second read request for XR display data to the buffer memory device, wherein the second read request comprises a read-invalidate read request. Upon receiving the XR display data from the buffer memory device, the display processor device displays the XR display data to the user.

[0021] In some aspects, the buffer memory device is configured to receive the first read request for the transition display data from the display processor device, and transmit the transition display data to the display processor device from a first cache line of aplurality of cache lines of the plurality of cache lines of the buffer memory device without invalidating the first cache line. The buffer memory device is further configured to receive the second read request for the XR display data from the display processor device. In response to receiving the second read request, the buffer memory device transmits the XR display data to the display processor device from a second cache line of the plurality of cache lines, and then invalidates the second cache line.

[0022] Some aspects may provide that the processor-based XR device further comprises a reprojection circuit that is configured to receive the indication of the upcoming transition between the non-secure mode and the secure mode, and, in response, transmit the transition display data to the buffer memory device. The reprojection circuit in such aspects is also configured to subsequently receive the indication that the transition between the non-secure mode and the secure mode is complete, and then transmit the XR display data to the buffer memory device.

[0023] In this regard, Figure 1 is a block diagram of an exemplary processor-based XR device 100 that is configured to generate and display an XR environment (e.g., a virtual reality (VR) environment, an augmented reality (AR) environment, and / or a mixed reality (MR) environment) to a user 102, and to update the displayed XR environment in response to input from the user 102 and / or changes in the XR environment. The processor-based XR device 100 comprises a processor 104 (also referred to as a “processor core” or a “central processing unit (CPU) core”), which may be an in-order or an out-of-order processor (OoP) and / or may be one of a plurality of processors 104 provided by the processor-based XR device 100.

[0024] In the example of Figure 1, the processor 104 comprises a reprojection circuit 106 and a display processor device 108 communicatively coupled to a display device 110. The reprojection circuit 106 is configured to generate XR display data 112 by projecting a rendered image of XR content onto the view of the user 102 (based on, e.g., the head position and orientation of the user 102). The display processor device 108 is a dedicated processing unit configured to accelerate the rendering of graphics and video data such as the XR display data 112 for display by the display device 110. The display device 110 may comprise, e.g., a head-mounted display (HMD), a monitor, eyeglasses, and / or the like. The reprojection circuit 106 and the display processor device 108 may be referred to collectively as a “display pipeline” of the processor-based XR device 100. It is to beunderstood that the display pipeline may include additional elements not shown in Figure 1 for the sake of clarity.

[0025] The processor 104 is also communicatively coupled to position / motion sensors 114 that are configured to provide the processor 104 with data regarding the position and motion of the user 102 and / or the processor-based XR device 100. The position / motion sensors 114 may comprise, e.g., accelerometers, compasses, positioning systems, and / or the like, as non-limiting examples. The processor 104 is additionally communicatively coupled to a memory device 116 that provides storage for instructions and data used by the processor 104 when executing an XR application.

[0026] To reduce power consumption by the processor-based XR device 100, the processor 104 provides a buffer memory device 118 in which display data such as the XR display data 112 can be cached. The buffer memory device 118 comprises a plurality of cache lines 120(0)- 120(C), each of which is configured to store a block of data. Although not shown in Figure 1, the buffer memory device 118 in some aspects may be organized into a plurality of sets that each comprises a plurality of ways in which the cache lines 120(0)-120(C) may be stored. In some aspects, the buffer memory device 118 may comprise, as non-limiting examples, a static random-access memory (SRAM) cache device (e.g., a Last Level Cache (LLC)), a system SRAM memory device, or a Tightly- Coupled Memory (TCM) buffer device.

[0027] The buffer memory device 118 is configured to support both read-invalidate requests and read-without-invalidate read requests from the display processor device 108. For a read-invalidate request that results in a hit on a cache line such as the cache line 120(0), the data is read from the cache line 120(0) and returned to the display processor device 108, and the cache line 120(0) is invalidated and evicted from the buffer memory device 118. In contrast, for a read-without-invalidate request that results in a hit on the cache line 120(0), the data is read from the cache line 120(0) and returned to the display processor device 108, and the cache line 120(0) remains in the buffer memory device 118 until subject to a replacement and eviction policy of the buffer memory device 118.

[0028] The processor-based XR device 100 of Figure 1 may encompass any one of known digital logic elements, semiconductor circuits, processing cores, and / or memory structures, among other elements, or combinations thereof. Aspects described herein are not restricted to any particular arrangement of elements, and the disclosed techniques maybe easily extended to various structures and layouts on semiconductor dies or packages. It is to be understood that some aspects of the processor-based XR device 100 may include elements in addition to those illustrated in Figure 1, and / or may include more or fewer of the elements illustrated in Figure 1. For example, the processor-based XR device 100 may further include caches, controllers, communications buses, and / or persistent storage devices, which are omitted from Figure 1 for the sake of clarity.

[0029] The processor-based XR device 100 of Figure 1 is configured to operate in one of a non-secure mode (for handling XR display streams that do not require authentication or encryption or are not associated with digital rights management (DRM)) and a secure mode (for handling XR display streams that require authentication, are encrypted, and / or are associated with DRM). When transitioning from the non-secure mode to the secure mode or vice versa, the processor-based XR device 100 must “tear down” and re-establish the display pipeline. This process may entail, as non-limiting examples, stopping and reconfiguring elements such as the reprojection circuit 106, and then restarting such elements in the new mode. However, as noted above, the use of read- invalidate requests by the display processor device 108 to stream the XR display data 112 from the buffer memory device 118 may result in a suboptimal user experience during transitions between the non-secure mode and the secure mode. In particular, when the reprojection circuit 106 is stopped and reconfigured, the writing of the XR display data 112 to the buffer memory device 118 is halted. The display processor device 108, though, will continue to read and invalidate the XR display data 112 that is cached in the buffer memory device 118 until there is no XR display data left to display to the user 102. This causes screen blanking to occur, which disrupts the user experience.

[0030] In this regard, the processor-based XR device 100 provides functionality for minimizing screen blanking during mode transitions. In exemplary operation, the processor 104 may determine that a transition between the non-secure mode and the secure mode (i.e., from the non-secure mode to the secure mode or from the secure mode to the non-secure mode) is upcoming, based on, e.g., a user input (not shown) or a notification from a content provider (not shown). The processor 104 generates an indication (captioned as “UPCOMING TRANSITION INDICATION” in Figure 1) 122 of the upcoming transition between the non-secure mode and the secure mode. In some aspects, the indication 122 is received by the reprojection circuit 106, which thentransmits transition display data 124 to a buffer memory device 118 of the processorbased XR device 100. The transition display data 124 comprises display data to be displayed to the user 102 during the transition between the non-secure mode and the secure mode, and may comprise, as non-limiting examples, a solid color image, a logo image, or a last displayed frame image. The transition display data 124 may be dynamically generated by the processor-based XR device 100, and / or may be read from the memory device 116 or a persistent data store (not shown). The transition display data 124 is then stored in one or more cache lines, such as the cache line 120(0), of the buffer memory device 118.

[0031] The display processor device 108 receives the indication 122 of the upcoming transition between the non-secure mode and the secure mode, and, in response, transmits a first read request 126 (i.e., via a communications bus (not shown)) for the transition display data 124 to the buffer memory device 118. The first read request 126 comprises a read-without-invalidate read request that instructs the buffer memory device 118 to return the requested data without invalidating the corresponding cache line 120(0) (i.e., so the requested data remains in the buffer memory device 118). In some aspects, the buffer memory device 118, upon receiving the first read request 126, transmits the transition display data 124 to the display processor device 108 from the cache line 120(0) without invalidating the first cache line 120(0).

[0032] The display processor device 108 receives the transition display data 124 from the buffer memory device 118, and then displays the transition display data 124 to the user 102. Because the transition display data 124 remains in the buffer memory device 118 without being evicted, the display processor device 108 is able to repeatedly request and display the transition display data 124 to the user 102 for the duration of the transition between the non-secure mode and the secure mode. The display processor device 108 in some aspects may perform a full display refresh cycle responsive to receiving the indication 122 to ensure that the entirety of the transition display data 124 has been written to the buffer memory device 118 by the reprojection circuit 106.

[0033] At a later point in time, the processor 104 determines that the transition between the non-secure mode and the secure mode is complete. Accordingly, the processor 104 generates an indication (captioned as “TRANSITION COMPLETE INDICATION” in Figure 1) 128 that the transition between the non-secure mode and thesecure mode is complete. The reprojection circuit 106 in some aspects receives the indication 128, and, in response, transmits the XR display data 112 (i.e., XR display data corresponding to the new XR display stream following the transition) to the buffer memory device 118. The buffer memory device 118 stores the XR display data 112 in one or more cache lines, such as the cache line 120(C), of the buffer memory device 118.

[0034] The display processor device 108 subsequently receives the indication 128 that the transition between the non-secure mode and the secure mode is complete. In response, the display processor device 108 transmits a second read request 130 (i.e., via the communications bus over which the first read request 126 was transmitted or over a different communications bus (not shown)) for the XR display data 112 to the buffer memory device 118. The second read request 130 comprises a read-invalidate read request that instructs the buffer memory device 118 to return the requested data, and invalidate and evict the cache line 120(C) in which the requested data is cached. Upon receiving the second read request 130, the buffer memory device 118 transmits the XR display data 112 to the display processor device 108, and invalidates the cache line 120(C). The display processor device 108 receives the XR display data 112 from the buffer memory device 118, and displays the XR display data 112 to the user 102.

[0035] To illustrate exemplary operations for minimizing screen blanking during mode transitions in the processor-based XR device 100 of Figure 1, Figures 2A-2C provide flowcharts illustrating exemplary operations 200. For the sake of clarity, elements of Figure 1 are referenced in describing Figures 2A-2C. It is to be understood that some of the exemplary operations 200 shown in Figures 2A-2C may be performed in an order other than that illustrated herein, and / or may be omitted.

[0036] In Figure 2A, the exemplary operations 200 in some aspects begin with a reprojection circuit of a processor-based XR device (e.g., the reprojection circuit 106 of the processor-based XR device 100 of Figure 1) receiving an indication (such as the indication 122 of Figure 1) of an upcoming transition between a non-secure mode and a secure mode (block 202). In response to receiving the indication 122 of the upcoming transition between the non-secure mode and the secure mode, the reprojection circuit 106 in such aspects transmits transition display data (e.g., the transition display data 124 of Figure 1) to a buffer memory device (such as the buffer memory device 118 of Figure 1) of the processor-based XR device 100 (block 204).

[0037] A display processor device (e.g., the display processor device 108 of Figure 1) of the processor-based XR device 100 receives the indication 122 of the upcoming transition between the non-secure mode and the secure mode (block 206). Responsive to receiving the indication 122 of the upcoming transition between the non-secure mode and the secure mode, the display processor device 108 transmits a first read request (e.g., the first read request 126 of Figure 1) for the transition display data 124 to the buffer memory device 118, the first read request 126 comprising a read-without-invalidate read request (block 208). In some aspects, the buffer memory device 118 receives the first read request 126 for the transition display data 124 from the display processor device 108 (block 210). In response to receiving the first read request 126, the buffer memory device 118 in such aspects transmits the transition display data 124 to the display processor device 108 from a first cache line of a plurality of cache lines (such as the cache line 120(0) of the plurality of cache lines 120(0)-120(C) of Figure 1) of the buffer memory device 118 without invalidating the first cache line 120(0) (block 212). The exemplary operations 200 then continue at block 214 of Figure 2B.

[0038] Turning now to Figure 2B, the exemplary operations 200 continue with the display processor device 108 receiving the transition display data 124 from the buffer memory device 118 (block 214). The display processor device 108 then displays the transition display data 124 to a user (such as the user 102 of Figure 1) (block 216). Some aspects may further provide that the display processor device 108 performs a full display refresh cycle responsive to receiving the indication 122 of the upcoming transition between the non-secure mode and the secure mode (block 218). According to some aspects, the reprojection circuit 106 subsequently receives an indication (e.g., the indication 128 of Figure 1) that the transition between the non-secure mode and the secure mode is complete (block 220). In response, the reprojection circuit 106 transmits XR display data (such as the XR display data 112 of Figure 1) to the buffer memory device 118 (block 222). The exemplary operations 200 then continue at block 224 of Figure 2C.

[0039] Referring now to Figure 2C, the exemplary operations 200 continue with the display processor device 108 in some aspects subsequently receiving the indication 128 that the transition between the non-secure mode and the secure mode is complete (block 224). In response to receiving the indication 128 that the transition between the non- secure mode and the secure mode is complete, the display processor device 108 transmitsa second read request (e.g., the second read request 130 of Figure 1) for the XR display data 112 to the buffer memory device 118, the second read request 130 comprising a read- invalidate read request (block 226). In some aspects, the buffer memory device 118 receives the second read request 130 for the XR display data 112 from the display processor device 108 (block 228). In response to receiving the second read request 130, the buffer memory device 118 performs a series of operations (block 230). The buffer memory device 118 transmits the XR display data 112 to the display processor device 108 from a second cache line 120(C) of the plurality of cache lines 120(0)- 120(C) (block 232). The buffer memory device 118 also invalidates the second cache line 120(C) (block 234). The display processor device 108 receives the XR display data 112 from the buffer memory device 118 (block 236). The display processor device 108 then displays the XR display data 112 to the user 102 (block 238).

[0040] Minimizing screen blanking during mode transitions according to aspects disclosed herein may be provided in or integrated into any processor-based device. Examples, without limitation, include a set top box, an entertainment unit, a navigation device, a communications device, a fixed location data unit, a mobile location data unit, a global positioning system (GPS) device, a mobile phone, a cellular phone, a smart phone, a session initiation protocol (SIP) phone, a tablet, a phablet, a server, a computer, a portable computer, a mobile computing device, laptop computer, a wearable computing device (e.g., a smart watch, a health or fitness tracker, eyewear, etc.), a desktop computer, a personal digital assistant (PDA), a monitor, a computer monitor, a television, a tuner, a radio, a satellite radio, a music player, a digital music player, a portable music player, a digital video player, a video player, a digital video disc (DVD) player, a portable digital video player, an automobile, a vehicle component, an avionics system, a drone, and a multicopter.

[0041] In this regard, Figure 3 illustrates an example of a processor-based device 300 that may comprise the processor-based XR device 100 illustrated in Figure 1. In this example, the processor-based device 300 includes a processor 302 that includes one or more central processing units (captioned as “CPUs” in Figure 3) 304, which may also be referred to as CPU cores or processor cores. The processor 302 may have cache memory 306 coupled to the processor 302 for rapid access to temporarily stored data. The processor 302 is coupled to a system bus 308 and can intercouple master and slave devicesincluded in the processor-based device 300. As is well known, the processor 302 communicates with these other devices by exchanging address, control, and data information over the system bus 308. For example, the processor 302 can communicate bus transaction requests to a memory controller 310, as an example of a slave device. Although not illustrated in Figure 3, multiple system buses 308 could be provided, wherein each system bus 308 constitutes a different fabric.

[0042] Other master and slave devices can be connected to the system bus 308. As illustrated in Figure 3, these devices can include a memory system 312 that includes the memory controller 310 and a memory array(s) 314, one or more input devices 316, one or more output devices 318, one or more network interface devices 320, and one or more display controllers 322, as examples. The input device(s) 316 can include any type of input device, including but not limited to input keys, switches, voice processors, etc. The output device(s) 318 can include any type of output device, including, but not limited to, audio, video, other visual indicators, etc. The network interface device(s) 320 can be any device configured to allow exchange of data to and from a network 324. The network 324 can be any type of network, including, but not limited to, a wired or wireless network, a private or public network, a local area network (LAN), a wireless local area network (WLAN), a wide area network (WAN), a BLUETOOTH™ network, and the Internet. The network interface device(s) 320 can be configured to support any type of communications protocol desired.

[0043] The processor 302 may also be configured to access the display controller(s) 322 over the system bus 308 to control information sent to one or more displays 326. The display controller(s) 322 sends information to the display(s) 326 to be displayed via one or more video processors 328, which process the information to be displayed into a format suitable for the display(s) 326. The display(s) 326 can include any type of display, including but not limited to a cathode ray tube (CRT), a liquid crystal display (LCD), a plasma display, etc.

[0044] Those of skill in the art will further appreciate that the various illustrative logical blocks, modules, circuits, and algorithms described in connection with the aspects disclosed herein may be implemented as electronic hardware, instructions stored in memory or in another computer readable medium and executed by a processor or other processing device, or combinations of both. Memory disclosed herein may be any typeand size of memory and may be configured to store any type of information desired. To clearly illustrate this interchangeability, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. How such functionality is implemented depends upon the particular application, design choices, and / or design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.

[0045] The various illustrative logical blocks, modules, and circuits described in connection with the aspects disclosed herein may be implemented or performed with a processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices (e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration).

[0046] The aspects disclosed herein may be embodied in hardware and in instructions that are stored in hardware, and may reside, for example, in Random Access Memory (RAM), flash memory, Read Only Memory (ROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), registers, a hard disk, a removable disk, a CD-ROM, or any other form of computer readable medium known in the art. An exemplary storage medium is coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a remote station. In the alternative, the processor and the storage medium may reside as discrete components in a remote station, base station, or server.

[0047] It is also noted that the operational steps described in any of the exemplary aspects herein are described to provide examples and discussion. The operationsdescribed may be performed in numerous different sequences other than the illustrated sequences. Furthermore, operations described in a single operational step may actually be performed in a number of different steps. Additionally, one or more operational steps discussed in the exemplary aspects may be combined. It is to be understood that the operational steps illustrated in the flowchart diagrams may be subject to numerous different modifications as will be readily apparent to one of skill in the art. Those of skill in the art will also understand that information and signals may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols, and chips that may be referenced throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or particles, optical fields or particles, or any combination thereof.

[0048] The previous description of the disclosure is provided to enable any person skilled in the art to make or use the disclosure. Various modifications to the disclosure will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other variations. Thus, the disclosure is not intended to be limited to the examples and designs described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

[0049] Implementation examples are described in the following numbered clauses:1. A processor-based Extended Reality (XR) device, comprising: a processor comprising: a buffer memory device; and a display processor device communicatively coupled to the buffer memory device; and the display processor device configured to: receive an indication of an upcoming transition between a non-secure mode and a secure mode; responsive to receiving the indication of the upcoming transition between the non-secure mode and the secure mode, transmit a first read request for transition display data to the buffer memory device, the first read request comprising a read-without-invalidate read request;receive the transition display data from the buffer memory device; and display the transition display data to a user.2. The processor-based XR device of clause 1, wherein the buffer memory device comprises one of a static random-access memory (SRAM) cache device, a Last Level Cache (LLC) device, a system SRAM memory device, and a Tightly-Coupled Memory (TCM) buffer device.3. The processor-based XR device of clause 1 or 2, wherein the display processor device is further configured to perform a full display refresh cycle responsive to receiving the indication of the upcoming transition between the non-secure mode and the secure mode.4. The processor-based XR device of any of clauses 1-3, wherein the transition display data comprises one of a solid color image, a logo image, and a last displayed frame image.5. The processor-based XR device of any of clauses 1-4, wherein the display processor device is further configured to: subsequently receive an indication that the transition between the non-secure mode and the secure mode is complete; responsive to receiving the indication that the transition between the non-secure mode and the secure mode is complete, transmit a second read request for XR display data to the buffer memory device, the second read request comprising a read-invalidate read request; receive the XR display data from the buffer memory device; and display the XR display data to the user.6. The processor-based XR device of clause 5, wherein: the buffer memory device comprises a plurality of cache lines; and the buffer memory device is configured to:receive the first read request for the transition display data from the display processor device; responsive to receiving the first read request, transmit the transition display data to the display processor device from a first cache line of the plurality of cache lines without invalidating the first cache line; receive the second read request for the XR display data from the display processor device; and responsive to receiving the second read request: transmit the XR display data to the display processor device from a second cache line of the plurality of cache lines; and invalidate the second cache line.7. The processor-based XR device of clause 5 or 6, wherein: the processor further comprises a reprojection circuit communicatively coupled to the buffer memory device; and the reprojection circuit is configured to: receive the indication of the upcoming transition between the non-secure mode and the secure mode; responsive to receiving the indication of the upcoming transition between the non-secure mode and the secure mode, transmit the transition display data to the buffer memory device; subsequently receive the indication that the transition between the non- secure mode and the secure mode is complete; and responsive to receiving the indication that the transition between the non- secure mode and the secure mode is complete, transmit the XR display data to the buffer memory device.8. The processor-based XR device of any of clauses 1-7, wherein the transition between the non-secure mode and the secure mode comprises one of a transition from the non-secure mode to the secure mode and a transition from the secure mode to the non- secure mode.9. The processor-based XR device of any of clauses 1-8, integrated into a device selected from the group consisting of: a set top box; an entertainment unit; a navigation device; a communications device; a fixed location data unit; a mobile location data unit; a global positioning system (GPS) device; a mobile phone; a cellular phone; a phone; a session initiation protocol (SIP) phone; a tablet; a phablet; a server; a computer; a portable computer; a mobile computing device; a wearable computing device; a desktop computer; a personal digital assistant (PDA); a monitor; a computer monitor; a television; a tuner; a radio; a satellite radio; a music player; a digital music player; a portable music player; a digital video player; a video player; a digital video disc (DVD) player; a portable digital video player; an automobile; a vehicle component; avionics systems; a drone; and a multicopter.10. A processor-based Extended Reality (XR) device, comprising: means for receiving an indication of an upcoming transition between a non-secure mode and a secure mode; means for transmitting a first read request for transition display data to a buffer memory device, the first read request comprising a read-without-invalidate read request, responsive to receiving the indication of the upcoming transition between the non-secure mode and the secure mode; means for receiving the transition display data from the buffer memory device; and means for displaying the transition display data to a user.11. A method for minimizing screen blanking during mode transitions in processorbased Extended Reality (XR) devices, comprising: receiving, by a display processor device of a processor-based XR device, an indication of an upcoming transition between a non-secure mode and a secure mode; responsive to receiving the indication of the upcoming transition between the non- secure mode and the secure mode, transmitting, by the display processor device, a first read request for transition display data to a buffer memorydevice of the processor-based XR device, the first read request comprising a read-without-invalidate read request; receiving, by the display processor device, the transition display data from the buffer memory device; and displaying, by the display processor device, the transition display data to a user.12. The method of clause 11, wherein the buffer memory device comprises one of a static random-access memory (SRAM) cache device, a Last Level Cache (LLC) device, a system SRAM memory device, and a Tightly-Coupled Memory (TCM) buffer device.13. The method of clause 11 or 12, further comprising performing, by the display processor device, a full display refresh cycle responsive to receiving the indication of the upcoming transition between the non-secure mode and the secure mode.14. The method of any of clauses 11-13, wherein the transition display data comprises one of a solid color image, a logo image, and a last displayed frame image.15. The method of any of clauses 11-14, further comprising: subsequently receiving, by the display processor device, an indication that the transition between the non-secure mode and the secure mode is complete; responsive to receiving the indication that the transition between the non-secure mode and the secure mode is complete, transmitting, by the display processor device, a second read request for XR display data to the buffer memory device, the second read request comprising a read-invalidate read request; receiving, by the display processor device, the XR display data from the buffer memory device; and displaying, by the display processor device, the XR display data to the user.16. The method of clause 15, further comprising: receiving, by the buffer memory device, the first read request for the transition display data from the display processor device;responsive to receiving the first read request, transmitting, by the buffer memory device, the transition display data to the display processor device from a first cache line of a plurality of cache lines of the buffer memory device without invalidating the first cache line; receiving, by the buffer memory device, the second read request for the XR display data from the display processor device; and responsive to receiving the second read request: transmitting, by the buffer memory device, the XR display data to the display processor device from a second cache line of the plurality of cache lines; and invalidating, by the buffer memory device, the second cache line.17. The method of clause 15 or 16, further comprising: receiving, by a reprojection circuit of the processor-based XR device, the indication of the upcoming transition between the non-secure mode and the secure mode; responsive to receiving the indication of the upcoming transition between the nonsecure mode and the secure mode, transmitting, by the reprojection circuit, the transition display data to the buffer memory device; subsequently receiving, by the reprojection circuit, the indication that the transition between the non-secure mode and the secure mode is complete; and responsive to receiving the indication that the transition between the non-secure mode and the secure mode is complete, transmitting, by the reprojection circuit, the XR display data to the buffer memory device.18. The method of any of clauses 11-17, wherein the transition between the non- secure mode and the secure mode comprises one of a transition from the non-secure mode to the secure mode and a transition from the secure mode to the non-secure mode.19. A non-transitory computer-readable medium having stored thereon computerexecutable instructions that, when executed, cause a processor of a processor-based Extended Reality (XR) device to: receive, using a display processor device of the processor-based XR device, an indication of an upcoming transition between a non-secure mode and a secure mode; responsive to receiving the indication of the upcoming transition between the nonsecure mode and the secure mode, transmit, using the display processor device, a first read request for transition display data to a buffer memory device of the processor-based XR device, the first read request comprising a read-without-invalidate read request; receive, using the display processor device, the transition display data from the buffer memory device; and display, using the display processor device, the transition display data to a user.20. The non-transitory computer-readable medium of clause 19, wherein the computer-executable instructions further cause the processor to: subsequently receive, using the display processor device, an indication that the transition between the non-secure mode and the secure mode is complete; responsive to receiving the indication that the transition between the non-secure mode and the secure mode is complete, transmit, using the display processor device, a second read request for XR display data to the buffer memory device, the second read request comprising a read-invalidate read request; receive, using the display processor device, the XR display data from the buffer memory device; and display, using the display processor device, the XR display data to the user.

Claims

What is claimed is:

1. A processor-based Extended Reality (XR) device, comprising: a processor comprising: a buffer memory device; and a display processor device communicatively coupled to the buffer memory device; and the display processor device configured to: receive an indication of an upcoming transition between a non-secure mode and a secure mode; responsive to receiving the indication of the upcoming transition between the non-secure mode and the secure mode, transmit a first read request for transition display data to the buffer memory device, the first read request comprising a read-without-invalidate read request; receive the transition display data from the buffer memory device; and display the transition display data to a user.

2. The processor-based XR device of claim 1, wherein the buffer memory device comprises one of a static random-access memory (SRAM) cache device, a Last Level Cache (LLC) device, a system SRAM memory device, and a Tightly-Coupled Memory (TCM) buffer device.

3. The processor-based XR device of claim 1, wherein the display processor device is further configured to perform a full display refresh cycle responsive to receiving the indication of the upcoming transition between the non-secure mode and the secure mode.

4. The processor-based XR device of claim 1, wherein the transition display data comprises one of a solid color image, a logo image, and a last displayed frame image.

5. The processor-based XR device of claim 1, wherein the display processor device is further configured to: subsequently receive an indication that the transition between the non-secure mode and the secure mode is complete; responsive to receiving the indication that the transition between the non-secure mode and the secure mode is complete, transmit a second read request for XR display data to the buffer memory device, the second read request comprising a read-invalidate read request; receive the XR display data from the buffer memory device; and display the XR display data to the user.

6. The processor-based XR device of claim 5, wherein: the buffer memory device comprises a plurality of cache lines; and the buffer memory device is configured to: receive the first read request for the transition display data from the display processor device; responsive to receiving the first read request, transmit the transition display data to the display processor device from a first cache line of the plurality of cache lines without invalidating the first cache line; receive the second read request for the XR display data from the display processor device; and responsive to receiving the second read request: transmit the XR display data to the display processor device from a second cache line of the plurality of cache lines; and invalidate the second cache line.

7. The processor-based XR device of claim 5, wherein: the processor further comprises a reprojection circuit communicatively coupled to the buffer memory device; and the reprojection circuit is configured to:receive the indication of the upcoming transition between the non-secure mode and the secure mode; responsive to receiving the indication of the upcoming transition between the non-secure mode and the secure mode, transmit the transition display data to the buffer memory device; subsequently receive the indication that the transition between the non- secure mode and the secure mode is complete; and responsive to receiving the indication that the transition between the non- secure mode and the secure mode is complete, transmit the XR display data to the buffer memory device.

8. The processor-based XR device of claim 1, wherein the transition between the non-secure mode and the secure mode comprises one of a transition from the non-secure mode to the secure mode and a transition from the secure mode to the non-secure mode.

9. The processor-based XR device of claim 1, integrated into a device selected from the group consisting of: a set top box; an entertainment unit; a navigation device; a communications device; a fixed location data unit; a mobile location data unit; a global positioning system (GPS) device; a mobile phone; a cellular phone; a phone; a session initiation protocol (SIP) phone; a tablet; a phablet; a server; a computer; a portable computer; a mobile computing device; a wearable computing device; a desktop computer; a personal digital assistant (PDA); a monitor; a computer monitor; a television; a tuner; a radio; a satellite radio; a music player; a digital music player; a portable music player; a digital video player; a video player; a digital video disc (DVD) player; a portable digital video player; an automobile; a vehicle component; avionics systems; a drone; and a multicopter.

10. A processor-based Extended Reality (XR) device, comprising: means for receiving an indication of an upcoming transition between a non-secure mode and a secure mode; means for transmitting a first read request for transition display data to a buffer memory device, the first read request comprising a read-without-invalidateread request, responsive to receiving the indication of the upcoming transition between the non-secure mode and the secure mode; means for receiving the transition display data from the buffer memory device; and means for displaying the transition display data to a user.

11. A method for minimizing screen blanking during mode transitions in processorbased Extended Reality (XR) devices, comprising: receiving, by a display processor device of a processor-based XR device, an indication of an upcoming transition between a non-secure mode and a secure mode; responsive to receiving the indication of the upcoming transition between the non- secure mode and the secure mode, transmitting, by the display processor device, a first read request for transition display data to a buffer memory device of the processor-based XR device, the first read request comprising a read-without-invalidate read request; receiving, by the display processor device, the transition display data from the buffer memory device; and displaying, by the display processor device, the transition display data to a user.

12. The method of claim 11, wherein the buffer memory device comprises one of a static random-access memory (SRAM) cache device, a Last Level Cache (LLC) device, a system SRAM memory device, and a Tightly-Coupled Memory (TCM) buffer device.

13. The method of claim 11, further comprising performing, by the display processor device, a full display refresh cycle responsive to receiving the indication of the upcoming transition between the non-secure mode and the secure mode.

14. The method of claim 11, wherein the transition display data comprises one of a solid color image, a logo image, and a last displayed frame image.

15. The method of claim 11, further comprising: subsequently receiving, by the display processor device, an indication that the transition between the non-secure mode and the secure mode is complete; responsive to receiving the indication that the transition between the non-secure mode and the secure mode is complete, transmitting, by the display processor device, a second read request for XR display data to the buffer memory device, the second read request comprising a read-invalidate read request; receiving, by the display processor device, the XR display data from the buffer memory device; and displaying, by the display processor device, the XR display data to the user.

16. The method of claim 15, further comprising: receiving, by the buffer memory device, the first read request for the transition display data from the display processor device; responsive to receiving the first read request, transmitting, by the buffer memory device, the transition display data to the display processor device from a first cache line of a plurality of cache lines of the buffer memory device without invalidating the first cache line; receiving, by the buffer memory device, the second read request for the XR display data from the display processor device; and responsive to receiving the second read request: transmitting, by the buffer memory device, the XR display data to the display processor device from a second cache line of the plurality of cache lines; and invalidating, by the buffer memory device, the second cache line.

17. The method of claim 15, further comprising: receiving, by a reprojection circuit of the processor-based XR device, the indication of the upcoming transition between the non-secure mode and the secure mode;responsive to receiving the indication of the upcoming transition between the nonsecure mode and the secure mode, transmitting, by the reprojection circuit, the transition display data to the buffer memory device; subsequently receiving, by the reprojection circuit, the indication that the transition between the non-secure mode and the secure mode is complete; and responsive to receiving the indication that the transition between the non-secure mode and the secure mode is complete, transmitting, by the reprojection circuit, the XR display data to the buffer memory device.

18. The method of claim 11, wherein the transition between the non-secure mode and the secure mode comprises one of a transition from the non-secure mode to the secure mode and a transition from the secure mode to the non-secure mode.

19. A non-transitory computer-readable medium having stored thereon computerexecutable instructions that, when executed, cause a processor of a processor-based Extended Reality (XR) device to: receive, using a display processor device of the processor-based XR device, an indication of an upcoming transition between a non-secure mode and a secure mode; responsive to receiving the indication of the upcoming transition between the non- secure mode and the secure mode, transmit, using the display processor device, a first read request for transition display data to a buffer memory device of the processor-based XR device, the first read request comprising a read-without-invalidate read request; receive, using the display processor device, the transition display data from the buffer memory device; and display, using the display processor device, the transition display data to a user.

20. The non-transitory computer-readable medium of claim 19, wherein the computer-executable instructions further cause the processor to: subsequently receive, using the display processor device, an indication that the transition between the non-secure mode and the secure mode is complete; responsive to receiving the indication that the transition between the non-secure mode and the secure mode is complete, transmit, using the display processor device, a second read request for XR display data to the buffer memory device, the second read request comprising a read-invalidate read request; receive, using the display processor device, the XR display data from the buffer memory device; and display, using the display processor device, the XR display data to the user.

Citation Information

Patent Citations

  • Method and apparatus for performing burst refresh of a self-refreshing display device

    US20130021352A1

  • Boot process for early display initialization and visualization

    US20210004241A1

  • Refreshing displays using on-die cache

    US20220130342A1

  • IN202341032725A