XR distribution method and XR projection system

Abstract

As resolution and image quality increase, the distribution bandwidth required to deliver XR images also increases. [Solution] A method for delivering an extended reality (XR) image from an XR application instance on a computing device to an XR device includes acquiring an XR image to be transmitted by the XR application instance to the XR device. The XR image is acquired relative to a predetermined reference position, the predetermined reference position having a predetermined relationship to an instantaneous position of the XR device, and the XR image has a first resolution. The method also includes delivering the XR image to the XR device and upconverting, by the XR device, the resolution of the received XR image to obtain a displayed XR image. The upconverted XR image has a second resolution higher than the first resolution.

Description

[Technical Field]

[0001] The present invention generally relates to an XR distribution method for distributing XR images from an XR application instance to an XR device, and further relates to an XR projection system. [Background technology]

[0002] In certain types of extended reality applications, XR images intended for display on an XR device are rendered by an external computing device and then delivered to the XR device.

[0003] This delivery approach is advantageous because rendering becomes increasingly computationally expensive as the native resolution and image quality standards of XR devices increase, which is ensured by the high computational resources of the external computing device.

[0004] However, as resolution and image quality increase, the distribution bandwidth required to deliver XR images also increases. Summary of the Invention

[0005] It is an object of the present invention to provide an XR distribution method and an XR projection system that requires less distribution bandwidth.

[0006] According to the present invention, the problem is solved by an XR distribution method for distributing an XR image from an extended reality (XR) application instance to an XR device. The XR application instance is incorporated in a computer device provided separately from the XR device. The XR distribution method includes the steps of: acquiring, by the XR application instance, an XR image for transmission to the XR device, the XR image being acquired relative to a predetermined reference position, the predetermined reference position having a predetermined relationship to an instantaneous position of the XR device, the XR image having a first resolution; distributing, by the XR application instance, the XR image to the XR device; and upconverting, by the XR device, the XR image received from the XR application instance, in resolution to thereby obtain an upconverted XR image for display on the XR device, the upconverted XR image having a second resolution higher than the first resolution.

[0007] Above and below, the term "location" is understood to describe a location and / or a direction.

[0008] Thus, the term "instantaneous position of the XR device" relates to the instantaneous location and / or instantaneous orientation of the XR device.

[0009] The predetermined reference position may be any position that has a certain relationship to the instantaneous position of the XR device.

[0010] Furthermore, it is understood that the term "obtaining an XR image for transmission to an XR device, the XR image having a first resolution" describes that the XR image may be rendered by an XR application instance having the first resolution, or that the XR image may be rendered by an XR application instance having a resolution higher than the first resolution and down-converted by the XR application instance.

[0011] The term "XR device" is understood to describe an electronic device configured to display extended reality (XR) images, i.e., augmented reality (AR), mixed reality (MR), and / or virtual reality (VR) images.

[0012] For example, the XR device may be a head-mounted display, e.g., a glasses-type electronic wearable, although it will be understood that the XR device may also be provided as any other XR-capable electronic device, e.g., a smartphone or tablet.

[0013] Furthermore, the term "XR image" is understood to describe at least one virtual image.

[0014] In the case of augmented reality (AR) or mixed reality, the XR image corresponds to at least one virtual image that is superimposed on reality.

[0015] For example, the XR device may be a head-mounted display with a translucent screen, where the virtual image is displayed on the translucent screen so that the user can see the environment directly through the translucent screen, with the virtual image superimposed on it.

[0016] As another example, the XR device may be an optically opaque head-mounted display. In this case, the head-mounted display may include at least one internal camera, in particular several internal cameras configured to capture images of the environment of the head-mounted display. The real image captured by the internal camera is overlaid with the virtual image, and the result of the overlay of the real image and the augmented reality image is displayed on the screen of the head-mounted display.

[0017] As another example, the XR device may be a smartphone or tablet, where an image taken by a camera on the XR device is overlaid onto at least one virtual image and the resulting image is displayed on the screen.

[0018] In the case of virtual reality, the XR image corresponds to the virtual image displayed on the screen of the XR device.

[0019] For example, the XR device may be an optically opaque head-mounted display, and the VR image may be displayed on the screen of the head-mounted display.

[0020] The XR distribution method according to the present invention is based on the idea of ​​using resolution upscaling techniques to save distribution bandwidth.

[0021] Instead of delivering an XR image with the full native or maximum resolution of the XR device, the XR image is transmitted at a first resolution that is less than the native or maximum resolution of the XR device.

[0022] The XR device upconverts the resolution of the received XR image to a second resolution, which may be the native resolution of the XR device, i.e., the maximum resolution of the XR device.

[0023] Up-conversion of a received XR image is less computationally expensive than rendering the XR image at a second resolution, which is advantageous due to the potentially limited computational resources available in the XR device and / or to conserve energy when the XR device may be battery powered.

[0024] Therefore, the main advantage of the XR distribution approach, namely reducing the computational load on the XR device, is ensured by the XR distribution method according to the present invention, while at the same time reducing the distribution bandwidth required to transmit the XR images from the computing device to the XR device.

[0025] It should be noted that any suitable upscaling technique may be used to upconvert in resolution the XR images received from the XR application instance.

[0026] For example, upconverting an XR image may include upscaling based on pixel replication with anti-aliasing, upscaling based machine learning, or any other type of resolution upscaling.

[0027] It should be noted that the method steps described above relate to a single frame, and of course these steps may be performed repeatedly to obtain a continuous stream of XR images on the XR device.

[0028] According to an aspect of the present invention, the second resolution corresponds to the native resolution of the XR device, and therefore corresponds to a resolution that provides optimal image quality for the XR images received from the XR application instance.

[0029] In an embodiment of the invention, an XR image to be sent to an XR device is rendered by an XR application instance at a first resolution, thereby conserving computational resources on the part of the external computing device as the XR image is rendered at a lower resolution than that displayed on the XR device.

[0030] The XR delivery method further includes the steps of rendering, by the XR application instance, a high resolution XR image for display on the XR device relative to a predetermined reference position, the high resolution XR image having a third resolution higher than the first resolution, and down-converting, by the XR application instance, the high resolution XR image, thereby obtaining an XR image for transmission to the XR device.

[0031] In other words, instead of rendering an XR image for display on an XR device at a first resolution, the XR image for display may be rendered at a higher resolution, say a third resolution, and after rendering, the XR image for display is down-converted to the first resolution and sent to the XR device.

[0032] In fact, the third resolution may be equal to the second resolution. In certain examples, the XR application instance may render XR images to be displayed at the native resolution of the XR device, i.e., the third resolution may be equal to the native resolution of the XR device.

[0033] According to another aspect of the present invention, the XR distribution method further includes the steps of upconverting, by the XR application instance, the XR image to a second resolution for transmission to the XR device, thereby obtaining a comparison XR image; comparing, by the XR application instance, the high-resolution XR image with the comparison XR image, thereby obtaining difference data; and transmitting, by the XR application instance, the difference data to the XR device.

[0034] In other words, the upconversion performed by the XR device may also be performed by an XR application instance embedded in an external computing device, thereby obtaining the comparative XR image. In fact, the XR application instance may use the same upconversion technology as the XR device.

[0035] The upconverted XR image, or comparison XR image, is compared with the rendered high resolution image having a third resolution such that the difference data indicates errors introduced into the upconverted XR image by the upconversion.

[0036] When the XR application instance and the XR device may use the same upconversion technology, particularly when the third resolution is equal to the second resolution, the difference data also accounts for the expected error caused by the reprojection performed by the XR device.

[0037] In general, transmitting an XR image and difference data having a first resolution may require significantly less distribution bandwidth than transmitting an XR image having a second resolution, which may be the native resolution of the XR device. Thus, despite transmitting the difference data to the XR device, the required distribution bandwidth may be significantly reduced compared to delivering a high-resolution XR image.

[0038] In a further embodiment of the invention, the upconverted XR image is corrected by the XR device based on the difference data. Thus, the image quality of the XR image upconverted to the second resolution by the XR device may be enhanced based on the difference data, as errors introduced by the upconversion may be corrected.

[0039] In particular, the XR application instance and the XR device use the same upconversion algorithm and / or the same machine learning model trained to perform the upconversion, thus ensuring that the difference data accurately represents the errors of the upconversion performed by the XR device, and thus ensuring that these errors can be reliably corrected based on the difference data.

[0040] According to an aspect of the present invention, the upconverted XR image is displayed on the screen of the XR device. When the upconverted XR image is modified based on the difference data described above, the resulting modified upconverted XR image may be displayed on the screen of the XR device.

[0041] According to another aspect of the invention, the XR images to be transmitted are encoded by the XR application instance before transmission to the XR device, thereby further reducing the distribution bandwidth required to transmit the XR images from the computing device to the XR device.

[0042] Optionally, the above-mentioned difference data may be encoded by the XR application instance before transmission to the XR device, thereby reducing the distribution bandwidth required to transmit the XR image and difference data from the computing device to the XR device.

[0043] In an embodiment of the present invention, an encoded XR image received by an XR device from an XR application instance is decoded by the XR device, and an XR image having a first resolution is restored by the XR device by decoding the encoded XR image.

[0044] Similarly, encoded difference data received by the XR device from the XR application instance may be decoded by the XR device. Decoding the encoded difference data restores the original difference data obtained by the XR application instance.

[0045] According to the present invention, the problem is further solved by an XR projection system including an XR device and an XR application instance, the XR application instance being embedded in a computer device provided separately from the XR device, the XR projection system being configured to execute the XR distribution method according to any of the above aspects.

[0046] With regard to advantages and further properties of the XR projection system, reference is made to the explanations given above with regard to the XR delivery method, which also apply to the XR projection system and vice versa.

[0047] According to an aspect of the present invention, the computing device is or includes at least one server. In particular, the computing device may be or include a server cloud having multiple servers cooperating to provide an XR distribution service.

[0048] However, it will be appreciated that the computing device may be configured as or include any other suitable type of computing device, such as a personal computer, laptop, notebook, MAC, tablet, smartphone, or other type of smart device. [Brief explanation of the drawings]

[0049] The foregoing aspects and many of the attendant advantages of the subject matter of this invention will become more readily appreciated as the same become better understood by reference to the following detailed description, when taken in conjunction with the accompanying drawings, in which:

[0050] [Figure 1] FIG. 1 shows a schematic representation of an XR projection system according to the present invention. [Figure 2] FIG. 2 illustrates a schematic diagram of an exemplary embodiment of the XR projection system of FIG. [Figure 3] FIG. 3 shows a flowchart of the XR distribution method according to the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0051] The detailed description set forth below in conjunction with the accompanying drawings, in which like numbers refer to like elements, is intended as a description of various embodiments of the disclosed subject matter, and is not intended to represent the only embodiments. Each embodiment described in this disclosure is provided merely as an example or illustration and should not be construed as preferred or advantageous over other embodiments. The illustrative examples provided herein are not intended to be exhaustive or to limit the claimed subject matter to the precise form disclosed.

[0052] For purposes of this disclosure, the phrase "at least one of A, B, and C" means, for example, (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C), including all other possible permutations when more than two elements are listed. In other words, the term "at least one of A and B" generally means "A and / or B," i.e., "A" only, "B" only, or "A and B."

[0053] FIG. 1 shows a schematic block diagram of an XR projection system 10 comprising an XR device 12 and an external computing device 14 connected to the XR device 12 in a signal transmission manner.

[0054] Above and below, the term "signaling coupled" is understood to describe a wired or wireless connection configured to transmit signals between the respective devices or components.

[0055] Generally, the XR device 12 is an electronic device configured to display extended reality (XR) images, i.e., augmented reality (AR) images, mixed reality (MR) images, and / or virtual reality (VR) images.

[0056] As shown in FIG. 2, the XR device 12 may be configured, for example, as a head-mounted display, particularly as an electronic wearable having a glasses type.

[0057] However, it is understood that the XR device 12 may be provided as any other XR-capable electronic device, for example a smartphone or a tablet.

[0058] In general, the XR projection system 10 allows a user to view and / or interact with virtual objects, in particular virtual 3D objects.

[0059] If the XR projection system 10 is an AR or MR projection system, these virtual objects are embedded in the user's real environment.

[0060] Thus, the XR device 12 comprises at least one projection surface 16, and at least one XR image to be displayed is projected onto the projection surface 16 such that virtual objects are displayed to the user.

[0061] The projection surface 16 may be the screen of the XR device 12.

[0062] Optionally, the XR projection system 10 may include at least one handheld input device (not shown in FIG. 1), and a user may control the XR projection system 10 by means of the at least one handheld input device.

[0063] For example, the at least one handheld input device may be provided as a pen-type device or any other type of suitable input device.

[0064] The XR device 12 further comprises at least one camera 18, at least one position sensor 20, a communication module 22, and a machine learning module 24.

[0065] Above and below, the term "module" is understood to describe suitable hardware, suitable software, or a combination of hardware and software that is configured to have a particular functionality.

[0066] The hardware may include, among other things, a CPU, GPU, FPGA, ASIC, or other types of electronic circuitry.

[0067] The at least one camera 18 is configured to capture images of the environment of the XR device 12, in particular the environment in front of the XR device 12.

[0068] In particular, the at least one camera 18 may be provided as a stereo camera. Alternatively or additionally, the XR device 12 may include several cameras with overlapping fields of view. Thus, depth information of images captured by the at least one camera 18 may be determined based on the images captured by the at least one camera 18.

[0069] The at least one position sensor 20 is configured to determine the position, ie the location and / or orientation, of the XR device 12 .

[0070] For example, the at least one position sensor 20 may be provided as a gyroscope, an acceleration sensor, a magnetometer, a GNSS device, and / or any other suitable type of position sensor.

[0071] In general, external computing device 14 may be provided as any type of electronic computing device configured to have the functionality described below.

[0072] For example, the external computing device 14 may be provided as a server having suitable hardware and suitable software running on the hardware.

[0073] As another example, the external computing device 14 may be provided as a personal computer, laptop, notebook, MAC, tablet, smartphone, or any other type of smart device.

[0074] The external computing device 14 includes at least one XR application instance 26 and a communications module 28.

[0075] Optionally, the external computing device 14 includes an analysis module 30 .

[0076] The functionality of the individual modules is described in more detail below.

[0077] The communication module 22 of the XR device 12 and the communication module 28 of the external computing device 14 are configured to communicate with each other.

[0078] Indeed, image data, position data, and / or control data may be exchanged between the XR device 12 and the external computing device 14 by means of the communication modules 22, 28.

[0079] In the above, any suitable wireless or wired transmission technology may be used by the communication modules 22, 28, for example WLAN, 4G, 5G, Ethernet, etc.

[0080] It will be understood that the embodiment of the XR projection system 10 shown in Figures 1 and 2 is exemplary.

[0081] The XR projection system 10 is configured to execute an XR distribution method for distributing XR images from at least one XR application instance 26 to an XR device 12, which is described below with reference to FIG.

[0082] Instantaneous position data is determined, where the instantaneous position data is associated with the instantaneous position of the XR device 12 (step S1).

[0083] In general, the instantaneous position data includes information about the instantaneous location of the XR device 12 and / or information about the instantaneous orientation of the XR device 12.

[0084] Preferably, the instantaneous position data includes information about the instantaneous location of the XR device 12 and information about the instantaneous orientation of the XR device 12, so that this uniquely determines the field of view of the user of the XR device 12 or of the XR device 12 itself.

[0085] In the exemplary embodiment shown in FIGS. 1 and 2, the instantaneous position data is determined by at least one position sensor 20 of the XR device 12 .

[0086] Alternatively or additionally, the instantaneous position data may be determined by at least one external camera, i.e. at least one camera not integrated into the XR device 12.

[0087] The at least one external camera may be connected to the analysis module 30, where the analysis module 30 is configured to determine instantaneous position data based on images of the XR device 12 captured by the at least one external camera. The analysis module 30 may be incorporated into the XR device 12 or the external computing device 14.

[0088] Optionally, the XR device 12 may include one or more light emitting elements, in particular one or more LEDs. The analysis module 30 may determine instantaneous position data based on images of the one or more light emitting elements captured by at least one external camera, in particular through triangulation.

[0089] It is further understood that analysis module 30 may determine instantaneous position data based on images captured by at least one external camera.

[0090] The instantaneous position data is transmitted via the communication modules 22, 28 to at least one XR application instance 26.

[0091] An XR image for transmission to the XR device 12 is acquired by at least one XR application instance 26 based on the instantaneous position data, and the XR image is rendered relative to a predetermined reference position (step S2).

[0092] Generally, the acquired XR image has a first resolution that is lower than a second resolution that the XR image has when displayed on the XR device 12.

[0093] The second resolution may be the native resolution of the XR device 12.

[0094] According to one variant, the XR images to be sent to the XR device 12 may be rendered by at least one XR application instance 26 at a first resolution.

[0095] According to another variant, the high-resolution XR image may be rendered by at least one XR application instance 26 at a third resolution higher than the first resolution. In particular, the third resolution may be equal to the second resolution.

[0096] The rendered high resolution XR image may be downconverted to the first resolution by at least one XR application instance 26, thereby obtaining an XR image for transmission to the XR device 12.

[0097] In the above, the predetermined reference position has a predetermined relationship with the instantaneous position of the XR device 12.

[0098] For example, the predetermined reference position may correspond to a first eye position, i.e., the location and / or orientation of a first eye of the user, or a second eye position, i.e., the location and / or orientation of a second eye of the user.

[0099] As another example, the predetermined reference position may be different from both the first eye position and the second eye position. In a particular example, the predetermined reference position may be an average of the first eye position and the second eye position.

[0100] However, the predetermined reference position may be any position that has a certain relationship with the instantaneous position of the XR device 12.

[0101] Optionally, the XR image acquired by the at least one XR application instance 26 to be sent to the XR device 12 may be upconverted to a second resolution by the at least one XR application instance 26, thereby acquiring a comparison image (step S3).

[0102] In the above, the at least one XR application instance 26 may use any suitable upscaling technique to upconvert the XR image to the second resolution for transmission.

[0103] For example, upconverting an XR image may include upscaling based on pixel replication with anti-aliasing, upscaling based machine learning, or any other type of resolution upscaling.

[0104] The above-mentioned high resolution XR image may be compared with a comparison XR image by at least one XR application instance 26, thereby obtaining difference data (step S4).

[0105] The XR image having the first resolution, and optionally the difference data, are delivered by the at least one XR application instance 26 via the communication modules 28, 22 to the XR device 12 (step S5).

[0106] In the above, the XR image having the first resolution may be encoded before transmission to the XR device 12. Upon receipt, the XR device 12 may decode the encoded XR image, thereby recovering the XR image having the first resolution.

[0107] Optionally, the difference data may be encoded before transmission to the XR device 12. Upon receipt, the XR device 12 may decode the encoded difference data, thereby recovering the difference data obtained by the XR application instance 26.

[0108] It should be noted that the XR image or the XR image data including the XR image sent to the XR device 12 may include information regarding the view matrix and / or the projection matrix.

[0109] When the XR image to be displayed includes a virtual world anchor object, in particular a virtual 3D object, the view matrix and / or projection matrix contain useful information for accurately displaying the XR image on the XR device 12.

[0110] The view matrix contains all the information necessary to transform an object from world space into view space, which is associated with the XR device 12, and in particular with the at least one camera 18 of the XR device 12. In view space, the at least one camera 18 may remain at the origin, and in particular the main viewing direction of the at least one camera is along the z-axis.

[0111] In particular, the view matrix may be determined based on a determined instantaneous position of the XR device 12 or of at least one camera 18 of the XR device 12.

[0112] Similarly, the view matrix may be determined based on the determined and updated position of the XR device 12 or of at least one camera 18 of the XR device 12.

[0113] The projection matrix contains all the information necessary to project an object from a view space into a projection space, which is associated with the XR device 12, and in particular with at least one camera 18 of the XR device 12. In general, projecting an object into this projection space allows the XR device 12 to accurately display a virtual (3D) object.

[0114] The XR image having the first resolution received by the XR device 12 is upconverted to a second resolution by the XR device 12, thereby obtaining an upconverted XR image having the second resolution (step S6).

[0115] For example, machine learning module 24 may include a pre-trained machine learning model for upconverting received XR images.

[0116] However, it will be understood that any other suitable resolution upscaling technique may be used by the XR device 12.

[0117] In fact, at least one of the XR application instance 26 and the XR device 12 may use the same upscaling technique to obtain the comparison XR image and the upconverted XR image, respectively.

[0118] Optionally, the upconverted XR image may be modified by the XR device 12 based on difference data received from the at least one XR application instance 26 (step S7).

[0119] As already mentioned above, the difference data indicates errors introduced by up-conversion from the first resolution to the second resolution, and these errors can therefore be corrected based on the difference data.

[0120] The upconverted XR image is displayed by the XR device (step S8).

[0121] In fact, the upconverted XR image may be displayed on the projection surface 16 .

[0122] If the upconverted XR image has been modified based on the difference data, the corresponding modified upconverted XR image may be displayed.

[0123] Furthermore, it should be noted that the upconverted XR image (or modified upconverted XR image) may be re-projected by the XR device 12 based on the updated position of the XR device 12, taking into account movement of the user and / or the XR device 12.

[0124] The updated position may differ from the instantaneous position of the XR device 12 at which the XR image was rendered due to the movement of the user and / or the movement of the XR device 12. This difference is accounted for by the reprojection performed by the XR device 12.

[0125] The updated position of the XR device 12 may be determined by the position sensor 20 or by any of the other variations described above.

[0126] For example, the reprojection may be performed by the machine learning module 24, or more precisely by a machine learning model of the machine learning module 24, that has been pre-trained to perform the reprojection.

[0127] However, it will be appreciated that any other suitable type of reprojection technique may be used.

[0128] Certain embodiments disclosed herein, and in particular each module and / or unit, utilize circuitry (e.g., one or more circuits) to implement a standard, protocol, methodology, or technique disclosed herein, operably connect two or more components, generate information, process information, analyze information, generate signals, encode / decode signals, convert signals, transmit and / or receive signals, control other devices, etc. Any type of circuitry may be used.

[0129] In embodiments, a circuit includes, among other things, one or more computing devices, such as a processor (e.g., a microprocessor), a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a system on a chip (SoC), etc., or any combination thereof, and may include discrete digital or analog circuit elements or electronics, or a combination thereof. In embodiments, a circuit includes a hardware circuit implementation (e.g., an implementation in analog circuitry, an implementation in digital circuitry, etc., and combinations thereof).

[0130] In embodiments, a circuit includes a combination of circuitry and a computer program product having software or firmware instructions stored in one or more computer-readable memories that cooperate to cause a device to execute one or more protocols, methodologies, or techniques described herein. In embodiments, a circuit includes circuitry, such as a microprocessor or portion of a microprocessor, that requires software, firmware, etc. to operate. In embodiments, a circuit includes one or more processors or portions thereof and associated software, firmware, hardware, etc.

[0131] This application may refer to quantities and values. Unless otherwise specified, such quantities and values ​​are not intended to be limiting, but rather exemplary of quantities or values ​​that may be associated with this application. In this regard, this application may also use the term "plurality" when referring to quantities or values. In this regard, the term "plurality" refers to a number greater than 1, e.g., 2, 3, 4, 5, etc. The terms "about," "approximately," "nearly," etc., refer to ±5% of the stated value.

Claims

1. 1. An extended reality (XR) delivery method for delivering XR images from an XR application instance (26) to an XR device (12), comprising: The XR application instance (26) is embedded in a computing device (14) provided separately from the XR device (12); The XR distribution method includes: acquiring, by the XR application instance (26), an XR image for transmission to the XR device (12), the X-ray images are acquired relative to a predetermined reference position; the predetermined reference position has a predetermined relationship with an instantaneous position of the XR device (12); the X-ray image has a first resolution; a high-resolution XR image for display on the XR device (12) relative to the predetermined reference position is rendered by the XR application instance (26); the high-resolution X-ray image has a third resolution higher than the first resolution; the high-resolution XR image is down-converted in resolution by the XR application instance (26); thereby obtaining the XR image for transmission to the XR device (12); Step, upconverting, by the XR application instance (26), the XR image to be transmitted to the XR device (12) to a second resolution, thereby obtaining a comparison XR image; comparing, by the XR application instance (26), the high resolution XR image with the comparison XR image, thereby obtaining difference data; delivering, by the XR application instance (26), the XR image to the XR device (12); transmitting, by the XR application instance (26), the difference data to the XR device (12); and up-converting in resolution, by the XR device (12), the XR image received from the XR application instance (26), thereby obtaining an up-converted XR image for display on the XR device (12); the upconverted X-ray image has a second resolution higher than the first resolution. Step, Including, XR distribution method.

2. the second resolution corresponds to the native resolution of the XR device (12); The XR distribution method of claim 1.

3. the XR image to be transmitted to the XR device (12) is rendered by the XR application instance (26) at the first resolution; The XR distribution method according to claim 1 or 2.

4. The third resolution is equal to the second resolution. The XR distribution method according to any one of claims 1 to 3.

5. The upconverted XR image is corrected by the XR device (12) based on the difference data. The XR distribution method according to any one of claims 1 to 4.

6. The XR application instance (26) and the XR device (12) use the same upconversion algorithm and / or the same machine learning model trained to perform the upconversion. The XR distribution method according to any one of claims 1 to 5.

7. The upconverted XR image is displayed on a screen of the XR device (12). The XR distribution method according to any one of claims 1 to 6.

8. The XR image to be transmitted is encoded by the XR application instance (26) before transmission to the XR device (12). The XR distribution method according to any one of claims 1 to 7.

9. The encoded XR image received by the XR device (12) from the XR application instance (26) is decoded by the XR device (12). The XR distribution method of claim 8.

10. 1. An XR projection system comprising: The XR projection system (10) comprises an XR device (12) and an XR application instance (26); The XR application instance (26) is embedded in a computing device (14) provided separately from the XR device (12); The XR projection system (10) is configured to perform the XR distribution method of any of claims 1 to 9. XR projection system.

11. the computing device (14) is or includes at least one server; The XR projection system of claim 10.

Images