Apparatus and method for rendering 3D digital content with multiple views

Abstract

Apparatuses and methods for rendering 3D digital content having multiple views are disclosed. An example device includes a screen, a first light source configured to emit first light at a first angle during a first time period, and a second light source configured to emit second light at a second angle during a second time period. The second angle is different from the first angle. The second time period is different from the first time period. The device includes a spatial light modulator configured to provide a first view of the digital content based on the first angle of the first light emitted during the first time period, and a second view of the digital content based on the second angle of the second light emitted during the second time period, and projection optics configured to project the first view and the second view for presentation via the screen.

Description

Technical Field

[0001] This application generally relates to light field displays for presenting three-dimensional (3D) digital content, and more specifically, to apparatus and methods for rendering 3D content having multiple views. Background Technology

[0002] Three-dimensional (3D) digital content can be presented to users via wearable display devices (such as head-mounted devices) or via surface-mounted (e.g., desktop) display devices (such as direct-view monitors or desktop light field displays). Motion parallax effects allow users to perceive that they are viewing different views of a 3D object, as if they were viewing the object from, for example, the right side or the left side. Summary of the Invention

[0003] An example device includes: a screen; a first light source configured to emit first light at a first angle during a first time period; and a second light source configured to emit second light at a second angle during a second time period. The second angle differs from the first angle. The second time period differs from the first time period. The device includes: a spatial light modulator configured to provide a first view of digital content based on the first angle of the first light emitted during the first time period, and a second view of the digital content based on the second angle of the second light emitted during the second time period. The first and second light sources are electrically coupled to the spatial light modulator. The device includes projection optics configured to project the first and second views for presentation via the screen. The projection optics are optically coupled to the first light source, the second light source, and the spatial light modulator. Attached Figure Description

[0004] Figure 1 An example system is shown that is constructed in accordance with the teachings of this disclosure and includes a wearable device for presenting 3D digital content and a light field display controller for controlling the presentation of the content.

[0005] Figure 2 It is shown Figure 1 A diagram of the system.

[0006] Figure 3 Another example system is shown that is constructed in accordance with the teachings of this disclosure and includes a surface-mounted display device for presenting 3D digital content and a light field display controller for controlling the presentation of the content.

[0007] Figure 4 It is shown Figure 3 A diagram of the system.

[0008] Figure 5Another example system is shown that is constructed in accordance with the teachings of this disclosure and includes a surface-mounted display device for presenting 3D digital content and a light field display controller for controlling the presentation of the content.

[0009] Figure 6A It is a combination Figure 1 Systems and / or Figure 3 A block diagram of an example implementation of the light field display controller for the system.

[0010] Figure 6B It is a combination Figure 5 A block diagram of an example implementation of the light field display controller for the system.

[0011] Figures 7-9 Showing via Figure 1 Example systems Figure 3 Example systems and / or Figure 5 Example view of a 3D object generated by the example system.

[0012] Figure 10 This is a flowchart representing machine-readable instructions that can be executed to achieve... Figure 6A Example light field display controller.

[0013] Figure 11 This is a flowchart representing machine-readable instructions that can be executed to achieve... Figure 6B Example light field display controller.

[0014] Figure 12 It is structured for execution Figure 10 Instructions to achieve Figure 6A and / or Figure 6B A block diagram of an example processing platform for an example light field display controller. Detailed Implementation

[0015] The accompanying drawings are not to scale. Generally, the same reference numerals in the drawings and this specification refer to the same or similar parts. Although the drawings show layers and areas with clearly defined lines and boundaries, some or all of these lines and / or boundaries may be idealized. In reality, boundaries and / or lines may be unobservable, mixed, and / or irregular.

[0016] Three-dimensional (3D) digital content can be presented to users via wearable display devices (such as head-mounted displays) or surface-mounted (e.g., desktop) display devices (such as direct-view monitors or desktop light field displays). When a viewer views 3D content representing, for example, an object via a display device, the viewer expects to see different features of the object (e.g., angles) depending on whether the viewer is to the left or right of the object. However, in some known display devices, the 3D object appears the same to the viewer regardless of their perceived position relative to the object. Therefore, the rendering of the 3D object looks unnatural because it fails to make the viewer perceive that they are viewing the object from all angles (e.g., as if the viewer were manipulating the object in real life).

[0017] Even when display devices offer surround view or motion parallax effects, presenting different views of a 3D object to the viewer in response to changes in the viewer's perceived position relative to the object, there is often a trade-off between angular resolution and spatial resolution. In at least one example, spatial resolution corresponds to the density or spacing of pixels associated with any particular view of the 3D image created by the associated light field. In at least one example, angular resolution corresponds to the number of views (e.g., stereoscopic views) created within the associated light field emitted from the individual lenses in the display device's lens array. For example, if the 3D object is a cube, the cube's faces can be presented with high spatial resolution. However, if the viewer manipulates the 3D cube to view one side, the user may not be able to see the corners where the two sides of the cube connect clearly due to the low angular resolution.

[0018] 3D displays based on monolithic imaging use lens arrays or biconvex lens arrays to create 3D views. To achieve high angular resolution in 3D content, a high pixel density should be used, ensuring sufficient spatial resolution for each view of the 3D content. However, pixel density in display devices is limited by factors such as manufacturing constraints. Achieving higher angular resolution, for example, may involve associating more pixels with each lens in the display device's lens array. Given the pixel density limitations, achieving higher angular resolution involves increasing the size of the individual lenses in the lens array to cover more pixels. However, such methods can lead to reduced spatial resolution of the 3D content because pixels associated with any particular view of the 3D content are spaced further apart due to the increased lens size. Furthermore, increasing the number of lenses used also results in reduced spatial resolution of the 3D content.

[0019] Using multiple display devices to address the pixel density limitations of each device can present additional challenges. For example, in wearable devices such as head-mounted displays, adding additional displays to increase pixel density and achieve higher angular resolution for 3D content can be expensive, increase weight, and increase power consumption. Similar issues regarding spatial resolution versus angular resolution exist for surface-mount displays such as direct-view monitors or desktop light field displays. However, using additional surface-mount displays also increases cost and space consumption. Furthermore, introducing moving components into the display device to give the user the impression that they are viewing a 3D object in all directions can complicate manufacturing and / or operation.

[0020] The example wearable and surface-mount display devices described herein provide multiple views of 3D content without sacrificing spatial resolution. In the examples described herein, an array of red, green, and blue (RGB) light sources is used to illuminate a spatial light modulator, such as a digital micromirror device (DMD), at a different angle for each light source. RGB light sources may include light-emitting diodes (LEDs), RGB laser diodes, optical fibers, or emitting displays such as microLEDs or organic light-emitting diodes (OLEDs). In the examples described herein, the light emitted by each RGB light source is associated with a different view of the 3D content (e.g., an object, a scene). As a result, a pupil associated with the lens system of the display device is divided by the number of RGB light sources. When each RGB light source is turned on and the light emitted by each light source is focused onto the spatial light modulator at a different angle, different images on the display device are flickered via the spatial light modulator to produce different angular views of the 3D content with full or substantially full spatial resolution of the display device. When the number of display devices is increased and / or additional lenses are added to the display devices, the examples described herein provide improved angular resolution of the 3D content without sacrificing spatial resolution.

[0021] Some examples described herein include wearable (e.g., head-mounted) display devices in which projection eyepieces project one or more images provided by a spatial light modulator for the wearer of the device to view at the exit pupil of the eyepiece. As the user views the eyepiece at a position corresponding to the exit pupil, the user sees a time-division multiplexed view of the 3D content. In the examples described herein, the spatial light modulator can be used to activate each light source sequentially over time to create different views of the 3D content by emitting light at different angles relative to the spatial light modulator.

[0022] In some examples, multiple views are created via a surface-mount device such as a direct-view light field monitor. In such examples, an exit pupil associated with the lens system of the display device is relayed to the eyebox or user viewing position via optics such as a Fresnel screen. In the example described herein, the eyebox comprises multiple sub-pupils corresponding to the number of light sources illuminating the spatial light modulator at different angles. Each light source is selectively activated via the spatial light modulator to create different time-division multiplexed views of the 3D content. As a result, the user sees different perspective views of the 3D content within the full or substantially full spatial resolution of the surface-mount monitor display.

[0023] Figure 1 An example system 100 for rendering multiple views of 3D content via a near-eye light field display device 102, constructed according to the teachings of this disclosure, is shown. Figure 1 As shown, the example near-eye light field display device 102 includes a head-mounted device (e.g., augmented reality glasses) such as glasses worn by user 104. The near-eye light field display device 102 includes a projection eyepiece optics 106 through which user 104 views digital content (e.g., 3D content) presented via the near-eye light field display device 102. The projection eyepiece optics 106 may include one or more lenses that are close to the user's eyes when the user wears the near-eye light field display device 102 and provide components for projecting (e.g., magnifying) one or more images for the user to view.

[0024] Figure 1 The near-eye light field display device 102 includes one or more light sources 108 or components for emitting light. The one or more light sources 108 define a light source array 110. Figure 1 In the example, one or more light sources 108 include one or more RGB light sources that emit red, green, and blue light. One or more light sources 108 may include, for example, light-emitting diodes (LEDs), emitting displays such as microLEDs or organic light-emitting diodes (OLEDs), lasers, and / or optical fibers.

[0025] The near-field light display device 102 includes an illumination optics 112. The illumination optics 112 includes one or more lenses to guide light emitted by one or more light sources to a spatial light modulator 114 of the near-field light display device 102. Figure 1The spatial light modulator 114 may include a digital micromirror device (DMD) comprising movable mirrors (e.g., thousands of mirrors), each of which may represent a pixel. The mirrors of the DMD can be selectively controlled to guide light emitted by one or more light sources 108 toward or away from the light projection path. Therefore, the spatial light modulator 114 provides components for guiding light emitted by one or more light sources 108. System 100 may use other types of spatial light modulators, such as liquid crystal displays (LCDs) or liquid crystal on silicon (LCOS).

[0026] Figure 1 Example 100 includes one or more semiconductor-based processors to control the operation of one or more light sources 108 and / or spatial light modulators 114. For example, as Figure 1 As shown, processor 116 is coupled (e.g., mounted) to near-field light display device 102. Furthermore, near-field light display device 102 includes battery 118 to provide power to processor 116 and / or other components of near-eye light display device 102.

[0027] In other examples, the processor is separate from the near-field light display device 102. For example, the processor 120 of a user device 122, such as a smartphone or other wearable device (e.g., a smartwatch), may generate instructions to control one or more light sources 108 and / or spatial light modulators 114 of the near-eye light display device 102 via a communication path (e.g., WiFi, cellular, Bluetooth, and / or other communication protocols). In other examples, one or more processors, servers, and / or virtual machines implemented by a cloud-based device 124 communicate with the near-eye light display device 102 (e.g., via WiFi, cellular, Bluetooth, and / or other communication protocols). In some examples, the processor 116 of the near-field light display device 102 is communicatively coupled to one or more other processors (e.g., the processor 120 of the user device 122) via one or more wired connections (e.g., cables) or wireless connections (e.g., cellular, Wi-Fi, or Bluetooth connections).

[0028] exist Figure 1 In one example, one or more light sources 108 and spatial light modulator 114 are controlled by a light field display controller 126. The example light field display controller 126 may be implemented by software executing on a processor 116 of the near-field light display 102, a processor 120 of a wearable or non-wearable user device 122, and / or a cloud-based device 124. In some examples, one or more components of the light field display controller 126 are implemented by the onboard processor 116 of the near-eye light display 102, and one or more other components are implemented by the processor 120 of the user device 122 and / or the cloud-based device 124. Figure 1The dashed lines extending from the light field display controller 126 delineate the different locations of the light field display controller 126 (e.g., on the near-eye display 102, in the cloud 124, and / or in the wearable or non-wearable user device 122).

[0029] exist Figure 1 In system 100, light field display controller 126 instructs light source 108 to selectively emit light based on a predefined time sequence. When a first light source in light source 108 is activated by light field display controller 126, the light emitted by the first light source is focused at a first angle onto spatial light modulator 114 (e.g., via illumination optics 112). When a second light source in light source 108 is activated by light field display controller 126, the light emitted by the second light source is focused at a second angle different from the first angle onto spatial light modulator 114. Spatial light modulator 114 reflects at least a portion of the light onto projection eyepiece optics 106. Light field display controller 126 selectively instructs spatial light modulator 114 to deflect light toward or away from projection eyepiece optics 106 based on the image to be generated.

[0030] exist Figure 1 In the example, projection eyepiece optics 106 projects one or more images corresponding to different views of the 3D content, such that when user 104 places his or her eyes at the exit pupil position associated with projection eyepiece optics 106 (e.g., the area where the user's pupils would be positioned to view the 3D content), user 104 views one or more images. For example, projection eyepiece optics 106 may magnify one or more images generated by spatial light modulator 114 so that user 104 can view one or more images when his or her eyes are at the exit pupil position. As described herein, when a user browses the exit pupil, the user will see different views of, for example, a 3D object, as if the user were viewing the object from different sides or circling the object based on motion parallax effects.

[0031] In some examples, the near-field light display device 102 includes a waveguide for relaying the outgoing pupil to the user's eye. For example, a waveguide can be used when the projection eyepiece optics 106 is positioned close to the user's temple rather than projecting directly into the user's eye.

[0032] Figure 2 It is shown Figure 1 The system 100 and shows the respective light sources (e.g., light source array 110) of the light source array 110. Figure 1 The light emitted by the light source 108) creates different views of the 3D content. For example... Figure 2As shown, the light source array 110 includes a first RGB light source 200, a second RGB light source 202, a third RGB light source 204, and a fourth RGB light source 206. The light source array 110 may include... Figure 2 The light sources shown are additional light sources. In the examples disclosed herein, each of light sources 202, 202, 204, and 206 can be sequenced to generate white light for a specific 2D image based on red, green, and blue wavelengths. Furthermore, in the examples disclosed herein, each of light sources 200, 202, 204, and 206 is sequenced together with spatial light modulator 114 to generate different perspective images of corresponding 3D content.

[0033] like Figure 2 As shown, the first light source 200 emits first light 208 during a first time period t1 based on instructions received from the light field display controller 126. For example, the first light 208 may be blue light. In other examples, the first light 208 is red light, green light, or light of another color based on a combination of red, green, and / or blue light. The first light 208 emitted by the first light source 200 passes through an illumination optics 112 (e.g., one or more lenses).

[0034] like Figure 2 As shown, the illumination optics 112 guides or focuses the first light 208 onto the spatial light modulator 114 at a first angle. Specifically, the illumination optics 112 focuses the first light 208 onto a corresponding mirror of the spatial light modulator 114, where the mirror corresponds to a pixel of the spatial light modulator 114. For example, Figure 1 The spatial light modulator 114 includes a first pixel 210, a second pixel 212, and a third pixel 214. The spatial light modulator 114 may include a pixel 210, a second pixel 212, and a third pixel 214. Figure 2 The pixels shown are more pixels than the pixels shown.

[0035] exist Figure 2 In the example, some pixels of spatial light modulator 114, 210, 212, 214, are turned on, such that light is reflected from the activated pixel(s) and directed to the projection eyepiece optics 106. In an example where spatial light modulator 114 is a digital micromirror device, the mirror(s) of the device (e.g., pixel(s) 210, 212, 214) are selectively tilted to deflect light toward (e.g., to "on") or away from (to "off") the projection eyepiece optics 106. For example, the mirrors of spatial light modulator 114 may have a tilt angle of + / - 12°. In an example where spatial light modulator 114 includes LCOS or LEDs, pixels are turned on and off via polarization.

[0036] exist Figure 2In the example, the light field display controller 126 selectively instructs certain pixels among pixels 210, 212, and 214 to turn on based on the image to be projected by the spatial light modulator 114. Figure 2 In this configuration, the light field display controller 126 selectively activates the first, second, and / or third pixels 210, 212, 214 of the spatial light modulator 114 to create one or more images corresponding to different views of the 3D content. First light 208 (e.g., blue light) emitted by the first light source 200 is deflected by the corresponding pixels 210, 212, 214 and guided to the projection eyepiece optics 106. As a result of the first light source 200 emitting light 208 at a first angle, the projection eyepiece optics 106 magnifies the first view (e.g., a first-angle view) of the 3D image from the spatial light modulator. Figure 2 In the example, when the user's eye 218 is placed at the exit pupil 216, the user of the near-field light display 102 sees a magnified first view of the 3D content.

[0037] exist Figure 1 and Figure 2 In an example where system 100 provides an augmented reality display of 3D content, a beam splitter or waveguide can be positioned between the projection eyepiece optics 106 and the exit pupil 216. As a result, the projected 3D content is overlaid onto the real-world environment in which the user is located and which can be seen through the beam splitter or waveguide.

[0038] As described above, the first light source 200 is an RGB light source. When the first light source 200 is activated by the light field display controller 126 during a first time period t1, the first light source 200 emits blue light during a first duration of the first time period t1, emits red light during a second duration of the first time period t1, and emits green light during a third duration of the first time period t1. Therefore, when the first RGB light source 200 emits blue light (e.g., first light 208) during the first duration of the first time period t1, a first view of a 3D image is generated based on the blue light. When the first RGB light source 200 emits red light during the second duration of the first time period t1, the red light follows or substantially follows Figure 2 The path of the first light 208 shown (e.g., with) Figure 1 The path of the blue light represented by line 208 is the same or substantially the same. As a result, a first view of the 3D image is generated based on the red light for viewing at the exit pupil 216. Similarly, when the first RGB light source 200 emits green light during the third duration of the first time period t1, the green light follows the path of the first light 208 (e.g., with the path of the first light 208). Figure 1 Line 208 in the diagram represents the same or substantially the same path of blue light. As a result, a first view of a 3D image is generated based on green light, to be viewed at the exit pupil 216. Figure 2In the example, the light field display controller 126 instructs the first light source 200 to emit blue, red, and green light during corresponding durations of a first time period t1 based on a predefined duty cycle. For example, the light field display controller 126 may instruct the first light source 200 to emit green light for 40% of the first time period t1, red light for 35% of the first time period t1, and green light for 25% of the first time period t1. The duty cycle may vary based on, for example, the wavelength of the emitted light, the desired color(s) produced in combination with(one or more) 3D images, etc.

[0039] exist Figure 2 In the example, the light field display controller 126 instructs the second light source 202 of the light source array 110 to emit light during a second time period t2. Figure 2 In the example, the second time period t2 can occur after the first time period t1, causing the first light source 200 and the second light source 202 to be activated sequentially in time. For example... Figure 2 As shown, the second light source 202 emits a second light 220 during a second time period t2. The second light 220 emitted by the second light source 202 can be red light, green light, blue light, and / or another colored light based on a combination of red light, blue light, and / or green light according to the duty cycle of the second light source 202. If the emission of light is ordered at a specific rate, the sequential emission of red light, green light, and blue light can be based on the human eye's ability to perceive a mixture of red light, green light, and blue light as white light.

[0040] like Figure 2As shown, the second light 220 emitted by the second light source 202 passes through the illumination optics 112 and is focused on pixels 210, 212, 214 of the spatial light modulator 114 at a second angle different from the angle of the first light 208 emitted by the first light source 200. As a result, the second light 220 of the second light source 202 illuminates pixels 210, 212, 214 of the spatial light modulator 114 at an angle different from when the first light 208 of the first light source 200 illuminates pixels 210, 212, 214. The second light 220 emitted by the second light source 202 is deflected by the activated pixels(s) 210, 212, 214 of the spatial light modulator 114 and guided to the projection eyepiece optics 106. The projection eyepiece optics 106 (e.g., one or more lenses) transmits a second view (e.g., a second-angle view) of the 3D image at the exit pupil 216, based on the angle at which the second light 220 is emitted by the second light source 202. Therefore, different angular views of the 3D content are generated by illuminating the spatial light modulator 114 with light 208, 220 emitted by the respective first light source 200 and second light source 202 at different angles. As described above, the second light source 202 emits, for example, red, blue, and green light during the second time period t2 based on instructions from the light field display controller 126 and a predefined duty cycle.

[0041] exist Figure 2 In the example, regarding the emitted light (e.g., red, green, and blue light) of each of the light sources 200, 202, 204, and 206, the first light source 200, the second light source 202, the third light source 204, and the fourth light source 206 are activated sequentially over time. Therefore, during the third time period t3, the third light source 204 emits light 222, which, based on its duty cycle, includes, for example, red, green, and blue light for the corresponding duration of the third time period t3. The light 222 emitted by the third light source 204 passes through the illumination optics 112, is focused onto one or more pixels 210, 212, 214 of the spatial light modulator 114, and is guided or directed to the projection eyepiece optics 106. Figure 2 As shown, light 222 emitted by the third light source 204 illuminates the spatial light modulator 114 at a third angle, which is different from the angle of light 208, 220 emitted by the corresponding first light source 200 and second light source 202. As a result of the third light source 204 emitting light 222 at the third angle (e.g., red light, green light, blue light), the projection eyepiece optics 106 transmits a third view (e.g., a third-angle view) of the 3D image at the exit pupil 216.

[0042] Similarly, the projection eyepiece optics 106 transmits a fourth view (e.g., a fourth-angle view) of the 3D image at the exit pupil 216 based on light 224 (e.g., red, green, and blue light) emitted by a fourth light source 206 during a fourth time period t4. Figure 2 In the example, light 224 emitted by the fourth light source 206 illuminates the spatial light modulator 114 at a fourth angle, different from the angles of the light emitted by the first light source 200, the second light source 202, and the third light source 204. Based on the duty cycle, the light 224 emitted by the fourth light source 206 during the fourth time period t4 may include red light, green light, blue light, or light of another color.

[0043] Therefore, in Figure 2 In the example, four different views of the 3D content are created by illumination from four different angles corresponding to light emitted by four light sources 200, 202, 204, and 206 (e.g., red, green, and blue light emitted by each of the light sources during corresponding time periods t1, t2, t3, and t4) via spatial light modulator 114. Specifically, the light sources 200, 202, 204, and 206 are time-division multiplexed using spatial light modulator 114 to create different images providing different perspective views of the 3D content. For example, in one or more views, the 3D content may appear angled or tilted. The user (e.g., ...) Figure 1 The user's brain (104) synthesizes multiple views generated by the spatial light modulator 114 and transmitted by the projection eyepiece optics 106, allowing the user to see different views of 3D content. In the examples disclosed herein, light sources 200, 202, 204, 206 and the spatial light modulator 114 are electrically coupled to enable the sequencing of red, green, and blue light to produce 3D content. For example, the sequencing of red, green, and blue light is performed for each of the light sources 200, 202, 204, 206 because each light source includes red, green, and blue wavelengths. The sequencing of each of the light sources 200, 202, 204, 206 produces white light for a specific 2D image. In the examples disclosed herein, each of the light sources 200, 202, 204, 206 is sequenced using the spatial light modulator to create different perspective images of the corresponding 3D content.

[0044] As mentioned above, in Figure 2 In the example, the projection eyepiece optics 106 defines the exit pupil 216, or the position on the retina of the user's eye 218 where each view of the 3D image generated by the spatial light modulator 114 is imaged when the user places his or her eye 218 at the exit pupil 216. The diameter of the exit pupil 216 is determined by the focal length of the projection eyepiece optics 106, the focal plane image (e.g., ... Figure 2The size of the spatial light modulator 114 in the example and the F-number (F-number, aperture number) of the optical system defined by the light source of the light source array 110, the spatial light modulator 114 and the projection eyepiece optics 106 are defined.

[0045] exist Figure 1 and Figure 2 In the example, the F-number (F / #) of the optical system defined by the light sources of the light source array 110, the spatial light modulator 114, and the projection eyepiece optics 106, and the size of the spatial light modulator 114 define the light-gathering rate of the optical system, or the ability of one or more light sources 200, 202, 204, 206 to emit light and the ability of the spatial light modulator 114 to receive light. In order for the spatial light modulator 114 to capture the maximum or substantially maximum brightness of the light 208, 220, 222, 224 emitted by one or more light sources 200, 202, 204, 206, the light-gathering rates of the one or more light sources 200, 202, 204, 206 should be suitable within the light-gathering rate of the spatial light modulator 114. Figure 2 In the example, the amount of light that the spatial light modulator 114 can collect is based on, for example, the angular range that the micromirrors of the spatial light modulator 114 can move (e.g., + / -12°, + / -17°).

[0046] exist Figure 2 In the example, the light-gathering rate of the spatial light modulator 114, and therefore its F / #, is divided by the light sources 200, 202, 204, 206 of the light source array 110, because each of the light sources 200, 202, 204, 206 in the light source array 110 is smaller than a single light source at substantially maximum brightness. Since F / # defines the size (e.g., diameter) of the exit pupil 216, the exit pupil 216 is also subdivided by the number of light sources 200, 202, 204, 206. For example, if the exit pupil diameter of a single light source is 10 mm, and there are two light sources, then the exit pupil diameter of each of the two light sources is 5 mm. In the examples disclosed herein, one or more light sources 200, 202, 204, 206, spatial light modulator 114, illumination optics 112, and projection eyepiece optics 106 are optically coupled via the system's light-gathering rate, and the size of one or more light sources 200, 202, 204, 206 is determined by the size of spatial light modulator 114 and the light receiving cone angle (i.e., F / # or numerical aperture). The selected F / # determines the size of illumination optics 112 and projection eyepiece optics 106, which enables illumination optics 112 and projection eyepiece optics 106 to capture all light.

[0047] Therefore, in Figure 2In the example, the exit pupil 216 is divided by the number of light sources 200, 202, 204, and 206 in the light source array 110, which results in the creation of smaller pupils or sub-pupils within the light collection rate of the spatial light modulator 114 (e.g., within the amount of light that can be collected by the spatial light modulator 114). Figure 2 In the image, the user browses the exit pupil 216 and sees different images of 3D content, divided by the number of light sources in the light source array 110. The sequential activation of light sources 200, 202, 204, and 206 provides a time-division multiplexed view of the 3D content. Figure 2 In the example, when light from corresponding light sources 200, 202, 204, 206 illuminates the spatial light modulator 114, the rendering of different views of the 3D content is based on the refresh rate of the spatial light modulator 114 when providing (e.g., flickering) a particular view. For example, the example spatial light modulator 114 may have a refresh rate of 240 Hz. In such examples, the spatial light modulator 114 may produce different views at refresh rates of 60 Hz each. Figure 2 The four light sources 200, 202, 204, and 206 of the light source array 110 correspond to four views of the 3D content. The user's brain synthesizes the images flickering by the spatial light modulator 114, allowing the user to perceive different views of the 3D content.

[0048] As a result of dividing the exit pupil 216 into sub-pupils based on the number of light sources 200, 202, 204, and 206 in the light source array 110, each sub-pupil has a slow F / # and therefore a long depth of field. Thus, 3D content is displayed with increased depth. Figure 1 and Figure 2 Increasing the depth of field in the display device 102 can reduce the vergence-accommodation conflict experienced by the user of the display device 102. Vergence-accommodation conflict can occur when the user's brain receives mismatched information about the distance or vergence of a virtual 3D object and the focusing distance or accommodation. For example, when a 3D object appears close to the user's face while the image is optically farther away, the user's eyes may focus at the wrong distance. However, with increased depth of field, the user's eyes converge at a certain distance from the display, making the 3D object appear to pop into or out of the display without accommodation or focusing. Therefore, Figure 1 and Figure 2 The near-field eye display device 102 provides an improved display of different views of 3D content.

[0049] Figure 3An example system 300 for rendering multiple views of 3D content via a display device 302, constructed in accordance with the teachings of this disclosure, is shown, wherein the display device 302 is a surface-mounted display device, such as a direct-view monitor, a desktop light field display, or another non-wearable display device. Figure 3 Example display device 302 includes screen 303, which allows a user (e.g., Figure 1 User 104) can view 3D content. Display device 302 includes one or more RGB light sources 304 defining a light source array 306. The one or more example light sources 304 may include LEDs, microLEDs, OLEDs, lasers, etc. In some examples, the light source array 306 of the surface-mount display device 302 includes a spatial light modulator that can pattern light and simulate many light sources, as combined below. Figure 5 As stated above.

[0050] Figure 3 The display device 302 includes an illumination optics 308. The illumination optics 308 includes one or more lenses to guide light emitted by one or more light sources 304 to a spatial light modulator 310 of the display device 302. Figure 3 The example spatial light modulator 310 may include a digital micromirror device (DMD). Figure 3 In one example, the spatial light modulator 310 selectively directs light emitted by one or more light sources 304 and focused by one or more light sources 304 onto a mirror (e.g., a pixel) of the spatial light modulator 310 to generate an image of 3D content.

[0051] Figure 3 The display device 302 includes one or more semiconductor-based processors 312 to control the operation of one or more light sources 304 and / or spatial light modulators 310. The display device 302 may include a battery to provide power to one or more processors 312 and / or other components of the display device 302.

[0052] In other examples, one or more processors are separate from the display device 302. For example, by a cloud-based device (e.g., Figure 1 One or more processors, servers, and / or virtual machines implemented in a cloud-based device 124 can generate instructions via a communication path (e.g., via WiFi, cellular, Bluetooth, and / or other communication protocols) to control one or more light sources 304 and / or spatial light modulators 310 of the display device 302. In other examples, a processor from another non-wearable or wearable device (e.g., Figure 1The processor 120 of the user equipment 122 can communicate with the display device 302 (e.g., via WiFi, cellular, Bluetooth, and / or communication protocols). In some examples, the processor(s) 312(s) of the display device 302 are communicatively coupled to one or more other processors (e.g., cloud-based devices 124, etc.) via one or more wired or wireless connections. Figure 1 The processor 120 of the user equipment 122).

[0053] exist Figure 3 In this example, one or more light sources 304 and spatial light modulator 114 are controlled by an example light field display controller 126. One or more components of the example light field display controller 126 may be controlled by one or more processors 312 in the display device 302, or by a processor in another user device (e.g., ...). Figure 1 The user equipment 122's processor 120) and / or cloud-based devices (e.g., Figure 1 It is implemented by software running on cloud-based devices (124).

[0054] exist Figure 3 In this example, the light field controller 126 sequentially activates one or more light sources 304 to emit light, thereby causing different views of the 3D content generated via the spatial light modulator 310. When the first light source among the light sources 304 is activated, the light emitted by the first light source 304 (e.g., red, blue, and / or green light based on a predefined duty cycle) is focused onto the spatial light modulator 310 at a first angle (e.g., via illumination optics 308). When the second light source among the light sources 304 is activated, the light emitted by the second light source 304 is focused onto the spatial light modulator 310 at a second angle different from the first angle, at which the light from the first light source 304 is focused onto the spatial light modulator 310.

[0055] Spatial light modulator 310 reflects at least a portion of light from one or more light sources 304 onto projection optics 314 of display device 302. Projection optics 314 projects different views of 3D content based on different angles at which light emitted from the respective light sources 304 is focused onto spatial light modulator 310. Figure 3 In some examples, projection optics 314 includes one or more lenses to expand the image(s) provided by spatial light modulator 310 for viewing via screen 303 of display device 302. In some examples, screen 303 includes a large-field lens, such as a Fresnel lens. In some examples, screen 303 includes a diffuser. Figure 3In the example, when the user places his or her eyes at eye-tracking range position 316 (e.g., the exit pupil or viewing position projected from screen 303 where the user sees one or more images), the user will see different views of the 3D content. Figure 3 In the example, different views of 3D content provide a motion parallax effect, allowing the viewer to perceive, for example, that he or she is looking around at the 3D object or seeing different sides of the object.

[0056] Figure 4 It is shown Figure 3 The diagram of system 300. (See figure below.) Figure 4 As shown, the light source array 306 includes multiple light sources (e.g., Figure 3 The plurality of light sources includes a first light source 400, a second light source 402, and a third light source 404. Example light source array 306 may include... Figure 4 The examples show more or fewer light sources. Example light sources 400, 402, and 404 include RGB light sources that are sorted to create white light for a specific 2D image based on red, green, and blue wavelengths, and sorted using a spatial light modulator 310 to generate different perspective images of the corresponding 3D content.

[0057] like Figure 4 As shown, the first light source 400 emits first light 406 in a first time period t1 based on instructions received from the light field display controller 126. The first light 406 may include, for example, red light, green light, blue light, or a combination thereof. Figure 4 As shown, first light 406 passes through illumination optics 308. Illumination optics 308 guides the first light 406 onto spatial light modulator 310 at a first angle. As described above... Figure 1 and Figure 2 The spatial light modulator 114 discussed, Figure 3 The spatial light modulator 310 includes pixels (e.g., mirrors) selectively activated by the light field display controller 126 to deflect light received from light sources 400, 402, 404 toward the projection optics 314, so that an image is provided or transmitted by the spatial light modulator 310. As a result of the first light source 400 emitting light 406 at a first angle, the projection optics 314 projects a first view (e.g., a first-angle view) of a 3D image via the screen 303 at the eye-tracking range 316. Figure 3 In the example, when the user's eye 408 is placed at the eye movement range 316, the user of the surface-mounted display device 302 sees a first view of the 3D content.

[0058] During the first time period t1, it is basically as described above. Figure 2As described in light sources 200, 202, 204, and 206, the example first light source 400 emits red light during a first duration of a first time period t1, green light during a second duration of the first time period t1, and blue light during a third duration of the first time period t1, based on a predefined duty cycle. As a result, during the first time period t1, a first view (e.g., a first angle) of a 3D image is generated based on red, green, and blue light.

[0059] exist Figure 4 In the example, the light field display controller 126 instructs the second light source 402 to emit a second light 410 during a second time period t2, wherein, regarding the emitted light of the light sources 400 and 402, the first light source 400 and the second light source 402 are activated sequentially in time. Figure 4 In the example, the light field display controller 126 instructs the second light source 202 to emit, for example, red, green, and blue light during a second time period t2 based on a predefined duty cycle. The second light 410 emitted by the second light source 402 passes through the illumination optics 308 and is focused onto the pixels of the spatial light modulator 310 at a second angle, different from the first angle of the light 406 emitted by the first light source 400. The second light 410 is deflected by the pixels of the spatial light modulator 310 and directed to the projection optics 314. As a result of the second light source 402 emitting light 410 at the second angle, the projection optics 314 projects a second view (e.g., a second-angle view) of the 3D image via the screen 303 at the eye-tracking range 316.

[0060] exist Figure 4 In the example, the light field display controller 126 instructs the third light source 404 to emit a third light 412 during a third time period t3. Therefore, in Figure 3 In the example, regarding the emitted light from light sources 400, 402, and 404, the first light source 400, the second light source 402, and the third light source 404 are activated sequentially. Figure 4 In this example, the light field display controller 126 instructs the third light source 404 to emit, for example, red, green, and blue light during a third time period t3 based on a predefined duty cycle. The light 412 emitted by the third light source 404 passes through the illumination optics 308 and is focused onto the pixels of the spatial light modulator 310 at a third angle, different from the angles of the light 406, 410 emitted by the corresponding first light source 400 and second light source 402. The third light 412 is deflected by the pixels of the spatial light modulator 310 and guided to the projection optics 314. As a result of the third light source 404 emitting light 412 at the third angle, the projection optics 314 projects a third view (e.g., a third-angle view) of the 3D image via the screen 303 at an eye-tracking range position 316.

[0061] Therefore, in Figure 4In the example, based on the temporal emission of light from corresponding light sources 400, 402, and 404, three different views of 3D content are created by spatial light modulator 310 at three different angles. The user 104's brain integrates the multiple views generated by spatial light modulator 310, allowing the user 104 to view the 3D content from different perspectives. Based on a predefined refresh rate, spatial light modulator 310 provides three views corresponding to the three light sources 400, 402, and 404.

[0062] exist Figure 4 In the examples, it is basically as described above. Figure 1 and Figure 2 The near-field light display device 102, as described, divides the eye movement range 316 or the projected exit pupil by the number of light sources, in order to... Figure 3 and Figure 4 Within the light collection rate of the surface-mounted display device 302 (e.g., within the light collection rate of the spatial light modulator 310), a smaller pupil or sub-pupil is generated. For example, in Figure 4 In this model, the eye-tracking range 316 is divided into three sub-pupils based on three light sources 400, 402, and 404. As a result, the eye-tracking range 316 includes multiple sub-pupils for different views of the 3D content. Figure 4 In this method, each sub-pupil generates the full resolution of the spatial light modulator 310. Compared to methods that use lens arrays comprising individual lenses to create 3D views, dividing the eye-tracking range 316 into sub-pupils based on the number of light sources increases the depth of field of the generated view without resolution loss.

[0063] Figure 5 An example system 500 for rendering multiple views of 3D content via a display device 502, constructed in accordance with the teachings of this disclosure, is shown, wherein the display device 502 is a direct-view monitor, a desktop light field display, or another non-wearable display device. Figure 5 Example display device 502 can have one or more components that can interact with Figure 3 and Figure 4 The display device 302 (e.g., screen 303, illumination optics 308, spatial light modulator 310, projection optics 314, (one or more) processors 312) is the same as or substantially the same as the display device 302.

[0064] Figure 5 The display device 502 includes a screen 503, and a user (e.g., Figure 1 User 104) views the content through this screen 503. Figure 5 The system 500 includes a backlight unit 504. The backlight unit 504 includes a projection engine 505, which includes a first spatial light modulator 506. The first spatial light modulator 506 generates a projected image 508. Figure 5 In the example, projected image 508 represents a light source array (e.g., similar to...). Figure 3 and Figure 4 The light source array 306). In some examples, each pixel of the projection engine 505 to be used as a light source includes overlapping red, green, and blue pixels. For example, based on the activation of a first pixel of the projection engine, the projection image 508 may include a red square (or other red projection image) corresponding to a red light source. Based on the activation of a first pixel or another pixel of the projection engine, the projection image 508 may include a green square corresponding to a green light source. The projection image 508 may include a blue square corresponding to a blue light source. Therefore, the projection engine 505 recreates the LED or microLED array via the projection image 508 because one or more pixels of the projection engine 505 are activated to serve as one or more light sources. The projection engine 505 can create as many RGB light sources as possible for the display device 502 via the projection image 508 because there are pixels associated with the projection engine 505. For example, in an example where the projection engine 505 is a 1080p projector, the projection engine 505 will have 1920x1080 pixels, each of which can be used as a separate light source. Therefore, the projection engine 505 provides for the display device 502 to use as a light source. Figure 5 The component that emits light in the system 500.

[0065] exist Figure 5 In the example, each pixel of the projected image 508 can be used as a light source emitting light, wherein the emitted light is received by the second spatial light modulator 510 (e.g., DMD) of the display device 502. Specifically, the light field display controller 126 controls the first spatial light modulator 506 of the projection engine 505 to selectively turn on and off pixels of the projection engine 505 based on a predefined pattern to create the projected image 508. The pattern can define a specific time-based sequence in which pixels should be activated such that one or more light sources represented in the projected image 508 selectively emit light (e.g., similar to...). Figure 3 and Figure 4 The light sources 400, 402, and 404 of the light array 306 are activated sequentially. Light provided by one or more of the individual light sources of the projected image 508 passes through the illumination optics 512. Essentially, as described above... Figure 3 and Figure 4 As described in system 300, light is focused at different angles onto the pixels of the second spatial light modulator 510. The pixels of the second spatial light modulator 510 selectively deflect the light emitted by the projected image 508, resulting in the transmission of the 3D image. The backlight unit 504 and the second spatial light modulator 510 can be transmitted via one or more processors (e.g., Figure 3The surface-mounted display device 302 is controlled by one or more processors 312.

[0066] Figure 5 The system 500 includes a projection optics 514. As a result of light being emitted at different angles, the projection optics 514 projects different views of a 3D image (e.g., a first angle view, a second angle view) via a screen 503. Figure 5 In the examples, it is basically as described above. Figure 3 and Figure 4 The discussion focuses on different views of a 3D image viewed by a user at eye-tracking range 516.

[0067] Therefore, in Figure 5 In the example, the backlight unit 504, including the first spatial light modulator 506 and the resulting projected image 508, can pattern the light and simulate multiple light sources. In other words, the backlight unit 504 can provide an increased number of light sources generated within the light collection rate of the second spatial light modulator 510. For example, the light collection rate of the second spatial light modulator 510 (e.g., DMD) can accept light from a one-millimeter light source. If the light source has a size of half a millimeter, the number of light sources adapted to the light collection rate of the light source can be limited to two half-millimeter light sources. Figure 5 In the example, the number of available light sources is increased due to the projection engine 505 and its associated pixels, which can provide up to millions of light sources via the projected image 508 (e.g., based on the refresh rate of one or more spatial light modulators 506, 510). Therefore... Figure 5 The display device 502 provides an increased number of light sources within the light-gathering rate of the second spatial light modulator 510, and avoids limitations, such as those related to the size of individual lenses in the lens array. Figure 5 In the example, the increased number of available light sources results in an increased angular resolution of the 3D content displayed via display device 502. The increased angular resolution of the 3D content can provide a more distinct image (e.g., more clearly defined edges of 3D objects).

[0068] Figure 6A yes Figures 1-4 A block diagram of the light field display controller 126. As described above, the light field display controller 126 is configured to control... Figures 1-4 The light sources are 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 and Figures 1-4 The operation of one or more spatial light modulators 114, 310, to via Figures 1-4 The display devices 102 and 302 generate different views of the 3D content (e.g., views from different angles). Figure 6A In the example, the light field display controller 126 consists of one or more processors (e.g., Figure 1 The processor 116 of the wearable display device 102, Figure 1 The processor 120 of the user equipment 122, Figure 1 124 cloud-based devices Figure 3 The surface-mount display device 302 is implemented by one or more processors 312. In some examples, one or more components of the light field display controller 126 are implemented via a cloud computing environment, and one or more other parts of the analysis are handled by the processor of the display device or another user device (e.g., Figure 1 The wearable display device 102 is implemented by a processor 116, and the surface-mount display device 302 is implemented by one or more processors 312.

[0069] The light field display controller 126 includes one or more light source drivers 600. One or more example light source drivers 600 control... Figures 1-4 The corresponding light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, and 404 are activated. In such examples, one or more light source drivers 600 cause the light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, and 404 to emit light. The one or more light source drivers 600 control the activation of the one or more light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, and 404 based on one or more light source activation rules 602. The one or more light source activation rules 602 are stored in a database 604. In some examples, the light field display controller 126 includes the database 604. In other examples, the database 604 is located outside the light field display controller 126 in a location accessible to the light field display controller 126, such as... Figure 6A As shown in the image.

[0070] One or more example light source activation rules 602 can be defined based on one or more user inputs. One or more light source activation rules 602 define, for example, the sequence in which each of light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 will be activated to emit light, and the duration for which each light source 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 will be activated. One or more light source activation rules 602 define the duty cycle of one or more RGB light sources 108, 200, 202, 204, 206, 304, 400, 402, 404, or the duration for which the corresponding light source emits red, green, blue, or another color of light when the light source is activated. (One or more) light source activation rules 602 can define when (one or more) light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 should be activated based on data such as indicating that display devices 102, 302 are powered on (e.g., battery status data), content selected by the user, etc.

[0071] Figure 6A The light field display controller 126 has one or more light source drivers 600 that are instructed based on one or more light source activation rules 602. Figures 1-4 The corresponding light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, and 404 of the display devices 102 and 302 emit light. One or more light source drivers 600 communicate with the light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, and 404 via one or more wired or wireless communication protocols.

[0072] The light field display controller 126 includes a spatial light modulator controller 606. Example: Spatial light modulator controller 606 controls... Figures 1-4 The operation of one or more spatial light modulators 114, 310 of the display devices 102, 302. For example, Figure 6A The spatial light modulator controller 606 controls one or more spatial light modulators 114, 310 regarding which pixels (e.g., mirrors) are activated to deflect light toward the projection optics 106, 314 and which pixels deflect light away from the projection optics 106, 314. Figure 1 , 3 ) operation. Figure 6AThe spatial light modulator controller 606 controls the activation of pixels of spatial light modulators 114 and 310 based on one or more spatial light modulator activation rules 608. The spatial light modulator activation rules 608 define which pixels of spatial light modulators 114 and 310 should be activated based on one or more images of the 3D content to be generated. The spatial light modulator activation rules can define when spatial light modulators 114 and 310 should be activated based on data such as indications that display devices 102 and 302 are powered on or that the user has selected content. The spatial light modulator activation rules 608 can be defined by one or more user inputs and stored in a database 604.

[0073] Figure 6B yes Figure 5 A block diagram of the light field display controller 126. As described above, the light field display controller 126 is configured to control... Figure 5 The operation of the projection engine 505, including the first spatial light modulator 506 and the second spatial light modulator 510 of the display device 502, is used to generate different views (e.g., different angle views) of 3D content via the display device 502. Figure 6B In the example, the light field display controller 126 consists of one or more processors (e.g., Figure 3 The surface-mount display device 302 is implemented by one or more processors 312. In some examples, one or more components of the light field display controller 126 are implemented via a cloud computing environment, and one or more other parts of the analysis are handled by the processor of the display device or another user device (e.g., Figure 1 The wearable display device 102 is implemented by a processor 116, and the surface-mount display device 502 is implemented by one or more processors 312.

[0074] exist Figure 6BIn the example, one or more light source drivers 600 are included. These one or more example light source drivers 600 control the activation of the projection engine 505. Based on one or more light source activation rules 602, the one or more light source drivers 600 instruct the projection engine 505, including the first spatial light modulator 506, to create a specific light pattern based on the time-based activation of one or more pixels of the projection engine 505. The projection engine 505 emits a projected image 508 corresponding to the one or more activated pixels (e.g., red squares, blue squares) based on the pattern or according to a time-based sequence. As a result, the projected image 508 simulates a light array that provides one or more light sources to the system 500. As described above, the one or more light source activation rules 602 can be based on one or more user inputs and stored in a database 604. In addition to the light patterns created by the projection engine 505, the one or more light source activation rules 602 can define when the projection engine 505 should be activated to emit the projected image 508 based on one or more indications, such as the display device 502 being powered on or the user having selected content. One or more light source drivers 600 can communicate with the projection engine 505 via one or more wired or wireless communication protocols.

[0075] exist Figure 6B In the example, the spatial light modulator controller 606 controls Figure 5 The operation of the second spatial light modulator 510 of the display device 502. For example, the spatial light modulator controller 606 determines which pixels (e.g., mirrors) are activated to direct the light provided by the projected image 508 toward the projection optics 514. Figure 5 The spatial light modulator controller 606 of Figure 6 controls the operation of the second spatial light modulator 510 based on one or more spatial light modulator activation rules 608. These rules define which pixels of the second spatial light modulator 510 should be activated based on one or more images of the 3D content to be generated, and (e.g., based on data indicating that the display device 502 is powered on, the user has selected content, etc.) when the second spatial light modulator 510 should be activated. As described above, the spatial light modulator activation rules 608 can be defined by one or more user inputs and stored in a database 604.

[0076] Although Figure 6A and Figure 6B The implementation is shown in the figure. Figures 1-5 An example of a light field display controller, but Figure 6A and / or Figure 6BOne or more of the elements, processes, and / or devices shown may be combined, divided, rearranged, omitted, eliminated, and / or implemented in any other way. Furthermore, the light source activator 600, database 604, spatial light modulator controller 606, and / or more generally, Figure 6A and / or Figure 6B The light field display controller 126 can be implemented by hardware, software, firmware, and / or any combination of hardware, software, and / or firmware. Thus, for example, example light source activator 600, example database 604, spatial light modulator controller 606, and / or more generally, Figure 6A and / or Figure 6B Any of the light field display controllers 126 can be implemented by one or more analog or digital circuits, logic circuits, one or more programmable processors, one or more programmable controllers, one or more graphics processing units (GPUs), one or more digital signal processors (DSPs), one or more application-specific integrated circuits (ASICs), one or more programmable logic devices (PLDs), and / or one or more field-programmable logic devices (FPLDs). When reading any of the device or system claims of this patent to cover purely software and / or firmware implementations, at least one of the light source activator 600, example database 604, and / or spatial light modulator controller 606 is hereby explicitly defined as including non-transitory computer-readable storage devices or storage disks, such as memory, digital versatile disks (DVDs), optical discs (CDs), Blu-ray discs, etc., including software and / or firmware. Furthermore, in addition to or replacing Figure 6A and / or Figure 6B Those shown, Figure 6A and / or Figure 6B The light field display controller 126 may include one or more elements, processes, and / or devices, and / or may include any or more of the elements, processes, and devices shown herein. As used herein, the phrase “communication” (including variations thereof) covers direct communication and / or indirect communication via one or more intermediate components, and does not require direct physical (e.g., wired) communication and / or constant communication, but additionally includes selective communication at regular intervals, scheduled intervals, non-periodic intervals, and / or one-off events.

[0077] Figures 7-9 Example views of 3D content that can be generated by the following systems are shown: Figure 1 and Figure 2 The system 100 is provided for a user (e.g., user 104) to view via a near-field display device 102; Figure 3 and Figure 4 The system 300 is for users to view via a display device 302 mounted on an example surface; and / or Figure 5 The system 500 is provided for users to view via a display device 502 mounted on an example surface. For example, Figure 7 A first view 700 (e.g., a first angle view) of example 3D content 702 is shown. Figure 8 A second view 800 (e.g., a second angle view) of example 3D content 702 is shown, and Figure 9 This illustrates a third view 900 (e.g., a third-angle view) of example 3D content 702. When from... Figures 1-4 The corresponding light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 of systems 100 and 300 and / or with Figure 5 When the light associated with the projected image 508 in the system is deflected by spatial light modulators 114, 310, and 510, different views 700, 800, and 900 can be generated by the spatial light modulators 114, 310, and 510 of systems 100, 300, and 500. As described above, the light field display controller 126 activates corresponding light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, and 404 in chronological order to emit light at different angles, which results in... Figures 1-4 Spatial light modulators 114 and 310 provide different views 700, 800, and 900 of the 3D content 702. In other examples, light field display controller 126 instructs projection engine 505 to emit a projected image 508, which serves as a light source array in system 500. Figure 5 The second spatial modulator 510 provides different views 700, 800, and 900 of the 3D content based on the light provided by the projected image 508. The spatial light modulators 114, 310, and 510 of the systems 100, 300, and 500 provide each view 700, 800, and 900 based on a predefined refresh rate.

[0078] Users can view views 700, 800, and 900 via eye-tracking ranges 216, 316, and 516, which include multiple sub-pupils for each view. The user's brain stitches together these multiple views of the 3D content 702, giving the user the impression that they are viewing the 3D content 702 in a panoramic view. Despite this... Figures 7-9 The example shows three views 700, 800, and 900, but based on, for example, the number of light sources (e.g., light source array 306 or associated with projected image 508) and the angle at which the light is focused on the spatial light modulators 114, 310, and 510, additional views of the example 3D content 702 can be generated by the spatial light modulators 114, 310, and 510 of the system 100, 300, and 500.

[0079] Figure 10 and Figure 11 The diagram shows the representation used for implementation. Figure 6A and / or Figure 6B The light field display controller 126 includes example hardware logic, machine-readable instructions, a hardware-implemented state machine, and / or any combination thereof flowcharts. Machine-readable instructions may be one or more executable programs or portions thereof, to be combined as follows... Figure 12 The program is executed by a computer processor, specifically processor 126, as shown in the example processor platform 1200 discussed. The program may be embodied in software stored on a non-transitory computer-readable storage medium (such as a CD-ROM, floppy disk, hard disk, DVD, Blu-ray disc, or memory associated with processor 126), but the entire program and / or portions thereof may alternatively be executed by a device other than processor 126 and / or embodied in firmware or dedicated hardware. Furthermore, although references... Figure 10 and / or Figure 11 The flowchart shown illustrates an example program, but many other methods can be used to implement the light field display controller 126. For example, the execution order of the blocks can be changed, and / or some of the blocks described can be altered, eliminated, or combined. Additionally or alternatively, any or all blocks can be implemented by one or more hardware circuits (e.g., discrete and / or integrated analog and / or digital circuits, FPGAs, ASICs, comparators, operational amplifiers, logic circuits, etc.) structured to perform the corresponding operations without executing software or firmware.

[0080] The machine-readable instructions described herein can be stored in one or more of the following formats: compressed format, encrypted format, fragmented format, compiled format, executable format, packaged format, etc. Machine-readable instructions as described herein can be stored as data (e.g., portions of instructions, code, representations of code, etc.) that can be used to create, manufacture, and / or produce machine-executable instructions. For example, machine-readable instructions can be segmented and stored on one or more storage devices and / or computing devices (e.g., servers). Machine-readable instructions may require one or more of the following to be installed, modified, adapted, updated, combined, supplemented, configured, decrypted, decompressed, unpacked, distributed, redistributed, compiled, etc., so that they can be directly read, interpreted, and / or executed by computing devices and / or other machines. For example, machine-readable instructions can be stored in multiple parts, which are separately compressed, encrypted, and stored on separate computing devices, wherein these parts, when decrypted, decompressed, and combined, form a set of executable instructions that implement a program such as the program described herein.

[0081] In another example, machine-readable instructions may be stored in a state where they can be read by a computer, but require the addition of libraries (e.g., dynamic link libraries (DLLs)), software development kits (SDKs), application programming interfaces (APIs), etc., to execute the instructions on a specific computing device or other device. In yet another example, the machine-readable instructions (e.g., storage settings, data input, recorded network addresses, etc.) may need to be configured before they can be executed, wholly or partially. Therefore, the described machine-readable instructions and / or corresponding programs are intended to cover such machine-readable instructions and / or programs, regardless of their specific format or state at storage or otherwise at rest or in transit.

[0082] The machine-readable instructions described in this article can be represented by any past, present, or future instruction language, scripting language, programming language, etc. For example, machine-readable instructions can be represented using any of the following languages: C, C++, Java, C#, Perl, Python, JavaScript, Hypertext Markup Language (HTML), Structured Query Language (SQL), Swift, etc.

[0083] As mentioned above, Figure 10 and / or Figure 11 The example process can be implemented using executable instructions (e.g., computer and / or machine-readable instructions) stored on non-transitory computer and / or machine-readable media, such as hard disk drives, flash memory, read-only memory, optical disks, digital universal disks, caches, random access memory, and / or any other storage device or storage disk in which information is stored for any duration (e.g., extended time periods, permanent, brief moments, temporary buffers, and / or caches of information). As used herein, the term non-transitory computer-readable media is explicitly defined to include any type of computer-readable storage device and / or storage disk, excluding propagated signals and transmission media.

[0084] Figure 10 This is a flowchart representing an example machine-readable instruction that, when executed, causes... Figure 1 , Figure 2 , Figure 3 , Figure 4 and / or Figure 6A The light field display controller 126 controls one or more light sources (e.g., Figures 1-4 Light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404) and display devices (e.g., Figures 1-4The display devices 102, 302) include one or more spatial light modulators (e.g., Figures 1-4 The operation of one or more spatial light modulators 114, 310 to produce different angle views or perspective views of 3D content. Figure 10 Example instructions can be provided by Figure 1 , Figure 2 , Figure 3 , Figure 4 and / or Figure 6A The light field display controller 126 is executed.

[0085] Figure 10 The example instruction begins with the light field display controller 126 receiving an instruction to render 3D content via display devices 102, 302 (box 1000). The light field display controller 126 may receive the instruction to render 3D content based on, for example, the state of the battery 118 of display devices 102, 302 (indicating that display devices 102, 302 are powered on), or by receiving one or more user inputs at display devices 102, 302.

[0086] exist Figure 10 In the example, one or more light source drivers 600 of the light field display controller 126 activate first light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 (box 1002) during a first time period. The one or more light source drivers 600 are based on data stored in... Figure 6A The first light source 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 is activated by one or more light source activation rules 602 in the database 604. (One or more) Light source activation rule 602 defines a sequence of specific light sources among light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404, the duration for which each light source 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 will emit light, and the duty cycle of the duration for which red, green, blue, or other colored light is emitted during the activation of the corresponding light source 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404.

[0087] exist Figure 10In the example, the spatial light modulator controller 606 of the light field display controller 126 activates (e.g., turns on) one or more pixels 210, 212, 214 of the spatial light modulators 114, 310, so that the light emitted by the first light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 is deflected toward the projection optics 106, 314 of the display devices 102, 302 (box 1004). The spatial light modulator controller 606 determines the pixels 210, 212, 214 to be activated based on one or more spatial light modulator activation rules 608 stored in the database 604 of FIG. 6. The one or more spatial light modulator activation rules 608 define the pixels to be activated based on, for example, an image of 3D content to be presented. As a result of the activation pixels of the spatial light modulators 114 and 310 deflecting the light from the first light source toward the projection optics 106 and 314, the projection optics 106 and 314 project a first image of the 3D content corresponding to a first view (e.g., a first angle view) of the 3D content.

[0088] exist Figure 10 In the example, one or more light source drivers 600 of the light field display controller 126 activate second light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 (box 1006) during a second time period. The one or more light source drivers 600 activate the second light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 based on one or more light source activation rules 602, which define the specific sequence of light sources used to activate the light sources, the duty cycle of the second light sources emitting red, green, and blue light, etc.

[0089] exist Figure 10In the example, the spatial light modulator controller 606 of the light field display controller 126 activates one or more pixels 210, 212, 214 of the spatial light modulators 114, 310 to deflect light emitted by the second light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 toward the projection optics 106, 314 of the display devices 102, 302 (box 1008). In some examples, the pixels of the spatial light modulators 114, 310 activated to deflect light from the second light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 are the same pixels activated to deflect light from the first light source. The activation of the pixels of the spatial light modulators 114, 310 is based on one or more spatial light modulator activation rules 608. As a result of the deflection of light from the second light source toward the projection optics 106, 314 by the activated pixels of the spatial light modulators 114, 310, the projection optics 106, 314 project a second image of the 3D content corresponding to a second view (e.g., a second angle view) of the 3D content. As described above, the exit pupils 216, 316 associated with the projection optics 106, 314 are divided by the number of light sources, such that when a user places his or her eyes on the exit pupils 216, 316, the user will see different time-division multiplexed views of the 3D content.

[0090] exist Figure 10 In this context, one or more light source drivers 600 determine whether to activate another light source based on a light source activation sequence defined by one or more light source activation rules 602 (box 1010). If another light source 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 in the sequence is to be activated, then one or more light source drivers 600 activate the light source during a specific time period associated with the light source activation sequence (box 1012). Furthermore, a spatial light modulator controller 606 determines that pixels of spatial light modulators 114, 310 will be activated to deflect light emitted by one or more light sources to provide different views of the 3D content (box 1014).

[0091] Figure 10 The example instruction continues until no other light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, and 404 are activated in the sequence (box 1010). Figure 10In the example, one or more light source drivers 600 determine whether the light source activation sequence should be repeated (box 1016). The one or more light source drivers 600 determine whether the light source activation sequence should be repeated based on one or more light source activation rules 602, which can define the duration of the sequence to be implemented based on the image to be presented. The activation sequence of light sources 108, 110, 200, 202, 204, 206, 304, 306, 400, 402, 404 can also be based on the refresh rate of spatial light modulators 114, 310, which provides time-division multiplexed output of the image. When no other light source is to be activated to emit light, Figure 10 The example instruction ends (box 1018).

[0092] Figure 11 This is a flowchart representing an example machine-readable instruction that, when executed, causes... Figure 5 and / or Figure 6B The light field display controller 126 controls the projection engine (e.g., Figure 5 The first spatial light modulator 506 includes a projection engine 505 and a display device (e.g., Figure 5 The display device 502) includes one or more spatial light modulators (e.g., Figure 5 The operation of the second spatial light modulator 510) is used to generate different angle views or perspective views of 3D content. Figure 11 Example instructions can be provided by Figure 5 and / or Figure 6B The light field display controller 126 is executed.

[0093] Figure 11 The example instruction begins with the light field display controller 126 receiving an instruction to render 3D content via the display device 502 (box 1100). The light field display controller 126 may receive the instruction to render 3D content based on, for example, the state of the battery of the display device 502 indicating that the display device 502 is powered on, one or more user inputs received at the display device 502, etc.

[0094] exist Figure 11 In the example, one or more light source drivers 600 of the light field display controller 126 instruct a projection engine 505, including a first spatial light modulator 506, to generate a projected image 508 to provide a first light source (box 1102). The one or more light source drivers 600 are based on data stored in... Figure 6AThe light pattern or sequence defined by one or more light source activation rules 602 in database 604 instructs projection engine 505 to generate projection image 508. Projection engine 505 emits projection image 508 in response to one or more activated pixels of projection engine 505 based on the pattern. For example, projection engine 505 generates projection image 508 including a red square based on a pattern that defines a sequence of pixels (one or more) used to activate projection engine to emit light. The red square corresponds to a red light source.

[0095] exist Figure 11 In the example, the spatial light modulator controller 606 of the light field display controller 126 activates (e.g., turns on) one or more pixels of the second spatial light modulator 510 to deflect light associated with the first light source represented in the projected image 508 toward the projection optics 514 of the display device 502 (box 1104). The spatial light modulator controller 606 determines the pixels of the second spatial light modulator 510 to be activated based on one or more spatial light modulator activation rules 608 stored in the database 604 of FIG. 6. The one or more spatial light modulator activation rules 608 define the pixels to be activated based on, for example, an image of 3D content to be presented. As a result of the activated pixels of the second spatial light modulator 510 deflecting light from the first light source toward the projection optics 514, the projection optics 514 projects a first image of the 3D content corresponding to a first view (e.g., a first angled view) of the 3D content.

[0096] exist Figure 11 In the example, one or more light source drivers 600 of the light field display controller 126 instruct the projection image 508 to generate a projection image 508 to provide a second light source (box 1106). For example, the projection engine 505 generates a projection image 508 comprising green squares corresponding to a green light source based on a pattern that defines a sequence of pixels for activating the projection engine 505.

[0097] exist Figure 11In one example, the spatial light modulator controller 606 of the light field display controller 126 activates one or more pixels of the second spatial light modulator 510 to deflect light associated with the second light source represented in the projected image 508 toward the projection optics 514 of the display device 502 (box 1108). In some examples, the pixels of the second spatial light modulator 510 activated to deflect light from the second light source in the projected image 508 are the same pixels activated to deflect light from the first light source. The activation of the pixels of the second spatial light modulator 510 is based on one or more spatial light modulator activation rules 608. As a result of the activated pixels of the second spatial light modulator 510 deflecting light from the second light source toward the projection optics 514, the projection optics 514 projects a second image of the 3D content corresponding to a second view (e.g., a second angled view) of the 3D content. As described above, the number of light sources divides the exit pupil 516 associated with the projection optics 514, so that when the user places his or her eyes on the exit pupil 516, the user sees different time-division multiplexed views of the 3D content.

[0098] exist Figure 11 In this process, one or more light source drivers 600 determine, based on a light pattern defined by one or more light source activation rules 602, whether another light source should be generated via a projection image 508 created by the projection engine 505 (box 1110). If another light source is to be provided, the one or more light source drivers 600 instruct the projection engine 505 to generate a projection image 508 to provide another light source for the system 500 based on the activation of one or more specific pixels of the projection engine 505 and the light pattern (box 1112). Furthermore, the spatial light modulator controller 606 determines that pixels of the second spatial light modulator 510 will be activated to deflect light associated with one or more selected light sources represented in the projection image 508 toward the projection optics 514 of the display device 502 (box 1114).

[0099] Figure 11 The example instructions continue until there are no more other light sources provided via the projected image 508 (box 1010). Figure 11 In the example, one or more light source drivers 600 determine whether the light pattern used to generate the projected image 508 should be repeated (box 1116). The one or more light source drivers 600 determine whether the projected image light pattern should be repeated based on one or more light source activation rules 602, which can define the sequence of pixels (one or more) used to activate the projection engine 505 to create the projected image 508. When no other light source is activated via the projected image 508 to emit light, Figure 11 The example instruction ends (box 1118).

[0100] Figure 12 It is structured for execution Figure 10 and / or Figure 11 Instructions to achieve Figure 6A and / or Figure 6B A block diagram of an example processor platform 1200 for a light field display controller 126. The processor platform 1200 can be, for example, a server, personal computer, workstation, self-learning machine (e.g., neural network), mobile device (e.g., mobile phone, smartphone, tablet computer, such as iPad). TM Personal digital assistants (PDAs), internet devices, personal video recorders, headsets or other wearable devices, or any other type of computing device.

[0101] The processor platform 1200 shown in the example includes a processor 126. The processor 126 shown in the example is hardware. For example, the processor 126 can be implemented by one or more integrated circuits, logic circuits, microprocessors, GPUs, DSPs, or controllers from any desired family or manufacturer. The hardware processor can be a semiconductor-based (e.g., silicon-based) device. In this example, the processor implements one or more light source drivers 600 and a spatial light modulator controller 606.

[0102] The processor 126 of the illustrated example includes local memory 1213 (e.g., cache). The processor 126 of the illustrated example communicates via bus 1218 with main memory, which includes volatile memory 1214 and non-volatile memory 1216. The volatile memory 1214 may be synchronous dynamic random access memory (SDRAM), dynamic random access memory (DRAM), etc. Dynamic Random Access Memory This can be implemented using flash memory and / or any other type of random access memory device. The non-volatile memory 1216 can be implemented using flash memory and / or any other desired type of memory device. Access to the main memory 1214, 1216 is controlled by the memory controller.

[0103] The processor platform 1200 shown in the example also includes interface circuitry 1220. Interface circuitry 1220 can be implemented using any type of interface standard, such as an Ethernet interface, Universal Serial Bus (USB), etc. Interfaces, Near Field Communication (NFC) interfaces, and / or PCI Express interfaces.

[0104] In the example shown, one or more input devices 1222 are connected to interface circuitry 1220. The input devices 1222 allow users to input data and / or commands into processor 126. The input devices may be implemented, for example, audio sensors, microphones, cameras (still or video), keyboards, buttons, mice, touchscreens, touchpads, trackballs, isopoint mice, and / or voice recognition systems.

[0105] One or more output devices 1224 are also connected to the interface circuitry 1220 of the illustrated example. The output devices 1224 may be implemented, for example, by display devices (e.g., light-emitting diodes (LEDs), organic light-emitting diodes (OLEDs), liquid crystal displays (LCDs), cathode ray tube displays (CRTs), in-situ switch (IPS) displays, touchscreens, etc.), haptic output devices, printers, and / or speakers. Therefore, the interface circuitry 1220 of the illustrated example typically includes a graphics driver card, a graphics driver chip, and / or a graphics driver processor.

[0106] The interface circuit 1220 of the example shown also includes communication devices such as transmitters, receivers, transceivers, modems, residential gateways, wireless access points, and / or network interfaces that facilitate data exchange with external machines (e.g., any kind of computing device) via network 1226. Communication may be via, for example, Ethernet connections, digital subscriber line (DSL) connections, telephone line connections, coaxial cable systems, satellite systems, line-to-line wireless systems, cellular telephone systems, etc.

[0107] The processor platform 1200 shown in the example also includes one or more mass storage devices 1228 for storing software and / or data. Examples of such mass storage devices 1228 include floppy disk drives, hard disk drives, optical disk drives, Blu-ray disk drives, redundant array of independent disks (RAID) systems, and digital multifunction disk (DVD) drives.

[0108] Figure 10 and / or Figure 11 The machine-executable instructions 1232 may be stored in mass storage device 1228, volatile memory 1214, non-volatile memory 1216 and / or on removable non-transitory computer-readable storage media (such as CD or DVD).

[0109] In this specification, the term "and / or" (when used in the form of A, B, and / or C) means any combination or subset of A, B, and C, such as: (a) only A; (b) only B; (c) only C; (d) A and B; (e) A and C; (f) B and C; and (g) A, B, and C. Furthermore, as used herein, the phrase "at least one of A or B" (or "at least one of A and B") means an implementation including any of the following: (a) at least one A; (b) at least one B; and (c) at least one A and at least one B.

[0110] The example methods, apparatus, and articles of art described herein provide improved display of multiple perspective views of 3D digital content via a display device such as a head-mounted display or a surface-mount display. The examples described herein provide time-sequential activation of light sources, resulting in one or more light sources emitting light at different angles relative to a spatial light modulator. As a result of the different angles at which light is focused onto the spatial light modulator, the spatial light modulator deflects the light from each light source to provide an image corresponding to a different angular view of the 3D content. The exit pupil of the lens system associated with the display device is divided into sub-pupils based on the number of light sources. As a result, when a user of the display device browses the exit pupils, the user sees a time-division multiplexed view of the 3D content without sacrificing spatial resolution and with improved angular resolution of the image.

[0111] This article describes example methods, apparatuses, systems, and artifacts for rendering 3D digital content with multiple views. Other examples and combinations thereof include the following:

[0112] Example 1 includes a device comprising: screens 303 and 503; first light sources 108, 200, 202, 204, 206, 304, 400, 402, and 404 configured to emit first light 208, 220, 222, 224, 406, 412, and 410 at a first angle during a first time period; and second light sources 108, 200, 202, 204, 206, 304, 400, 402, and 404 configured to emit second light 208, 220, 222, 224, 406, 412, and 410 at a second angle during a second time period. The second angle differs from the first angle. The second time period differs from the first time period. The device includes spatial light modulators 114, 310, and 510, which are configured to provide a first view 700, 800, and 900 of digital content 702 based on a first angle of first light 208, 220, 222, 224, 406, 412, and 410 emitted during a first time period, and a second view 700, 800, and 900 of digital content 702 based on a second angle of second light 208, 220, 222, 224, 406, 412, and 410 emitted during a second time period. A first light source 108, 200, 202, 204, 206, 304, 400, 402, and 404, and a second light source 108, 200, 202, 204, 206, 304, 400, 402, and 404 are electrically coupled to the spatial light modulators 114, 310, and 510. The device includes projection optics 106, 314, and 514, which are configured to project first views 700, 800, and 900 and second views 700, 800, and 900 to be presented via screens 303 and 503. The projection optics 106, 314, and 514 are optically coupled to first light sources 108, 200, 202, 204, 206, 304, 400, 402, and 404, second light sources 108, 200, 202, 204, 206, 304, 400, 402, and 404, and spatial light modulators 114, 310, and 510.

[0113] Example 2 includes the device of Example 1, wherein first views 700, 800, 900 are first angle views 700, 800, 900 of digital content 702, and second views 700, 800, 900 are second angle views 700, 800, 900 of digital content.

[0114] Example 3 includes the device of Example 1, wherein the first light source 108, 200, 202, 204, 206, 304, 400, 402, 404 and the second light source 108, 200, 202, 204, 206, 304, 400, 402, 404 define the pixels of the light source array 110, 306.

[0115] Example 4 includes the device of Example 3, wherein the light source arrays 110 and 306 are microLED panels or OLED panels.

[0116] Example 5 includes the device of Example 1, wherein the first light includes red light, green light, and blue light. First light sources 108, 200, 202, 204, 206, 304, 400, 402, 404, and 505 are configured to emit red light during a first duration of a first time period, green light during a second duration of the first time period, and blue light during a third duration of the first time period.

[0117] Example 6 includes the device of Example 1, which further includes lenses 112, 308, and 512 configured to guide first light 208, 220, 222, 224, 406, 412, and 410 emitted by first light sources 108, 200, 202, 204, 206, 304, 400, 402, and 404 to spatial light modulators 114, 310, and 510. Lenses 112, 308, and 512 are optically coupled to the first light sources 108, 200, 202, 204, 206, 304, 400, 402, and 404, the second light sources 108, 200, 202, 204, 206, 304, 400, 402, and 404, and the spatial light modulators 114, 310, and 510.

[0118] Example 7 includes the device of Example 1, which further includes a projection engine 505 configured to generate a projected image 508 corresponding to the first light sources 108, 200, 202, 204, 206, 304, 400, 402, 404.

[0119] Example 8 includes a method comprising executing instructions via processor 126 to cause first light sources 304, 400, 402, 404 of direct-view display devices 302, 502 to emit first light 406, 412, 410; executing instructions via processor to cause second light sources 304, 400, 402, 404 of direct-view display devices 302, 502 to emit second light 406, 412, 410; and executing instructions via processor to selectively activate pixels of spatial light modulators 310, 510 of direct-view display devices 302, 502 to provide a first image of digital content 702 based on the first light and a second image of the digital content based on the second light. The first light 406, 412, 410 illuminates the pixels of the spatial light modulators 310, 510 at a first angle, and the second light 406, 412, 410 illuminates the pixels of the spatial light modulators 310, 510 at a second angle different from the first angle.

[0120] Example 9 includes the method of Example 8, further including causing the first light sources 304, 400, 402, 404 to emit first light 406, 412, 410 at a first time, and causing the second light sources 304, 400, 402, 404 to emit second light 406, 412, 410 at a second time, the second time occurring after the first time.

[0121] Example 10 includes the method of Example 11, further including wherein the first light 406, 412, 410 includes red light, green light and blue light, and further including causing the first light source 304, 400, 402, 404 to emit red light, green light and blue light based on a duty cycle.

[0122] Example 11 includes the method of Example 11, wherein the first image is a first perspective view 700, 800, 900 of digital content 702, and the second image is a second perspective view 700, 800, 900 of digital content.

[0123] Example 12 includes the method of Example 11, further comprising causing a third light source 304, 400, 402, 404 of a direct-view display device to emit a third light 406, 412, 410 at a third time, the third light 406, 412, 410 illuminating the pixels of spatial light modulators 310, 510 at a third angle, the third angle being different from the first angle and the second angle.

[0124] Example 13 includes the method of Example 8, instructing projection engine 505 to generate projection images 508 corresponding to the first light sources 304, 400, 402, 404.

[0125] Example 14 includes the method of Example 13, further including instructing the projection engine 505 to generate a projection image 508 corresponding to the second light sources 304, 400, 402, 404 based on a pattern for projecting the image 508.

[0126] Example 15 includes a device comprising components 108, 200, 202, 204, 206, 304, 400, 402, 404, and 505 for emitting light, the components being configured to emit first light 208, 220, 222, 224, 406, 412, and 410 and second light 208, 220, 222, 224, 406, 412, and 410. The device includes: projection optics 106, 314, 514 configured to project a first image based on a first light and a second image based on a second light; and spatial light modulators 114, 310, 510 configured to guide first light 208, 220, 222, 224, 406, 412, 410 and second light 208, 220, 222, 224, 406, 412, 410 relative to the projection optics 106, 314, 514. The first light 208, 220, 222, 224, 406, 412, 410 will be focused on the spatial light modulators 106, 314, 514 at a first angle, and the second light 208, 220, 222, 224, 406, 412, 410 will be focused on the spatial light modulators 106, 314, 514 at a second angle. The first angle and the second angle are different. Projection optics 106, 314, 514 are optically coupled to components 108, 200, 202, 204, 206, 304, 400, 402, 404, 505 for emitting light and spatial light modulators 114, 310, 510.

[0127] Example 16 includes the device of Example 15, wherein the components 108, 200, 202, 204, 206, 304, 400, 402, 404, and 505 for emitting light include light arrays 110 and 306, which include first light sources 108, 200, 202, 204, 206, 304, 400, 402, and 404 and second light sources 108, 200, 202, 204, 206, 304, 400, 402, and 404.

[0128] Example 17 includes the device of Example 15, wherein the components 108, 200, 202, 204, 206, 304, 400, 402, 404, and 505 for emitting light include a projection engine 505 configured to generate a projected image 508 based on the activation of a first pixel of the projection engine 505. The projected image 508 corresponds to the first light source 108, 200, 202, 204, 206, 304, 400, 402, and 404.

[0129] Example 18 includes the device of Example 17, wherein the projection engine 505 is configured to generate a projected image 508 corresponding to the second light sources 108, 200, 202, 204, 206, 304, 400, 402, 404 based on the activation of a second pixel of the projection engine 505.

[0130] Example 19 includes the device of Example 15, wherein the spatial light modulators 114, 310, 510 include a digital micromirror device.

[0131] Example 20 includes the device of Example 15, which further includes Fresnel screens 303 and 503.

[0132] Within the scope of the claims, modifications may be made to the described embodiments, and other embodiments are also possible.

Claims

1. A device for presenting digital content, comprising: A first light source is configured to emit first light during a first time period; A second light source is configured to emit a second light during a second time period, which is different from the first time period; A spatial light modulator, optically coupled to the first light source and the second light source, is configured such that: Receive the first light at a first angle; A first view of digital content is provided based on the first angle of the first light emitted during the first time period; The second light is received at a second angle, wherein the second angle is different from the first angle; and A second view of the digital content is provided based on the second angle of the second light emitted during the second time period; and A projection optics device optically coupled to the spatial light modulator, the projection optics device being configured to project a first view of the digital content through a first sub-pupil of the pupil of the near-eye display and a second view of the digital content through a second sub-pupil of the pupil of the near-eye display.

2. The device according to claim 1, wherein, The first view is a first-angle view of the digital content, and the second view is a second-angle view of the digital content.

3. The device according to claim 1, wherein, The first light source and the second light source define the pixels of the light source array.

4. The device according to claim 3, wherein, The light source array is a microLED panel or an OLED panel.

5. The device according to claim 1, wherein, The first light source is configured to emit red light during a first duration of the first time period, green light during a second duration of the first time period, and blue light during a third duration of the first time period.

6. The device of claim 1, further comprising a lens configured to guide the first light emitted by the first light source to the spatial light modulator, the lens being optically coupled to the first light source, the second light source, and the spatial light modulator.

7. The device of claim 1, further comprising a projection engine configured to generate a projected image corresponding to the first light source.

8. The device according to claim 1, wherein, The projection optics are configured to project the first view onto the screen and the second view onto the screen.

9. The device according to claim 1, wherein, The projection optics device is a projection optical eyepiece.

10. The device of claim 1, further comprising a processor electrically coupled to the first light source, the second light source, and the spatial light modulator, wherein, The processor is configured to: Instructing the first light source to emit the first light during the first time period; Instructing the second light source to emit the second light during the second time period; and The spatial light modulator is instructed to selectively activate pixels.

11. The device according to claim 1, further comprising: A third light source is configured to emit a third light during a third time period, which is different from the first and second time periods; as well as A fourth light source is configured to emit a fourth light during a fourth time period, which is different from the first time period, the second time period, and the third time period; The spatial light modulator is further configured to: The third light is received at a third angle, wherein the third angle is different from the first angle and the second angle; A third view of the digital content is provided based on the third angle of the third light emitted during the third time period; The fourth light is received at a fourth angle, wherein the fourth angle is different from the first angle, the second angle, and the third angle; and A fourth view of the digital content is provided based on the fourth angle of the fourth light emitted during the fourth time period; and The projection optics are further configured to project a third view of the digital content through a third sub-pupil of the pupil of the near-eye display and a fourth view of the digital content through a fourth sub-pupil of the pupil of the near-eye display.

12. A device for presenting digital content, comprising: A first light source is configured to emit first light during a first time period; A second light source is configured to emit a second light during a second time period, which is different from the first time period; A spatial light modulator, optically coupled to the first light source and the second light source, is configured such that: Receive the first light at a first angle; A first view of digital content is provided based on the first angle of the first light emitted during the first time period; The second light is received at a second angle, wherein the second angle is different from the first angle; and A second view of the digital content is provided based on the second angle of the second light emitted during the second time period; screen; and A projection optics device, optically coupled to the spatial light modulator and the screen, wherein the projection optics device is configured as follows: The screen is used to project the first view of the digital content onto the exit pupil of the first projection within the eye-tracking range; and The second view of the digital content is projected onto the exit pupil of the second projection within the eye-tracking range using the screen.

13. The device according to claim 12, wherein, The spatial light modulator is a digital micromirror device.

14. The device according to claim 12, wherein, The first light source is a first projected image, and the second light source is a second projected image. The device also includes a projector configured to generate the first projected image and the second projected image.

15. The device according to claim 12, wherein, The first light source is a first light-emitting diode, i.e., a first LED, and the second light source is a second LED.

16. The device according to claim 12, wherein, The first light source is configured to emit red light during a first duration of the first time period, green light during a second duration of the first time period, and blue light during a third duration of the first time period.

17. A method for presenting digital content, comprising: The first light is generated by the first light source during the first time period; A second light is generated by a second light source during a second time period, which is different from the first time period. The first light is received at a first angle by a spatial light modulator; The spatial light modulator provides a first view of digital content based on the first angle of the first light emitted during the first time period; The second light is received by the spatial light modulator at a second angle, wherein the second angle is different from the first angle; The spatial light modulator provides a second view of the digital content based on the second angle of the second light emitted during the second time period; The first view of the digital content is projected by a projection optics through a first sub-pupil of the pupil; and The second view of the digital content is projected by the projection optics through the second sub-pupil of the pupil.

18. The method according to claim 17, wherein, Generating the first light includes: Red light is generated during the first duration of the first time period; Green light is generated during the second duration of the first time period, and Blue light is generated during the third duration of the first time period.

19. The method of claim 17, further comprising: The lens guides the first light from the first light source to the spatial light modulator; as well as The lens guides the second light to the spatial light modulator.

20. The method of claim 17, wherein, The first view is a first-angle view of the digital content, and the second view is a second-angle view of the digital content.

21. The method according to claim 17, wherein, The first view is a first perspective view of the digital content, and the second view is a second perspective view of the digital content.

Images