Holographic display of three-dimensional objects

Abstract

The invention provides a method, a device, equipment, a subsystem and a system for holographic display of a three-dimensional object. In one aspect, a system includes a display and a controller. The display comprises a back plate with a plurality of circuits and a plurality of display components arranged on the back plate. The plurality of display components form an irregular pattern. Each of the plurality of display components is coupled to a respective circuit of the plurality of circuits. The controller is coupled to the display and configured to transmit at least one control signal to at least one display component of the display to modulate at least one characteristic of the at least one display component.

Description

[0001] Cross-referencing related applications This application claims priority to U.S. Application No. 18 / 410,185, filed January 11, 2024; U.S. Application No. 18 / 468,571, filed September 15, 2023; and U.S. Provisional Patent Application No. 63 / 501,928, filed May 12, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This invention relates to three-dimensional (3D) displays, and more specifically, to the display of 3D objects. Background Technology

[0003] Advances in traditional two-dimensional (2D) projection and 3D rendering have brought new approaches to 3D displays, including hybrid technologies that combine head and eye tracking with conventional display devices used in virtual reality (VR), augmented reality (AR), and mixed reality (MR). These technologies attempt to recreate the experience of holographic images by combining tracking and measurement-based computations to simulate stereoscopic or intraocular light fields that can be represented by actual holograms. Summary of the Invention

[0004] This disclosure also describes methods, apparatus, devices, subsystems, and systems for displaying 3D objects. This technology enables relatively compact optical systems for displaying 3D objects with relatively high efficiency, fast computation speed, high display refresh rate, and high image quality.

[0005] One aspect of this disclosure relates to a computer-implemented method for manipulating data of a plurality of primitives corresponding to at least one object, the data including primitive data of each of the plurality of primitives, a primitive including at least one vertex, the primitive data of the primitive including data of the at least one vertex, the computer-implemented method comprising: for each of the plurality of vertices of the plurality of primitives, associating a corresponding vertex identifier of the vertex with corresponding vertex data of the vertex, and storing the association between the corresponding vertex identifier of the vertex and the corresponding vertex data in a memory; and for each of the plurality of primitives, associating a corresponding primitive identifier of the primitive with one or more corresponding vertex identifiers of one or more vertices of the primitive in the memory, and storing the association between the corresponding primitive identifier of the primitive and the one or more corresponding vertex identifiers in the memory.

[0006] Another aspect of this disclosure relates to a computer-implemented method comprising: acquiring data of a plurality of primitives corresponding to at least one object, the data including primitive data of each of the plurality of primitives, wherein a primitive includes at least one vertex, and the primitive data of the primitive includes vertex data of the at least one vertex; for each of the plurality of vertices of the plurality of primitives, associating a corresponding vertex identifier of the vertex with the corresponding vertex data of the vertex, and storing the association between the corresponding vertex identifier of the vertex and the corresponding vertex data in a memory; and for each of the plurality of primitives, associating a corresponding primitive identifier of the primitive with one or more corresponding vertex identifiers of one or more vertices of the primitive in the memory, and storing the association between the corresponding primitive identifier of the primitive and the one or more corresponding vertex identifiers in the memory.

[0007] In some embodiments, the computer-implemented method further includes: determining a primitive identifier of a plurality of primitives associated with a command instruction; and transmitting a command including the command instruction and the primitive identifier of the plurality of primitives to a processing device.

[0008] In some embodiments, the computer-implemented method further includes: determining a vertex identifier associated with the primitive identifier; and transmitting the command, including the command instruction, the vertex identifier associated with the primitive identifier, and the primitive identifiers of the plurality of primitives, to the processing device. In some embodiments, the command instructs the plurality of primitives to be drawn according to the command instruction and based on at least one of the primitive identifiers of the plurality of primitives or the vertex identifiers associated with the primitive identifiers.

[0009] In some implementations, the computer-implemented method further includes determining the corresponding vertex identifiers of the plurality of vertices based on the order of the plurality of vertices in a vertex stream corresponding to the plurality of primitives.

[0010] In some implementations, the computer-implemented method further includes determining the corresponding primitive identifiers of the plurality of primitives based on their order in a primitive stream corresponding to the at least one object.

[0011] In some implementations, the at least one object includes a representative object in a three-dimensional (3D) simulation application configured to generate data for the plurality of primitives.

[0012] In some implementations, the corresponding vertex data of the vertex includes at least one of the following: vertex identifier of the vertex, coordinate information of the vertex in a 3D coordinate system, color information associated with the vertex, texture coordinate information associated with the vertex, shading information associated with the vertex, viewpoint-dependent shading information associated with the vertex (e.g., geometric specular reflection), or occlusion information associated with the vertex.

[0013] In some implementations, the primitive data of the primitive includes at least one of the following: the primitive identifier of the primitive, at least one vertex identifier of the at least one vertex, the coordinate information of the primitive in the 3D coordinate system, the color information of the primitive, the texture coordinate information of the primitive, the shading information of the primitive, the viewpoint-dependent shading information of the primitive (e.g., geometric specular reflection), or the occlusion information of the primitive.

[0014] In some implementations, the computer-implemented method further includes: adjusting the vertex data of the plurality of vertices of the plurality of primitives to generate gaps or overlaps between neighboring primitives of the plurality of primitives; and updating the vertex data of the plurality of vertices in the memory based on the result of the adjustment.

[0015] Another aspect of this disclosure relates to a non-transitory, computer-readable medium storing one or more instructions executable by at least one processor to perform the methods described above.

[0016] Another aspect of this disclosure relates to an apparatus comprising: at least one processor; and at least one memory coupled to the at least one processor and storing instructions thereon that can be executed by the at least one processor to perform the methods described above.

[0017] Another aspect of this disclosure relates to a method comprising: obtaining primitive data of the plurality of primitives based on information of the plurality of primitives including corresponding primitive identifiers corresponding to at least one object; determining, for each of the plurality of primitives, an electromagnetic (EM) field contribution to each of a plurality of display components of a display based on the primitive data of the primitive; and generating, for each of the plurality of display components of the display, a sum of the EM field contributions of the plurality of primitives to that display component.

[0018] Another aspect of this disclosure relates to a method comprising: acquiring information of a plurality of primitives corresponding to at least one object, wherein the information includes corresponding primitive identifiers of the plurality of primitives; acquiring primitive data of the plurality of primitives based on the information of the plurality of primitives; determining, for each of the plurality of primitives, an electromagnetic (EM) field contribution to each of a plurality of display components of a display based on the primitive data of the primitive; and generating, for each of the plurality of display components of the display, a sum of the EM field contributions of the plurality of primitives to the display component.

[0019] In some implementations, obtaining the information of the plurality of primitives corresponding to the object includes: receiving a command from a computing device, wherein the command includes the information of the plurality of primitives but not the primitive data of the plurality of primitives, and the command includes instructions for drawing the plurality of primitives based on the information of the plurality of primitives. Obtaining the primitive data of the plurality of primitives based on the information of the plurality of primitives may include: receiving the primitive data of the plurality of primitives from the computing device, wherein the primitive data of the plurality of primitives and the corresponding primitive identifier are associated and stored in the computing device.

[0020] In some implementations, each of the plurality of primitives includes one or more vertices, and the primitive data of the primitive includes vertex data of the one or more vertices. In some implementations, the information of the plurality of primitives includes: for each of the plurality of primitives, one or more vertex identifiers of the one or more vertices, and an association between the primitive identifier of the primitive and the one or more vertex identifiers of the one or more vertices of the primitive.

[0021] In some implementations, the plurality of primitives includes a plurality of vertices. Obtaining the primitive data of the plurality of primitives based on the information of the plurality of primitives includes retrieving the primitive data of the plurality of primitives from memory based on the vertex identifiers of the plurality of vertices of the plurality of primitives. The primitive data includes the corresponding vertex data of each vertex of the plurality of vertices, and the memory stores the vertex data of the plurality of vertices associated with the vertex identifiers of the plurality of vertices.

[0022] In some implementations, the corresponding vertex data of the vertex includes at least one of the following: the vertex identifier of the vertex, the coordinate information of the vertex in the 3D coordinate system, the color information associated with the vertex, the texture coordinate information associated with the vertex, the viewpoint-related shading information associated with the vertex, or the occlusion information associated with the vertex.

[0023] In some implementations, the plurality of primitives includes a first primitive and a second primitive that are adjacent to each other. The first primitive and the second primitive have at least one shared vertex.

[0024] In some implementations, for each of the plurality of primitives, determining the electromagnetic (EM) field contribution of the first primitive to each of the plurality of display components of the display based on the primitive data of the first primitive includes: determining the first EM field contribution of the first primitive to the display component of the display based on the primitive data of the first primitive; and determining the second EM field contribution of the second primitive to the display component of the display based on the first EM field contribution and the primitive data of the second primitive.

[0025] In some implementations, the method further includes: adjusting vertex data associated with at least one of the first primitive or the second primitive to generate a gap between the first primitive and the second primitive such that there are no shared vertices between the first primitive and the second primitive.

[0026] In some embodiments, the gap is equal to or greater than a preset diffraction limit of the display. In some embodiments, determining the electromagnetic (EM) field contribution of each of the plurality of primitives to the display based on the primitive data of the display includes: determining the EM field contribution of at least one of the first primitives or the second primitives based on the adjusted vertex data associated with at least one of the first primitives or the second primitives.

[0027] In some implementations, for each of the plurality of primitives, determining the electromagnetic (EM) field contribution of the primitive data of the display to each of the plurality of display components of the display includes: determining a first EM contribution of the primitive to a first display component of the display; and determining a second EM contribution of the primitive to a second display component of the display, the second display component being adjacent to the first display component, based on the first EM contribution.

[0028] In some implementations, for each of the plurality of primitives, determining the electromagnetic (EM) field contribution of the display to each of the plurality of display components of the display based on the primitive data of the display includes: determining at least one distance between the display component and the primitive in a three-dimensional (3D) coordinate system based on the coordinate information of the display component and the coordinate information of the primitive, and determining the EM field contribution of the primitive to the display component based on a predetermined expression of the primitive and the at least one distance.

[0029] In some implementations, the predetermined expression is determined based on at least one of the following: analytically calculating the EM field propagation from the primitive to the display component, a solution to Maxwell's equations with boundary conditions defined by the display, or at least one function from a group of functions including sine, cosine, and exponential functions, wherein determining the EM field contribution includes identifying the value of the at least one function in a table stored in memory.

[0030] In some embodiments, the method includes: determining a first corresponding EM field contribution from a first element of the plurality of primitives to each of the plurality of display components; determining a second corresponding EM field contribution from a second element of the plurality of primitives to each of the plurality of display components; and accumulating the EM field contribution of each of the plurality of display components by adding the first corresponding EM field contribution and the second corresponding EM field contribution corresponding to the display component.

[0031] In some implementations, determining the first corresponding EM field contribution of each of the plurality of display components from the first primitive to the plurality of display components and determining the second corresponding EM field contribution of each of the plurality of display components from the second primitive to the plurality of display components are performed in parallel.

[0032] In some implementations, for each of the plurality of primitives, determining the electromagnetic (EM) field contribution of the display to each of the plurality of display components of the display based on the primitive data of the display includes at least one of the following: determining the second EM field contribution of the second primitive to the first display component while determining the first EM field contribution of the first primitive to the first display component; determining the second EM field contribution of the second primitive to the second display component while determining the first EM field contribution of the first primitive to the first display component; or determining the second EM field contribution from the first primitive to the second display component while determining the first EM field contribution of the first primitive to the first display component.

[0033] In some embodiments, the method further includes: obtaining the sum of the EM field contributions of the plurality of display components to the display by determining the EM field contribution of each of the plurality of primitives to each of the plurality of display components and pipeline processing to generate the sum of the EM field contributions from the plurality of primitives to each of the plurality of display components.

[0034] In some embodiments, the method further includes generating a hologram corresponding to the object, the hologram including the sum of the EM field contributions of the plurality of display components of the display. The hologram may be a complex-valued hologram.

[0035] In some embodiments, the method further includes converting the complex-valued hologram into a pure phase hologram. In some embodiments, the hologram is a phase hologram or an amplitude hologram.

[0036] In some embodiments, the method further includes storing the hologram in a storage device. In some embodiments, the method further includes transmitting the hologram to a driving device for the display.

[0037] In some embodiments, the method further includes altering the hologram by adjusting the corresponding phase of each of the plurality of display components.

[0038] In some implementations, adjusting the corresponding phase of each of the plurality of display components includes adding the corresponding phase to the corresponding phase of each of the plurality of display components.

[0039] In some implementations, the corresponding phase of each of the plurality of display components is expressed as: Ø=2π (xcosθ + ysinθ) / λ , Wherein, Ø represents the corresponding phase of the display component, λ represents the wavelength of the light to be incident on the display component at the incident angle, θ represents the angle corresponding to the redirection angle of the optical redirection device configured to redirect light from the display, and x and y represent the coordinates of the display component in the global 3D coordinate system, wherein the EM field contribution of each of the plurality of display components to the display component is determined in the global 3D coordinate system.

[0040] In some implementations, the corresponding phase of each of the plurality of display components is expressed as: , Where Ø represents the corresponding phase of the display component, and a and b represent constants. λ This indicates the wavelength of the light that is to be incident on the display. f The focal length of the optical diverging component configured to diverge light from the display is represented, and x and y represent the coordinates of the display component in the coordinate system in which the contribution of each of the plurality of display components to the EM field of the display component is determined.

[0041] In some embodiments, the method further includes: after acquiring the primitive data of the plurality of primitives, adjusting the primitive data of the plurality of primitives, wherein the adjusted primitive data of the plurality of primitives corresponds to a virtual object moving relative to the display in a global 3D coordinate system. For each of the plurality of primitives, determining the electromagnetic (EM) field contribution of the primitive to each of the plurality of display components of the display based on the primitive data of the primitive includes: determining the EM field contribution of the primitive to each of the plurality of display components of the display based on the adjusted primitive data of the primitive in the 3D coordinate system.

[0042] In some implementations, the adjusted primitive data of the plurality of primitives corresponds to the virtual object rotated relative to the display at an angle in the global 3D coordinate system. This angle corresponds to the redirection angle of an optical redirection device configured to redirect light from the display such that the modulated light through the plurality of display components forms a holographic scene, while the display zero-order light from the display is redirected away from the holographic scene.

[0043] In some implementations, the adjusted primitive data of the plurality of primitives corresponds to the virtual object that moves relative to the display in the global 3D coordinate system along a direction perpendicular to the display by a certain distance, and the distance corresponds to the focal length of an optical diverging component configured to diverge light from the display, such that the modulated light through the plurality of display components forms a holographic scene without divergence, while the zero-order light from the display is diverged and suppressed in the holographic scene.

[0044] In some implementations, the method includes: calculating one or more mathematical functions using at least one of fixed-point representation or floating-point representation.

[0045] In some implementations, the method includes: calculating the corresponding EM field contribution of each of the plurality of primitives to each of the plurality of display components. The calculation of the corresponding EM field contribution may be performed without including at least one member selected from the group consisting of: extending the geometry of the object to the plurality of display components; performing visibility testing before packing the wavefront; and decision-making or communication between parallel computations of different primitives for the plurality of primitives. The calculation of the corresponding EM field contribution may be configured such that at least one member is selected from the group consisting of: tuning the parallel computations of the plurality of primitives to achieve speed, cost, size, or energy consumption optimization; reducing latency from the initiation of drawing to the result being ready for display; using fixed-point representation to increase accuracy; skipping the unpacking and repacking of floating-point representations between mathematical operations; and optimizing computation speed by optimizing mathematical functions.

[0046] In some implementations, the plurality of primitives includes at least one of point primitives, line primitives, and polygon primitives.

[0047] In some implementations, the primitive data of the primitive includes at least one of the following: the primitive identifier of the primitive, the coordinate information of the primitive in the 3D coordinate system, the color information of the primitive, the texture coordinate information of the primitive, the viewpoint-related shading information of the primitive (e.g., geometric specular reflection), the shading information of the primitive, or the occlusion information of the primitive.

[0048] In some implementations, the primitive data of the primitive includes texture coordinate information of the primitive, which includes values ​​associated with the discrete cosine transform (DCT) amplitude of pixels of an image to be mapped onto a specified surface of one or more of the plurality of primitives, wherein the DCT amplitude of the pixels of the image is associated with the DCT weights of the pixels of the image. For each of the plurality of primitives, determining the electromagnetic (EM) field contribution to each of the plurality of display components of the display based on the primitive data of the primitive includes: calculating the EM field contribution from each of the one or more primitives to each of the plurality of display components using the values ​​associated with the DCT amplitude of the pixels of the image.

[0049] In some implementations, the primitive data of the primitive includes occlusion information of the primitive. The method includes: determining one or more specific display components that do not contribute to the reconstruction of the given primitive based on the occlusion information of the given primitive; and for each of the one or more specific display components, generating a corresponding sum of the EM field contributions of the plurality of primitives to the specific display component by excluding the EM field contribution of the given primitive to the specific display component.

[0050] In some implementations, the primitive data of the primitive includes occlusion information of the primitive. The method includes: for each of the plurality of display components, determining, based on the occlusion information of the given primitive, a corresponding portion of the given primitive that does not contribute to the EM field of the display component; and for each of the plurality of display components, generating a sum of EM field contributions from the plurality of primitives to the display component by excluding the EM field contribution of the corresponding portion of the given primitive to the display component.

[0051] In some implementations, the primitive data of the primitive includes view-dependent shading information of the primitive. The method includes determining the corresponding EM field contribution of each of the plurality of primitives to each of the plurality of display components by taking into account the view-dependent shading information of the primitive.

[0052] In some embodiments, the method further includes: acquiring information about the display, wherein the information about the display includes coordinate information corresponding to a plurality of points of the plurality of display components. For each of the plurality of primitives, determining the electromagnetic (EM) field contribution of the display to each of the plurality of display components of the display based on the primitive data of the display includes: calculating the EM propagation from the primitive to the display in a three-dimensional (3D) coordinate system based on the coordinate information of the primitive and the coordinate information of the points corresponding to the display component.

[0053] In some embodiments, each of the plurality of display components has a plurality of corresponding shapes in a region of the display, each of the plurality of shapes uniquely surrounding a corresponding point of the plurality of points, and neighboring shapes of the plurality of shapes being distinct from each other. The coordinate information of the plurality of points includes coordinate information and offset data of a plurality of spaced points in the region of the display, the offset data including a corresponding offset between each of the plurality of points and a corresponding spaced point of the plurality of spaced points.

[0054] Another aspect of this disclosure relates to an apparatus comprising: at least one processor; and at least one memory coupled to the at least one processor and storing thereon instructions executable by the at least one processor to perform the methods described above.

[0055] Another aspect of this disclosure relates to an apparatus comprising: a command processor configured to: receive a command from a computing device, the command including information of a plurality of primitives corresponding to at least one object, the information including corresponding primitive identifiers of the plurality of primitives, and to process the command to obtain primitive data of the plurality of primitives from the computing device based on the information of the plurality of primitives; a plurality of computing units configured to calculate an electromagnetic (EM) field contribution of each of the plurality of primitives to each of a plurality of display components based on the primitive data of the plurality of primitives; and an accumulator configured to: accumulate the EM field contributions of the plurality of primitives to each of the plurality of display components, and to generate a hologram including a corresponding sum of the EM field contributions of the plurality of primitives to each of the plurality of display components.

[0056] In some implementations, the command processor, the plurality of computing units, and the accumulator are connected in series, and the plurality of computing units are connected in parallel between the command processor and the accumulator.

[0057] In some implementations, the device includes at least one of the following: application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), programmable gate array (PGA), central processing unit (CPU), graphics processing unit (GPU), phase unit processing unit (PPU), or standard computing unit.

[0058] In some embodiments, the device is configured to communicate with the computing device via a high-speed peripheral component interconnect (PCIe). In some embodiments, the device is an integrated chip that can be inserted into a PCIe slot of the computing device. In some embodiments, the device is configured to be integrated with the display in a package external to the computing device.

[0059] Another aspect of this disclosure relates to a method comprising: generating modulation control signals for a plurality of display components of a display based on a hologram of the display, wherein, for each of the plurality of display components, the hologram includes a sum of corresponding contributions of a plurality of primitives to the electromagnetic (EM) field of the display component corresponding to at least one object. Generating the modulation control signals comprises: for each of the plurality of display components, generating a corresponding modulation control signal based on the sum of the corresponding contributions of the plurality of primitives to the EM field of the display component.

[0060] Another aspect of this disclosure relates to a method comprising: acquiring a hologram of a display, wherein the display includes a plurality of display components, and for each of the plurality of display components, the hologram includes a sum of corresponding contributions of a plurality of primitives to the electromagnetic (EM) field of the display component corresponding to at least one object; generating a corresponding modulation control signal for each of the plurality of display components based on the sum of the corresponding contributions of the plurality of primitives to the display component in the EM field; and outputting the corresponding modulation control signal to each of the plurality of display components for modulating the display component.

[0061] In some embodiments, the hologram is a complex-valued hologram, wherein the method further includes converting the complex-valued hologram into a pure phase hologram, wherein the corresponding modulation control signals of the plurality of display components are generated based on the pure phase hologram.

[0062] In some embodiments, the method includes: receiving the complex-valued hologram from a processing device; storing the complex-valued hologram in a memory; and storing the pure-phase hologram in the memory after converting the complex-valued hologram into the pure-phase hologram.

[0063] In some embodiments, outputting the corresponding modulation control signal to each of the plurality of display components includes: sequentially outputting the corresponding modulation control signal to each of the plurality of display components.

[0064] In some embodiments, the method further includes transmitting an illumination control signal to an illuminator to activate the illuminator to illuminate the display, such that the light is modulated by the display's modulation display components to form a volume light field corresponding to the at least one object.

[0065] In some implementations, outputting the corresponding modulation control signal to each of the plurality of display components is performed in conjunction with transmitting the lighting control signal to the illuminator.

[0066] In some embodiments, the illuminator includes two or more light-emitting components, each configured to emit light of a different color, and the method includes: sequentially transmitting corresponding lighting control signals to sequentially activate each of the two or more light-emitting components of the illuminator.

[0067] In some embodiments, the method includes: sequentially outputting a first modulation control signal to modulate the display with information associated with a first color during a first time period, and outputting a second modulation control signal to modulate the display with information associated with a second color during a second, sequential time period; and sequentially outputting a first illumination control signal to activate the illuminator to turn on a first light-emitting component to emit light of the first color during the first time period, and outputting a second illumination control signal to activate the illuminator to turn on a second light-emitting component to emit light of the second color during the second time period.

[0068] Another aspect of this disclosure relates to an apparatus comprising: at least one processor; and at least one memory coupled to the at least one processor and storing thereon instructions executable by the at least one processor to perform the methods described above.

[0069] Another aspect of this disclosure relates to an apparatus comprising: a memory configured to store a hologram of a display; and a display driver coupled to the memory and the display. The display includes a plurality of display components, and for each of the plurality of display components, the hologram includes a sum of corresponding contributions of a plurality of primitives to the electromagnetic (EM) field of that display component from at least one object. The display driver is configured to: for each of the plurality of display components, generate a corresponding modulation control signal based on the sum of the corresponding contributions of the plurality of primitives to the EM field of that display component, and output the corresponding modulation control signal to each of the plurality of display components to modulate that display component.

[0070] In some embodiments, the device further includes an illuminator driver coupled to an illuminator, wherein the illuminator driver is configured to generate and transmit an illumination control signal to the illuminator to activate the illuminator to illuminate the display, such that the light is formed by the modulation display components of the display to form a volume light field corresponding to the at least one object.

[0071] In some embodiments, the display driver and the illuminator driver are configured to communicate with each other such that the output of the corresponding modulation control signal to each of the plurality of display components via the display driver and the transmission of the lighting control signal to the illuminator via the illuminator driver are performed in a coordinated manner.

[0072] In some embodiments, the memory includes a first storage buffer coupled to the display driver and a second storage buffer coupled to the illuminator driver, wherein the second storage buffer has a smaller capacity than the first storage buffer.

[0073] In some implementations, the device is configured to perform the methods described above.

[0074] Another aspect of this disclosure relates to an apparatus comprising: a backplane including a plurality of circuits and a plurality of components on the backplane, the plurality of components being formed in an irregular pattern. The plurality of components are coupled to the plurality of circuits through regularly arranged conductive vias.

[0075] In some implementations, the device includes a display, camera, or image sensor. The components may include phase units or pixels.

[0076] In some implementations, the irregular pattern includes a Voronoi pattern.

[0077] In some implementations, at least one of the plurality of components has an irregular polygonal shape.

[0078] In some implementations, adjacent components of the plurality of components have different shapes.

[0079] In some implementations, the size distribution of the plurality of components is around the same value as the spatial frequency response of the device.

[0080] In some embodiments, the device includes: a liquid crystal layer; a transparent conductive layer serving as a common electrode on the top side of the liquid crystal layer; and a plurality of metal electrodes on the bottom side of the liquid crystal layer. Each of the plurality of metal electrodes is electrically isolated from each other and can be individually controlled by the backplane. Each of the plurality of metal electrodes is electrically coupled one-to-one to a corresponding circuit in the plurality of circuits in the backplane via a corresponding conductive via of the conductive via.

[0081] In some embodiments, the plurality of metal electrodes form the irregular pattern, and each of the plurality of metal electrodes corresponds to a corresponding component of the plurality of components.

[0082] In some embodiments, for each of the plurality of metal electrodes, the corresponding conductive via is located at the centroid of the metal electrode.

[0083] In some embodiments, the device includes multiple pairs of metal electrodes and conductive via layers stacked sequentially between the liquid crystal layer and the plurality of circuits along a first direction. In some embodiments, the first conductive vias of the first pair of the multiple pairs are located between the plurality of circuits and the first metal electrodes of the first pair, and are regularly arranged along a second direction perpendicular to the first direction. In some embodiments, the second conductive vias of the second pair of the multiple pairs are located between the first metal electrodes of the first pair and the second metal electrodes of the second pair, and are regularly arranged along the second direction. In some embodiments, adjacent first and second conductive vias are offset from each other along the second direction.

[0084] In some embodiments, the first metal electrodes of the first pair form a first irregular pattern, and the second metal electrodes of the second pair form a second irregular pattern. The irregular pattern is associated with both the first and second irregular patterns.

[0085] In some embodiments, the device further includes: a first alignment layer on top of the liquid crystal layer; a second alignment layer below the liquid crystal layer; and a spacer. The liquid crystal layer is located between the first alignment layer and the second alignment layer, and the first alignment layer and the second alignment layer are separated by the spacer to maintain the thickness of the liquid crystal layer.

[0086] In some embodiments, each of the plurality of metal electrodes is configured to reflect light through the liquid crystal layer.

[0087] Another aspect of this disclosure relates to a display, including: a back panel; and a plurality of display components disposed on the back panel, the plurality of display components forming an irregular pattern.

[0088] In some embodiments, the irregular pattern includes a Voronoi pattern. In some embodiments, at least one of the plurality of display components has an irregular polygonal shape. In some embodiments, adjacent display components of the plurality of display components have different shapes.

[0089] In some implementations, the gap between adjacent display components of the plurality of display components is smaller than the wavelength of the incident light.

[0090] In some implementations, the size distribution of the plurality of display components is near the same value as the spatial frequency response of the display.

[0091] In some embodiments, the device includes: a liquid crystal layer; a transparent conductive layer serving as a common electrode on the top side of the liquid crystal layer; and a plurality of metal electrodes on the bottom side of the liquid crystal layer.

[0092] In some embodiments, each of the plurality of metal electrodes is electrically isolated from each other and can be individually controlled by the backplane. The plurality of metal electrodes may have the irregular pattern.

[0093] In some embodiments, the backplane includes a plurality of circuits, and each of the plurality of metal electrodes is electrically coupled one-to-one to a corresponding circuit in the plurality of circuits in the backplane via a corresponding conductive via. In some embodiments, two or more conductive vias are conductively coupled to corresponding circuits in the plurality of circuits in the backplane. In some embodiments, at least one of the plurality of metal electrodes is conductively coupled to the corresponding circuit in the plurality of circuits in the backplane via two or more corresponding conductive vias, wherein the two or more corresponding conductive vias are conductively coupled to the corresponding circuits in the plurality of circuits in the backplane. In some embodiments, the corresponding conductive vias coupled between the plurality of metal electrodes and the plurality of circuits are regularly arranged.

[0094] In some embodiments, the device further includes: a first alignment layer beneath the liquid crystal layer; a second alignment layer on top of the liquid crystal layer; and a spacer. The liquid crystal layer lies between the first alignment layer and the second alignment layer, and the first alignment layer and the second alignment layer are separated by the spacer to maintain the thickness of the liquid crystal layer.

[0095] In some embodiments, each of the plurality of metal electrodes is configured to reflect light through the liquid crystal layer.

[0096] Another aspect of this disclosure relates to a method comprising: generating, by at least one processor, a plurality of shapes based on a plurality of points irregularly located in a region of a display, each of the plurality of shapes uniquely surrounding a corresponding point of the plurality of points; and generating, by the at least one processor, a profile of the display based on the plurality of shapes, the display comprising a plurality of display components each corresponding to a corresponding shape of the plurality of shapes.

[0097] Another aspect of this disclosure relates to a method comprising: determining, by at least one processor, a plurality of points irregularly located in a region of a display; generating, by the at least one processor, a plurality of shapes based on the plurality of points according to an irregular pattern, each of the plurality of shapes uniquely surrounding a corresponding point of the plurality of points; and generating, by the at least one processor, a profile of the display according to the plurality of shapes, the display comprising a plurality of display components, each corresponding to a corresponding shape of the plurality of shapes.

[0098] In some implementations, the irregular pattern includes a Voronoi pattern.

[0099] In some implementations, determining the plurality of points irregularly located in the region of the display includes: determining a plurality of spaced points in the region of the display; and adding different offsets to the plurality of spaced points to generate the plurality of points irregularly located in the region of the display.

[0100] In some embodiments, the method further includes determining the different offsets based on a Poisson noise distribution. In some embodiments, the plurality of spacers define a regularly arranged pattern. In some embodiments, a first spacer in a first region of the region has a first spacer period, and a second spacer in a second region of the region has a second spacer period that may be different from the first spacer period. In some embodiments, at least one of the different offsets is equal to or greater than half the distance between adjacent spacers.

[0101] In some embodiments, the method further includes: storing the different offsets in a storage library; and associating the different offsets with the plurality of interval points in the storage library.

[0102] Another aspect of this disclosure relates to a method of manufacturing an irregular display, comprising: manufacturing the irregular display according to a configuration file of the irregular display, the configuration file of the irregular display including information on a plurality of shapes, wherein the information on each shape corresponds to a corresponding display component of a plurality of display components of the irregular display, the plurality of shapes forming an irregular pattern.

[0103] Another aspect of this disclosure relates to a method for manufacturing an irregular display, comprising: obtaining a profile of the irregular display, the irregular display including a plurality of display components, wherein each display component corresponds to a corresponding shape of a plurality of shapes forming an irregular pattern; and manufacturing the irregular display according to the profile of the irregular display.

[0104] In some embodiments, manufacturing the irregular display according to the profile of the irregular display includes forming a plurality of metal electrodes corresponding to the plurality of shapes, the plurality of metal electrodes having the irregular pattern.

[0105] In some embodiments, manufacturing the irregular display according to the profile of the irregular display includes: forming a plurality of circuits on a substrate; forming a plurality of conductive vias on top of the plurality of circuits, wherein each of the plurality of conductive vias is conductively coupled to a corresponding circuit in the plurality of circuits; forming a metal layer on top of the plurality of conductive vias; and patterning the metal layer according to the irregular pattern to obtain the plurality of metal electrodes.

[0106] In some embodiments, the plurality of conductive vias are regularly arranged on top of the plurality of circuits. In some embodiments, first conductive vias in a first region are regularly arranged at a first interval, and second conductive vias in a second region are regularly arranged at a second interval different from the first interval. In some embodiments, at least two pairs of adjacent conductive vias have different spaces. In some embodiments, the metal layer is configured as a reflector.

[0107] In some embodiments, manufacturing the irregular display according to the profile of the irregular display includes: forming a first alignment layer on top of the plurality of metal electrodes; forming a plurality of separate spacers on the first alignment layer; forming a liquid crystal layer on the first alignment layer; forming a second alignment layer on top of the liquid crystal layer and the plurality of separate spacers; and forming a transparent conductive layer as a common electrode on top of the second alignment layer.

[0108] Another aspect of this disclosure relates to a method comprising: generating, by at least one processor, a plurality of shapes based on a plurality of points irregularly located in a region of a device, each of the plurality of shapes uniquely surrounding a corresponding point of the plurality of points; and generating, by the at least one processor, a profile of the device based on the plurality of shapes, the device comprising a plurality of components, wherein each component corresponds to a corresponding shape of the plurality of shapes.

[0109] In some implementations, the irregular pattern includes a Voronoi pattern.

[0110] In some implementations, the method further includes determining the plurality of points irregularly located in the region of the device by determining a plurality of interval points in the region of the device; and adding different offsets to the plurality of interval points to generate the plurality of points irregularly located in the region of the device.

[0111] In some implementations, the method further includes determining the different offsets based on a Poisson noise distribution.

[0112] In some implementations, the plurality of spaced points define a regularly arranged pattern.

[0113] In some embodiments, the method further includes storing the different offsets in a storage library and associating the different offsets with the plurality of interval points in the storage library.

[0114] Another aspect of this disclosure relates to a method of manufacturing an irregular device, comprising: manufacturing the irregular device according to a configuration file of the irregular device, the configuration file of the irregular device including information on a plurality of shapes, wherein the information on each shape corresponds to a corresponding component of a plurality of components of the irregular device, the plurality of shapes forming an irregular pattern.

[0115] In some embodiments, manufacturing the irregular device according to the configuration file of the irregular device includes forming a plurality of metal electrodes corresponding to the plurality of shapes, the plurality of metal electrodes having the irregular pattern.

[0116] In some embodiments, manufacturing the irregular device according to the configuration file of the irregular device includes: forming a plurality of circuits on a substrate; forming a plurality of conductive vias on top of the plurality of circuits, wherein each of the plurality of conductive vias is conductively coupled to a corresponding circuit in the plurality of circuits; forming a metal layer on top of the plurality of conductive vias; and patterning the metal layer according to the irregular pattern to obtain the plurality of metal electrodes.

[0117] In some implementations, the plurality of conductive vias are arranged regularly on top of the plurality of circuits.

[0118] In some embodiments, at least two pairs of adjacent conductive vias have different spacing.

[0119] In some implementations, the metal layer is configured as a reflector.

[0120] In some embodiments, manufacturing the irregular device according to the configuration file of the irregular device includes: forming a first alignment layer on top of the plurality of metal electrodes; forming a plurality of individual spacers on the first alignment layer; forming a liquid crystal layer on the first alignment layer; forming a second alignment layer on top of the liquid crystal layer and the plurality of individual spacers; and forming a transparent conductive layer as a common electrode on top of the second alignment layer.

[0121] Another aspect of this disclosure relates to a system including a display and a controller. The display includes a backplane comprising a plurality of circuits and a plurality of display components disposed on the backplane. The plurality of display components are formed in an irregular pattern and are coupled to the plurality of circuits through regularly arranged conductive vias. The controller is coupled to the display and configured to transmit at least one control signal to at least one display component of the display for modulating at least one characteristic of the at least one display component.

[0122] In some implementations, the controller includes at least one of the following: application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), programmable gate array (PGA), central processing unit (CPU), graphics processing unit (GPU), phase unit processing unit (PPU), or standard computing unit.

[0123] In some embodiments, the controller is configured to: for each of a plurality of primitives corresponding to at least one object, determine the EM field contribution of each of the plurality of display components to the display by calculating the electromagnetic (EM) field propagation from that primitive to the display component in a three-dimensional (3D) coordinate system; and for each of the plurality of display components, generate a sum of the EM field contributions from each of the plurality of primitives to the display component. The at least one control signal corresponds to the corresponding sum of the EM field contributions from each of the plurality of primitives to the at least one display component.

[0124] In some implementations, each of the plurality of display components is associated with a corresponding interval point and a corresponding offset associated with the plurality of interval points. The controller is configured to: for each of the plurality of display components, obtain the position of the corresponding interval point and the corresponding offset associated with the corresponding interval point; and calculate the EM field propagation from the primitive to the display component based on the position of the corresponding interval point and the corresponding offset associated with the corresponding interval point. The corresponding offset represents the distance between the corresponding interval point and the seed point of the display component.

[0125] In some embodiments, the controller is configured to sequentially modulate the display with information associated with a first color during a first time period and with information associated with a second color during a second, sequential time period. The controller is also configured to control an illuminator to sequentially activate a first light-emitting component to emit light of the first color during the first time period and to activate a second light-emitting component to emit light of the second color during the second, sequential time period.

[0126] Another aspect of this disclosure relates to a system comprising: a display and a controller. The display includes: a back panel and a plurality of display components disposed on the back panel, the plurality of display components forming an irregular pattern. The controller is coupled to the display and configured to transmit at least one control signal to at least one display component of the display for modulating at least one characteristic of the at least one display component.

[0127] In some implementations, the controller includes at least one of the following: application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), programmable gate array (PGA), central processing unit (CPU), graphics processing unit (GPU), phase unit processing unit (PPU), or standard computing unit.

[0128] In some embodiments, the controller is configured to: for each of a plurality of primitives corresponding to at least one object, determine the EM field contribution of each of the plurality of display components to the display by calculating the electromagnetic (EM) field propagation from the primitive to the display component in a three-dimensional (3D) coordinate system; and for each of the plurality of display components, generate a sum of the EM field contributions from each of the plurality of primitives to the display component, wherein the at least one control signal corresponds to a corresponding sum of the EM field contributions from each of the plurality of primitives to the at least one display component.

[0129] In some implementations, each of the plurality of display components is associated with a corresponding regular display component having a regular shape. The controller is configured to: for each of the plurality of display components, obtain the position of the center point of the corresponding regular display component and the offset associated with the center point of the corresponding regular display component; and calculate the EM field propagation from the primitive to the display component based on the position of the center point and the offset associated with the center point, wherein the offset represents the distance between the center point of the corresponding regular display component and the seed point of the display component.

[0130] In some implementations, each of the plurality of display components is associated with a corresponding interval point of the plurality of interval points and a corresponding offset associated with that interval point. The controller is configured to: for each of the plurality of display components, obtain the position of the corresponding interval point and the corresponding offset associated with that interval point; and calculate the EM field propagation from the primitive to the display component based on the position of the corresponding interval point and the corresponding offset associated with that interval point, wherein the corresponding offset represents the distance between the corresponding interval point and the seed point of the display component. The shape of the display component may be generated based on the seed point of the display component and an irregular pattern. The plurality of interval points may be the center points of the plurality of display components of a regular display.

[0131] In some embodiments, the controller is configured to modulate the display with information associated with a first color during a first time period and with information associated with a second color during a second, sequential time period, and the controller is configured to control the illuminator to sequentially turn on a first light-emitting component to emit light of the first color during the first time period and to turn on a second light-emitting component to emit light of the second color during the second, sequential time period.

[0132] Another aspect of this disclosure relates to a system comprising: a display including a plurality of display components; and a driving device as described above, wherein the driving device is configured to perform the method as described above.

[0133] In some embodiments, the system further includes a processing device as described above, and the processing device is configured to perform the method as described above.

[0134] Another aspect of this disclosure relates to a system comprising: a display including a plurality of display components; and a driving device coupled to the display and configured to: acquire a hologram for the display, wherein, for each of the plurality of display components, the hologram includes a sum of corresponding contributions of a plurality of primitives to the electromagnetic (EM) field of the display component corresponding to at least one object; generate a corresponding modulation control signal for each of the plurality of display components based on the sum of the corresponding contributions of the plurality of primitives to the display component; and output the corresponding modulation control signal to each of the plurality of display components for modulating the display component.

[0135] In some embodiments, the driving device includes: a memory configured to store the hologram; and a display driver coupled to the memory and the display.

[0136] In some embodiments, the system further includes: a processing device coupled to the driving device and configured to: acquire information of the plurality of primitives corresponding to the at least one object, wherein the information includes a corresponding primitive identifier of the plurality of primitives; acquire primitive data of the plurality of primitives based on the information of the plurality of primitives; for each of the plurality of primitives, determine an electromagnetic (EM) field contribution to each of the plurality of display components of the display based on the primitive data of the primitive; and for each of the plurality of display components of the display, generate a sum of the EM field contributions of the plurality of primitives to the display component.

[0137] In some embodiments, the processing apparatus includes: a command processor configured to: receive a command from a computing device, the command including information of the plurality of primitives corresponding to the at least one object, and process the command to obtain primitive data of the plurality of primitives from the computing device based on the information of the plurality of primitives; a plurality of computing units configured to calculate an electromagnetic (EM) field contribution of each of the plurality of primitives to each of the plurality of display components based on the primitive data of the plurality of primitives; and an accumulator configured to: accumulate the EM field contributions of the plurality of primitives to each of the plurality of display components, and generate the hologram including a corresponding sum of the EM field contributions of the plurality of primitives to each of the plurality of display components.

[0138] In some embodiments, the driving device and the processing device are integrated in a package as a controller for the display. In some embodiments, the controller is integrated with the display.

[0139] In some embodiments, the system further includes a illuminator, wherein the driving device includes an illuminator driver for the illuminator. In some embodiments, the controller, the illuminator, and the display are integrated in a package.

[0140] In some embodiments, the system further includes a computing device configured to perform the corresponding methods described above. The processing device is configured to be integrated with the computing device. In some embodiments, the processing device can be inserted into a PCIe slot of the computing device.

[0141] In some implementations, the computing device is configured to: generate scene data using a 3D simulation application running on the computing device, wherein the scene data includes information on a plurality of primitives corresponding to at least one object; and generate primitive data corresponding to the plurality of primitives of the at least one object based on the scene data using an application programming interface (API).

[0142] In some implementations, the API is configured to adjust the initial primitive data of the plurality of primitives generated based on the scenario data to generate the primitive data of the plurality of primitives, and the API is configured to execute the corresponding method as described above.

[0143] In some implementations, the display is an irregular display, and the plurality of display components form an irregular pattern.

[0144] In some embodiments, the system further includes an optical device adjacent to the display, wherein the optical device includes a substrate and an optical diffraction component disposed on the substrate and configured to diffract light to the display. In some embodiments, the optical diffraction component includes a diffraction grating having a specific diffraction efficiency for the light, the diffraction efficiency being lower than a predetermined threshold. In some embodiments, the predetermined threshold is 20%, 15%, or 10%. In some embodiments, the holographic grating comprises a photopolymer material or a silver halide material.

[0145] In some embodiments, the system further includes a polarization controller disposed between the optical device and the display. The polarization controller is configured to give the light from the optical device to be incident on the display an S-polarization state, and to give the returning light from the display to be incident on the optical device a P-polarization state or an intermediate state between the S-polarization state and the P-polarization state. In some embodiments, the polarization controller includes a Faraday rotator.

[0146] In some embodiments, the optical diffraction component is configured such that when multiple different colors of light are incident on the optical diffraction component, the optical diffraction component separates or combines the individual colors of light while suppressing crosstalk between the different colors.

[0147] In some embodiments, the optical diffraction assembly includes: at least one optical diffraction device; and at least one of one or more color-selective polarizers or one or more reflective layers or one or more transmissive layers.

[0148] In some embodiments, the optical device further includes an optical redirection component disposed on the substrate. The display is configured to diffract a portion of the light illuminating one or more display components, and the optical redirection component is configured to transmit the diffracted portion of the light to form a holographic scene and redirect the zero-order light of the display away from the holographic scene in three-dimensional (3D) space, the zero-order light of the display including reflected light from the display.

[0149] In some embodiments, the optical diffraction component is disposed on a first side of the substrate facing the display surface of the display, and the optical redirection component is disposed on a second side of the substrate opposite to the first side of the substrate.

[0150] In some embodiments, the system further includes: an illuminator disposed adjacent to the optical device and configured to provide light of multiple different colors to the optical device, wherein the illuminator includes a plurality of light-emitting components, each light-emitting component being configured to emit light of a corresponding color; and a coupling device disposed between the illuminator and the optical device and configured to receive the multiple different colors of light from the illuminator and output the multiple different colors of light to the optical device.

[0151] In some embodiments, the coupling device includes: a prism assembly disposed between the illuminator and the optical device and configured to receive the multiple different colors of light from the input surface of the prism assembly; one or more extended gratings adjacent to the exit surface of the prism assembly, each of the one or more extended gratings being configured to extend the beam profile of the light of different corresponding colors by a factor in at least one dimension; and one or more reflectors downstream of the one or more extended gratings, each of the one or more reflectors being configured to reflect light of the corresponding color into the optical diffraction assembly, wherein the tilt angle of each of the one or more reflectors can be independently adjusted to achieve diffraction uniformity from the optical device to the display.

[0152] In some embodiments, the optical device is disposed facing the display surface along a direction perpendicular to the display surface. In some embodiments, the coupling device is configured to couple multiple colors of light from a side surface of the coupling device into the optical diffraction component. In some embodiments, the coupling device is configured to couple multiple colors of light from a bottom surface or a top surface of the coupling device into the optical diffraction component.

[0153] In some embodiments, the system includes a plurality of optical devices, including at least one first optical device configured to produce positive optical dispersion of light incident on the display, and at least one second optical device configured to produce negative optical dispersion of the light, the light having a spectral bandwidth and a peak wavelength. The positive and negative optical dispersions can compensate for each other, such that the holographic scene reconstructed from the light has little or no optical dispersion.

[0154] In some embodiments, the at least one first optical device includes a first diffraction grating, and the at least one second optical device includes a second diffraction grating. In some embodiments, the first diffraction grating and the second diffraction grating are configured to produce the same amount of dispersion in the light. In some embodiments, the system is configured to cause the light to undergo an odd number of reflections between the first diffraction grating and the second diffraction grating, and the first diffraction grating and the second diffraction grating are configured to produce the same amount of dispersion in the light. In some embodiments, the system is configured to cause the light to undergo an even number of reflections between the first diffraction grating and the second diffraction grating, and the first diffraction grating and the second diffraction grating are configured to produce opposite amounts of dispersion in the light.

[0155] In some embodiments, the positive optical dispersion generated by the at least one first optical device has a first dispersion value, and the negative optical dispersion generated by the at least one second optical device has a second dispersion value, and the ratio of the first dispersion value to the second dispersion value is different from 1.

[0156] In some embodiments, the at least one second optical device is disposed downstream of the at least one first optical device along the light path of the light to be incident on the display, wherein the system is configured to change the beam width of the light from the at least one first optical device to the at least one second optical device by a width multiple in one dimension, and wherein the width multiple is the same as the magnitude ratio.

[0157] In some embodiments, the system is configured to change the beam width of the light from the at least one first optics to the at least one second optics by a first width multiple in a first dimension and by a second width multiple in a second dimension other than the first dimension, wherein each of the first width multiple and the second width multiple is the same as the magnitude ratio.

[0158] In some embodiments, the at least one first optical element is disposed downstream of the at least one second optical element along the light path of the light to be incident on the display, and the system is configured to change the beam width of the light from the at least one second optical element to the at least one first optical element by a width multiple in one dimension, and the width multiple is the same as the reciprocal of the magnitude ratio.

[0159] In some embodiments, the system is configured to change the beam width of the light from the at least one second optics to the at least one first optics by a first width multiple in a first dimension and by a second width multiple in a second dimension different from the first dimension, wherein each of the first width multiple and the second width multiple is the reciprocal of the magnitude ratio.

[0160] In some embodiments, the plurality of optical devices includes at least one third optical device configured to cause optical dispersion of the light, and the at least one first optical device, the at least one second optical device, and the at least one third optical device are configured to compensate for the optical dispersion of the light, respectively.

[0161] In some embodiments, the plurality of optical devices includes: a first optical device configured for optical dispersion compensation of light of a first color, and a second optical device configured for optical dispersion compensation of light of a second color, which is different from the first color of light.

[0162] In some embodiments, the plurality of optical devices includes: a first set of optical devices each configured to cause a first optical dispersion of a corresponding color of light of the plurality of colors, and a second set of optical devices each configured to cause a second optical dispersion of a corresponding color of light of the plurality of colors, wherein the first set of optical devices and the second set of optical devices are configured to compensate for the optical dispersion of each of the plurality of colors of light.

[0163] In some embodiments, at least one of the first set of optical devices and the second set of optical devices includes a series of holographic gratings made of the same material. In some embodiments, the plurality of optical devices are configured to compensate for the optical dispersion of light of a first color having a first spectral width, without compensating for light of a second color having a second spectral width narrower than the first spectral width.

[0164] Another aspect of this disclosure relates to a method comprising: recording a diffraction grating in a recording material by irradiating an object beam and a reference beam having a mismatched polarization state into the recording material.

[0165] Another aspect of this disclosure relates to a method comprising: forming a recording material on a substrate; and irradiating an object beam and a reference beam into the recording material to record a diffraction grating in the recording material, wherein the object beam and the reference beam have mismatched polarization states.

[0166] In some embodiments, the diffraction grating has a diffraction efficiency below a predetermined threshold. In some embodiments, the predetermined threshold is 10%, 15%, or 20%.

[0167] In some embodiments, one of the object beam and the reference beam has one of an S-polarization state and a P-polarization state, and the other of the object beam and the reference beam has an intermediate polarization state between the S-polarization state and the P-polarization state.

[0168] In some embodiments, one of the object beam and the reference beam has a first intermediate polarization state between an S-polarization state and a P-polarization state, and the other of the object beam and the reference beam has a second intermediate polarization state between an S-polarization state and a P-polarization state, wherein the second intermediate polarization state is different from the first intermediate polarization state. In some embodiments, each of the object beam and the reference beam has a P-polarization state.

[0169] In some embodiments, the method further includes: measuring the diffraction efficiency of the diffraction grating; and adjusting the polarization state of at least one of the object beam or the reference beam based on the measured diffraction efficiency. In some embodiments, adjusting the polarization state of at least one of the object beam or the reference beam based on the measured diffraction efficiency includes: in response to determining that the measured diffraction efficiency is higher than a predetermined threshold, adjusting the polarization state of at least one of the object beam and the reference beam to increase the mismatch between the polarization states of the object beam and the reference beam. In some embodiments, adjusting the polarization state of at least one of the object beam and the reference beam to increase the mismatch between the polarization states of the object beam and the reference beam includes: adjusting the polarization state of at least one of the object beam and the reference beam to be closer to a P-polarization state than an S-polarization state.

[0170] In some embodiments, the beam angle between the object beam and the reference beam is in the range of 70° to 80°. In some embodiments, the beam ratio between the object beam and the reference beam is in the range of 1 to 30.

[0171] In some embodiments, the method further includes: measuring the diffraction efficiency of the diffraction grating; and adjusting the beam ratio between the object beam and the reference beam based on the measured diffraction efficiency.

[0172] In some embodiments, adjusting the beam ratio between the object beam and the reference beam based on the measured diffraction efficiency includes: increasing the beam ratio between the object beam and the reference beam in response to determining that the measured diffraction efficiency is higher than a predetermined threshold.

[0173] In some embodiments, the method further includes inducing movement in at least one of the object beam and the reference beam during recording the diffraction grating.

[0174] In some embodiments, the recording material includes photopolymer materials or silver halide materials.

[0175] Another aspect of this disclosure relates to a method comprising: adjusting primitive data corresponding to a plurality of primitives of an object by means of at least one processor to generate gaps between adjacent primitives of the plurality of primitives.

[0176] In some implementations, the gap is not less than a predetermined value for at least one pair of adjacent primitives. In some implementations, prior to this adjustment, the adjacent primitives are in contact and have at least one shared edge.

[0177] In some implementations, adjusting the primitive data corresponding to the plurality of primitives of the object to generate the gap between the adjacent primitives of the plurality of primitives includes: for each of the adjacent primitives, causing the primitive to shrink towards the center of the primitive by half the distance of the gap.

[0178] In some implementations, the coordinate information of the center of the primitive in a three-dimensional (3D) coordinate system remains unchanged, and the vertical distance between the edge of the primitive and the center of the primitive is reduced to half of the gap.

[0179] In some implementations, the coordinate information of the center of the primitive in the 3D coordinate system remains unchanged, and the coordinate data of the vertices defining the primitive are adjusted relative to the center of the primitive to generate the gap.

[0180] In some implementations, adjusting the primitive data corresponding to the plurality of primitives of the object to generate the gap between the adjacent primitives of the plurality of primitives includes: scaling the shared edge of the first primitive adjacent to the second primitive; and updating the corresponding primitive data of the first primitive based on the scaling result.

[0181] In some implementations, scaling the shared edge of the first primitive adjacent to the second primitive includes moving two vertices of the shared edge of the first primitive toward at least one adjacent vertex of the first primitive.

[0182] In some implementations, the first primitive has only one adjacent primitive that serves as the second primitive, and one or more other edges of the first primitive remain unscaled.

[0183] In some embodiments, the method further includes: receiving an input for generating the gap among the plurality of primitives, wherein, in response to receiving the input, the primitive data corresponding to the plurality of primitives of the object is adjusted to generate the gap between the adjacent primitives of the plurality of primitives.

[0184] In some implementations, at least one of the plurality of primitives includes a triangular primitive or a polygonal primitive.

[0185] In some implementations, the primitive data of a primitive includes at least one of the following: the texture information of the primitive, the viewpoint-dependent shading information of the primitive, the color information of the primitive, or the coordinate information of the primitive in a 3D coordinate system.

[0186] In some implementations, the method further includes: generating primitive data of the plurality of primitives by the at least one processor based on scene data of the object, the scene data including information of the plurality of primitives.

[0187] In some implementations, the method further includes generating scene data of the object using a 3D simulation application via the at least one processor.

[0188] Another aspect of this disclosure relates to a non-transitory, computer-readable medium storing one or more instructions executable by at least one processor to perform the methods described above.

[0189] Another aspect of this disclosure relates to a method comprising: generating control signals for a plurality of display components for a display based on primitive data corresponding to a plurality of primitives of at least one object, wherein the primitive data indicates the gap between adjacent primitives of the plurality of primitives.

[0190] Another aspect of this disclosure relates to a method comprising: acquiring primitive data corresponding to a plurality of primitives of an object, wherein the primitive data indicates the gap between adjacent primitives of the plurality of primitives; for each of the plurality of primitives, determining an EM field contribution to the display component by calculating electromagnetic (EM) field propagation from the primitive to the display component in a three-dimensional (3D) coordinate system using the primitive data of the primitive and coordinate data of each of a plurality of display components of the display; and for each of the plurality of display components, generating a sum of the EM field contributions from each of the plurality of primitives to the display component.

[0191] In some embodiments, the method further includes transmitting corresponding control signals to each of the plurality of display components of the display to modulate at least one characteristic of the display component based on the sum of the EM field contributions of the display component.

[0192] In some embodiments, the method further includes: irradiating light onto a modulation display component of the display to form a volume light field in a three-dimensional (3D) space, the volume light field corresponding to a reconstruction of the object, wherein the reconstruction of the object includes reconstructed adjacent primitives corresponding to the adjacent primitives having the gap.

[0193] In some embodiments, the gap is configured such that the reconstructed adjacent primitives are distinguishable from each other. In some embodiments, the gap is configured to be small enough that the reconstructed adjacent primitives appear seamless. In some embodiments, the gap is configured such that there is no overlap between the reconstructed adjacent primitives.

[0194] In some embodiments, the gap is configured to be equal to or greater than a preset diffraction limit of the display. In some embodiments, the ratio between the gap and the preset diffraction limit of the display is in the range of 1 to 10. In some embodiments, the ratio is in the range of 3 to 5.

[0195] In some embodiments, the preset diffraction limit of the display conforms to the Rayleigh criterion. In some embodiments, the preset diffraction limit of the display is determined based on the size of the display components and the wavelength of the light incident on the display.

[0196] In some implementations, the preset diffraction limit of the display is expressed as: , in res This indicates the preset diffraction limit of the display. This represents the wavelength of light in the air, and This indicates the output angle from the surface of the display.

[0197] In some embodiments, the display includes a cover on top of the plurality of display components of the display, and the output angle Expressed as: ,and , in θ i This indicates the angle of incidence at the interface between the cover and the surrounding medium. n i and n o This indicates the refractive index of the material of the cover and the refractive index of the surrounding medium. This indicates the wavelength of light in the material of the cover, and This indicates the display component cycle of the monitor.

[0198] In some embodiments, the display component period of the display is one of a period along a first direction of the display component or a period along a second direction of the display component perpendicular to the first direction.

[0199] Another aspect of this disclosure relates to a method comprising: acquiring primitive data corresponding to a plurality of primitives of an object, wherein the primitive data indicates the gap between adjacent primitives of the plurality of primitives; generating control signals for a plurality of display components of a display using the primitive data of the plurality of primitives; and transmitting the control signals to the display to modulate the plurality of display components of the display based on the control signals.

[0200] In some embodiments, the method further includes transmitting a timing control signal to an illumination source to illuminate a modulation display component of the display to form a volume light field in a three-dimensional (3D) space corresponding to a reconstruction of the object, wherein the reconstruction of the object includes reconstructed adjacent primitives corresponding to the adjacent primitives having the gap, and wherein the gap is configured to make the reconstructed adjacent primitives distinguishable from each other.

[0201] Another aspect of this disclosure relates to a non-transitory, computer-readable medium storing one or more instructions executable by at least one processor to perform the methods described above.

[0202] Another aspect of this disclosure relates to a method comprising: acquiring primitive data corresponding to a plurality of primitives of an object; adjusting the primitive data of the plurality of primitives to generate a gap between adjacent primitives of the plurality of primitives; generating control signals for a plurality of display components of a display using the adjusted primitive data of the plurality of primitives; modulating the plurality of display components of the display based on the control signals; and irradiating light onto the modulated display components of the display to form a volume light field in a three-dimensional (3D) space, the volume light field corresponding to a reconstruction of the object. The reconstruction of the object includes reconstructed adjacent primitives corresponding to the adjacent primitives having the gap, and the gap is configured such that the reconstructed adjacent primitives are distinguishable from each other.

[0203] In some implementations, the gap is configured to be small enough to make the reconstructed adjacent primitives appear seamless and large enough to prevent overlap between the reconstructed adjacent primitives.

[0204] In some embodiments, generating the control signal for the plurality of display components using the adjusted primitive data of the plurality of primitives includes: for each of the plurality of primitives, calculating the electromagnetic (EM) field propagation from the primitive to the display component in a three-dimensional (3D) coordinate system using the adjusted primitive data of the primitive and the coordinate data of each of the plurality of display components of the display to determine the EM field contribution to the display component; and for each of the plurality of display components, generating a sum of the EM field contributions from each of the plurality of primitives to the display component; and generating a corresponding control signal based on the sum of the EM field contributions to the display component.

[0205] In some implementations, the method further includes: generating scene data of the object using a 3D simulation application; and generating primitive data of the plurality of primitives based on the scene data of the object, the scene data including information of the plurality of primitives.

[0206] In some implementations, the gap is configured to be equal to or greater than the preset diffraction limit of the display as determined by the Rayleigh criterion.

[0207] Another aspect of this disclosure relates to a method comprising: adjusting primitive data corresponding to a plurality of primitives of an object by means of at least one processor to generate an overlap between adjacent primitives of the plurality of primitives.

[0208] In some implementations, adjusting the primitive data of the plurality of primitives to generate the overlap between the adjacent primitives includes: for each of the adjacent primitives, scaling the primitive away from its center.

[0209] In some implementations, the coordinate data of the center of the primitive in the 3D coordinate system remains unchanged, and the coordinate data of the vertices defining the primitive are adjusted relative to the center of the primitive to generate the overlap.

[0210] In some implementations, adjusting the primitive data of the plurality of primitives to generate the overlap between the adjacent primitives includes: for each of the adjacent primitives, moving a first primitive relative to a second primitive adjacent to the first primitive to generate the overlap.

[0211] In some embodiments, the method further includes: receiving input for generating the overlap among the plurality of primitives, wherein, in response to receiving the input, the primitive data of the plurality of primitives is adjusted to generate the overlap between the adjacent primitives of the plurality of primitives.

[0212] Another aspect of this disclosure relates to a method comprising: generating control signals for a plurality of display components of a display based on primitive data corresponding to a plurality of primitives of at least one object, wherein the primitive data indicates overlap between adjacent primitives of the plurality of primitives.

[0213] Another aspect of this disclosure relates to a method comprising: acquiring primitive data corresponding to a plurality of primitives of an object, wherein the primitive data indicates overlap between adjacent primitives of the plurality of primitives; generating control signals for a plurality of display components of a display using the primitive data of the plurality of primitives; and transmitting the control signals to the display to modulate the plurality of display components of the display based on the control signals.

[0214] In some embodiments, the method further includes transmitting a timing control signal to an illumination source to illuminate a modulation display component of the display to form a volume light field in a three-dimensional (3D) space, the volume light field corresponding to a reconstruction of the object. The reconstruction of the object includes reconstructed adjacent primitives corresponding to the adjacent primitives having the overlap, and the overlap is configured such that the reconstructed adjacent primitives overlap each other.

[0215] Another aspect of this disclosure relates to a system comprising: a display and a controller coupled to the display. The controller is configured to: acquire primitive data corresponding to a plurality of primitives of an object, wherein the primitive data indicates the gap between adjacent primitives of the plurality of primitives; for each of the plurality of primitives, determine an EM field contribution to the display component by calculating electromagnetic (EM) field propagation from the primitive to the display component in a three-dimensional (3D) coordinate system using the primitive data of the primitive and coordinate data of each of a plurality of display components of the display; and for each of the plurality of display components, generate a sum of the EM field contributions from each of the plurality of primitives to the display component.

[0216] Another aspect of this disclosure relates to a system comprising: a display and a controller coupled to the display. The controller is configured to: acquire primitive data corresponding to a plurality of primitives of an object, wherein the primitive data indicates the gap between adjacent primitives of the plurality of primitives; generate control signals for a plurality of display components of the display using the primitive data of the plurality of primitives; and transmit the control signals to the display to modulate the plurality of display components of the display based on the control signals.

[0217] Another aspect of this disclosure relates to a system comprising: a display and a controller coupled to the display. The controller is configured to: acquire primitive data corresponding to a plurality of primitives of an object, wherein the primitive data indicates overlap between adjacent primitives of the plurality of primitives; generate control signals for a plurality of display components of the display using the primitive data of the plurality of primitives; and transmit the control signals to the display to modulate the plurality of display components of the display based on the control signals.

[0218] In some implementations, the controller is coupled to a computing device. The computing device is configured to: generate scene data using a 3D simulation application, wherein the scene data includes information about the plurality of primitives of the object; and generate primitive data corresponding to the plurality of primitives of the object based on the scene data using an application programming interface (API).

[0219] In some implementations, the API is configured to adjust the initial primitive data of the plurality of primitives generated based on the scenario data to generate the primitive data of the plurality of primitives.

[0220] Another aspect of this disclosure relates to an apparatus comprising: an optical guiding device configured to guide light propagating within the optical guiding device along a first direction, the light having a spectral bandwidth and a peak wavelength; an ingress coupling diffraction structure configured to diffract the light for propagation within the optical guiding device; and one or more outgress coupling diffraction structures disposed downstream of the ingress coupling diffraction structure along the first direction and configured to diffract at least a portion of the light out of the optical guiding device along a second direction different from the first direction. The ingress coupling diffraction structure is configured to induce a first optical dispersion of the light, and at least one of the one or more outgress coupling diffraction structures is configured to induce a second optical dispersion of the light, the first optical dispersion and the second optical dispersion mutually compensating each other such that the light diffracted out of the optical guiding device has little or no optical dispersion.

[0221] In some implementations, the optical guiding device is configured to guide the light via total internal reflection (TIR).

[0222] In some embodiments, the ingress coupling diffraction structure includes a first diffraction grating, and at least one of the one or more outgress coupling diffraction structures includes a second diffraction grating, and the first diffraction grating and the second diffraction grating are configured to produce opposite dispersions of the same magnitude to the light by the first optical dispersion and the second optical dispersion.

[0223] In some embodiments, the first diffraction grating has a first fringe plane with a first fringe tilt angle, and the second diffraction grating has a second fringe plane with a second fringe tilt angle, wherein the first fringe tilt angle and the second fringe tilt angle have the same value and opposite directions, and the first diffraction grating has a first fringe spacing perpendicular to the first fringe plane, and the second diffraction grating has a second fringe spacing perpendicular to the second fringe plane, wherein the first fringe spacing and the second fringe spacing are the same.

[0224] In some embodiments, the light diffracted by the first diffraction grating has a first beam width, and the light diffracted by the second diffraction grating has a second beam width, and the first beam width and the second beam width are the same.

[0225] In some embodiments, the first diffraction efficiency of the first diffraction grating for light having the peak wavelength is greater than the second diffraction efficiency of the second diffraction grating for light having the peak wavelength.

[0226] In some implementations, the first diffraction efficiency is not less than 60%, and the second diffraction efficiency is not greater than 20%.

[0227] In some embodiments, the first diffraction grating is a reflection grating, a transmission grating, or a transmissive-reflective grating, and the second diffraction grating is a reflection grating or a transmission grating.

[0228] In some embodiments, the ingress coupling diffraction structure is disposed in or on the optical guiding device, wherein the one or more outgress coupling diffraction structures include a plurality of outgress coupling diffraction structures disposed in or on the optical guiding device along the first direction.

[0229] In some embodiments, the ingress coupling diffraction structure and the plurality of outgress coupling diffraction structures are disposed on the same side of the optical guiding device.

[0230] In some embodiments, the ingress coupling diffraction structure and the plurality of outgress coupling diffraction structures are disposed on opposite sides of the optical guiding device.

[0231] In some embodiments, the plurality of out-coupled diffraction structures are in contact with or overlap each other along the first direction, wherein the in-coupled diffraction structure is spaced apart from the plurality of out-coupled diffraction structures.

[0232] In some embodiments, along the first direction, the width of the ingress coupling diffraction structure is the same as the width of each of the plurality of outgress coupling diffraction structures.

[0233] In some embodiments, the ingress coupling diffraction structure includes a first diffraction grating, and each of the plurality of outgress coupling diffraction structures includes a corresponding second diffraction grating, and the first diffraction grating and the corresponding second diffraction grating are configured to produce opposite dispersion of the same amount for the light.

[0234] In some embodiments, the corresponding second diffraction grating is configured to give the light the same dispersion in the same magnitude and direction.

[0235] In some embodiments, the plurality of out-coupled diffraction structures include a first out-coupled diffraction structure and a second out-coupled diffraction structure, wherein the second out-coupled diffraction structure is configured to be further away from the in-coupled diffraction structure than the first out-coupled diffraction structure, and the second out-coupled diffraction structure has a higher diffraction efficiency for light having the peak wavelength than the first out-coupled diffraction structure.

[0236] In some embodiments, the first out-coupled diffraction structure is configured to diffract a first portion of the light incident on the first out-coupled diffraction structure out of the optical guiding device, the first diffracted portion of the light having a first optical power; the second out-coupled diffraction structure is configured to diffract a second portion of the light incident on the second out-coupled diffraction structure out of the optical guiding device, the second diffracted portion of the light having a second optical power; and the first portion of the light having a higher optical power than the second portion of the light; and the first output coupling structure and the second output coupling structure are configured such that the second optical power is the same as the first optical power.

[0237] In some embodiments, the portion of the first part of the light that is not diffracted by the first out-coupled diffraction structure propagates along the first direction in the optical guiding device via total internal reflection (TIR) ​​to be incident on the second out-coupled diffraction structure.

[0238] In some embodiments, the diffracted light from the ingress coupling diffraction structure propagates in the optical guiding device along the first direction via total internal reflection to sequentially incident on each of the plurality of outgress coupling diffraction structures along the first direction, and the plurality of outgress coupling diffraction structures are configured to have a diffraction efficiency that gradually increases along the first direction for the light, such that the light diffracted out of the optical guiding device by each of the plurality of outgress coupling diffraction structures has the same optical power.

[0239] In some embodiments, the diffracted light from the ingress coupling diffraction structure is incident on each of the plurality of outgress coupling diffraction structures at the same incident angle, and each of the plurality of outgress coupling diffraction structures is configured such that the diffracted light passing through each of the plurality of outgress coupling diffraction structures has the same diffraction angle.

[0240] In some embodiments, the ingress coupling diffraction structure is configured to receive the light at a first incident angle and diffract the light at a first diffraction angle, wherein the first incident angle is the same as the same diffraction angle.

[0241] In some embodiments, the incident angle is not less than 60°, and the diffraction angle is approximately 0°. In some embodiments, the optical guiding device includes a waveguide or an optical guide.

[0242] In some embodiments, the light includes light of different colors, and the infeed diffraction structure includes a first corresponding diffraction grating for each different color of light, and each of the one or more outfeed diffraction structures includes a second corresponding diffraction grating for each different color of light.

[0243] In some embodiments, the first corresponding diffraction gratings of the different colors of light are recorded in the same first recording medium, or the second corresponding diffraction gratings of the different colors of light are recorded in the same second recording medium, or each of the first corresponding diffraction gratings of the different colors of light is recorded in a corresponding first recording medium, or each of the second corresponding diffraction gratings of the different colors of light is recorded in a corresponding second recording medium.

[0244] In some embodiments, a system includes a display and optical devices. The optical devices include: an optical guiding device configured to guide light propagating within the optical guiding device along a first direction, the light having a spectral bandwidth and a peak wavelength; an ingress coupling diffraction structure configured to diffract the light for propagation within the optical guiding device; and a plurality of outgress coupling diffraction structures disposed downstream of the ingress coupling diffraction structure along the first direction and configured to diffract at least a portion of the light out of the optical guiding device along a second direction different from the first direction. The ingress coupling diffraction structure is configured to induce a first optical dispersion of the light, and each of the plurality of outgress coupling diffraction structures is configured to induce a second optical dispersion of the light, the first optical dispersion and the second optical dispersion compensating for each other such that the light diffracted out of the optical guiding device has little or no optical dispersion.

[0245] In some embodiments, the ingress coupling diffraction structure includes a first diffraction grating, and each of the plurality of outgress coupling diffraction structures includes a corresponding second diffraction grating, and the first diffraction grating and the corresponding second diffraction grating are configured to produce opposite dispersion of the same amount for the light.

[0246] In some embodiments, each of the first diffraction grating and the corresponding second diffraction grating is a reflection grating.

[0247] In some embodiments, the first diffraction grating is a reflection grating or a transmission grating, and the corresponding second diffraction grating is a reflection grating or a transmission grating.

[0248] In some embodiments, the diffracted light from the ingress coupling diffraction structure propagates in the optical guiding device along the first direction via total internal reflection to sequentially incident on each of the plurality of outgress coupling diffraction structures along the first direction, and the plurality of outgress coupling diffraction structures are configured to have a diffraction efficiency that gradually increases along the first direction for the light, such that the light diffracted out of the optical guiding device by each of the plurality of outgress coupling diffraction structures has the same optical power.

[0249] In some embodiments, the plurality of out-coupled diffraction structures are configured such that the diffracted light passing through each of the plurality of out-coupled diffraction structures propagates to illuminate a corresponding portion of the display, the sum of which is not less than the area of ​​the display.

[0250] In some embodiments, the corresponding portion of the display has a width along the first direction and a length along a third direction perpendicular to the first and second directions.

[0251] In some embodiments, the widths of the respective portions of the display are the same.

[0252] In some embodiments, along the first direction, the width of the ingress coupling diffraction structure is the same as the width of each of the plurality of outgress coupling diffraction structures.

[0253] In some embodiments, the input coupling diffraction structure is configured to receive the light at a first incident angle and diffract the light at a first diffraction angle, and each of the plurality of output coupling diffraction structures is configured to receive reflected light from the optical guiding device at a second incident angle and diffract the reflected light at a second diffraction angle, wherein the first incident angle and the second diffraction angle are the same. In some embodiments, the second incident angle is not less than 60°, and wherein the second diffraction angle is approximately 0°.

[0254] In some embodiments, the display includes a plurality of display components extending along the first direction and a third direction perpendicular to the first and second directions. The optical guiding device is a first optical guiding device, the ingress coupling diffraction structure is a first ingress coupling diffraction structure, and the plurality of outgress coupling diffraction structures are a plurality of first outgress coupling diffraction structures. The system further includes: a second optical guiding device extending along the first direction and the third direction; a plurality of second ingress coupling diffraction structures disposed in or on the second optical guiding device along the first direction; and a plurality of sets of second outgress coupling diffraction structures, each set of second outgress coupling diffraction structures being disposed in or on the second optical guiding device along the third direction. For each of the plurality of second ingress coupling diffraction structures, the second ingress coupling diffraction structure is configured to receive first light diffracted from the corresponding first outgress coupling diffraction structure, and diffract the first light to propagate via TIR along the third direction in the second optical guide device to sequentially incident on the corresponding group of second outgress coupling diffraction structures, and each of the corresponding group of second outgress coupling diffraction structures is configured to receive second light reflected from the second optical guide device and diffract the second light from the second optical guide device toward the display along the second direction.

[0255] In some embodiments, the second ingress coupling diffraction structure has a higher diffraction efficiency than the corresponding first outgress coupling diffraction structure and each of the corresponding group of second outgress coupling diffraction structures. The second ingress coupling diffraction structure includes a first diffraction grating, and each of the corresponding group of second outgress coupling diffraction structures includes a corresponding second diffraction grating. The first diffraction grating and the corresponding second diffraction grating are configured to produce opposite dispersion of the same amount for the light.

[0256] In some embodiments, the corresponding group of second out-coupled diffraction structures is configured to have a diffraction efficiency that gradually increases along the third direction for the light, such that the light diffracted from the optical guiding device by each of the corresponding group of second out-coupled diffraction structures toward the display has the same optical power.

[0257] In some embodiments, the first ingress coupling diffraction structure, the plurality of first egress coupling diffraction structures, the plurality of second ingress coupling diffraction structures, and the plurality of sets of second egress coupling diffraction structures are configured such that the diffracted light from each set of the plurality of sets of second egress coupling diffraction structures toward the display along the second direction has uniform optical power.

[0258] In some embodiments, the plurality of sets of second out-coupled diffraction structures are configured such that the diffracted light passing through each set of the plurality of sets of second out-coupled diffraction structures propagates to illuminate a corresponding portion of the display, the sum of which is not less than the area of ​​the display.

[0259] In some embodiments, the corresponding portions of the display have the same size along the first direction and the third direction. In some embodiments, the corresponding portions of the display are identical to each other.

[0260] In some embodiments, the first optical guiding device and the second optical guiding device are integrated into one unit.

[0261] In some embodiments, the system further includes one or more absorbers disposed in or on the end face of the optical guiding device and configured to absorb light propagating out of the optical guiding device.

[0262] In some embodiments, the light includes light of different colors, and the in-coupled diffraction structure includes a corresponding first diffraction grating for each different color of light, and each of the plurality of out-coupled diffraction structures includes a corresponding second diffraction grating for each different color of light.

[0263] In some embodiments, the display includes: a backplane including a plurality of circuits; and a plurality of display components disposed on the backplane, the plurality of display components forming an irregular pattern, wherein each of the plurality of display components is coupled to a corresponding circuit of the plurality of circuits.

[0264] In some embodiments, the system further includes: an illuminator configured to emit the light; and a controller coupled to the display and the illuminator. The controller is configured to: transmit at least one control signal to at least one display component of the display to modulate at least one characteristic of the at least one display component; sequentially modulate the display with information associated with a first color during a first time period and with information associated with a second color during a second, sequential time period; and control the illuminator to sequentially activate a first light-emitting component to emit light of the first color during the first time period and to activate a second light-emitting component to emit light of the second color during the second, sequential time period.

[0265] In some embodiments, an optical device includes: a first optical guiding device configured to guide light to propagate within the first optical guiding device along a first direction via total internal reflection, the light having a spectral bandwidth and a peak wavelength; a first ingress coupling diffraction structure configured to diffract the light to propagate within the first optical guiding device; a plurality of first egress coupling diffraction structures disposed downstream of the first ingress coupling diffraction structure along the first direction and configured to diffract at least a portion of the light out of the first optical guiding device along a second direction different from the first direction; a second optical guiding device extending along the first direction and a third direction perpendicular to the first and second directions; a plurality of second ingress coupling diffraction structures disposed within or on the second optical guiding device along the first direction; and a plurality of sets of second egress coupling diffraction structures disposed within or on the second optical guiding device along the third direction. The first in-coupled diffraction structure is configured to induce a first optical dispersion of the light, and each of the plurality of first out-coupled diffraction structures is configured to induce a second optical dispersion of the light, wherein the first optical dispersion and the second optical dispersion compensate for each other such that the light diffracted out of the first optical guiding device has little or no optical dispersion, and for each of the plurality of second in-coupled diffraction structures, the second in-coupled diffraction structure is configured to receive the first light diffracted from the corresponding first out-coupled diffraction structure and diffract the first light in the second optical guiding device along the first out-coupled diffraction structure. The light propagates in three directions via total internal reflection and is sequentially incident on the corresponding group of second out-coupled diffraction structures. Each of the corresponding group of second out-coupled diffraction structures is configured to receive the second light reflected from the second optical guide device and diffract the second light out of the second optical guide device along the second direction. The second in-coupled diffraction structure and each of the corresponding group of second out-coupled diffraction structures are configured to cause mutually compensating opposite dispersions, such that the light diffracted out of the second optical guide device has no or almost no optical dispersion.

[0266] In some embodiments, the first ingress coupling diffraction structure, the plurality of first egress coupling diffraction structures, the plurality of second ingress coupling diffraction structures, and the plurality of sets of second egress coupling diffraction structures are configured such that the diffracted light from each set of the plurality of sets of second egress coupling diffraction structures toward the display along the second direction has uniform optical power.

[0267] In some embodiments, a method of forming a device includes: providing an optical guiding device configured to guide light propagating within the optical guiding device along a first direction, the light having a spectral bandwidth and a peak wavelength; forming an ingress coupling diffraction structure configured to diffract the light to propagate within the optical guiding device; and forming one or more outgress coupling diffraction structures disposed downstream of the ingress coupling diffraction structure along the first direction and configured to diffract at least a portion of the light out of the optical guiding device along a second direction different from the first direction. The ingress coupling diffraction structure is configured to cause a first optical dispersion of the light, and at least one of the one or more outgress coupling diffraction structures is configured to cause a second optical dispersion of the light, and the first optical dispersion and the second optical dispersion compensate for each other such that the light diffracted out of the optical guiding device has little or no optical dispersion.

[0268] Another aspect of this disclosure relates to a system comprising: an optical device configured to deflect target light toward a target device; a linear polarizer configured to transmit light having a linear polarization state; and an optical retarder configured to alter the polarization state of light passing through the optical retarder, wherein the linear polarizer and the optical retarder are configured to cause ambient light from a first side of the linear polarizer to pass through the linear polarizer and the optical retarder, then incident on the target device, and return from the target device to pass through the optical retarder, so as to be blocked by the linear polarizer from a second side of the linear polarizer, the second side of the linear polarizer being opposite to the first side of the linear polarizer, wherein the optical device, the linear polarizer, and the optical retarder are configured to cause the target light to be incident on the target device and return from the target device, so as to be transmitted through the linear polarizer from the second side of the linear polarizer.

[0269] In some embodiments, the optical device is configured to guide the target light along a first direction and diffract it to the target device along a second direction different from the first direction, and the target light passes through the linear polarizer without passing through the first side of the linear polarizer.

[0270] In some embodiments, the linear polarizer and the optical delayer are configured to cause the ambient light to pass through the linear polarizer once and the optical delayer twice, and the optical device, the linear polarizer and the optical delayer are configured to cause the target light to pass through the optical delayer twice and the linear polarizer once.

[0271] In some embodiments, the linear polarizer and the optical delayer are configured to cause the ambient light incident on the second side of the linear polarizer and the ambient light transmitted from the first side of the linear polarizer to be in opposite polarization states.

[0272] In some embodiments, the optical retarder is configured to perform at least one of the following: changing linearly polarized light passing through the optical retarder to circularly polarized light, or changing circularly polarized light passing through the optical retarder to linearly polarized light.

[0273] In some implementations, the optical retarder includes a quarter-wave plate (QWP).

[0274] In some implementations, the optical retarder includes an achromatic quarter-wave plate (QWP) or a wide-angle quarter-wave plate (QWP).

[0275] In some implementations, the quarter-wave plate is at a transmission angle of 45° relative to the linear polarizer.

[0276] In some embodiments, the target device is configured to deflect the ambient light without changing the polarization state of the ambient light, and to deflect the target light without changing the polarization state of the target light.

[0277] In some embodiments, the intensity of the target light transmitted from the linear polarizer is about half the intensity of the target light deflected from the display.

[0278] In some implementations, the target device is a reflective device.

[0279] In some embodiments, the linear polarizer and the optical retarder are disposed on a first side of the optical device, and the target device is disposed on a second side of the optical device opposite to the first side of the optical device, and the optical retarder is between the linear polarizer and the optical device.

[0280] In some embodiments, the target light is deflected by the optical device with a first polarization state that is the same as the linear polarization state of the linear polarizer. The target light is incident on the linear polarizer from the second side of the linear polarizer with a circular polarization state, and the target light is incident on the target device with the first polarization state and returns from the target device with the first polarization state.

[0281] In some embodiments, the linear polarization state is a first linear polarization state, the ambient light is incident on a first side of the optical retarder with the first linear polarization state, and the optical retarder converts the first linear polarization state of the ambient light into a circular polarization state, the ambient light returns from the target device to a second side of the optical retarder opposite to the first side of the optical retarder with the circular polarization state, and the optical retarder converts the circular polarization state of the ambient light into a second linear polarization state opposite to the first linear polarization state.

[0282] In some embodiments, the first linear polarization state is one of an S-polarization state and a P-polarization state, and the second linear polarization state is the other of an S-polarization state and a P-polarization state.

[0283] In some implementations, the first linear polarization state is an S-polarization state, and the second linear polarization state is a P-polarization state.

[0284] In some embodiments, the linear polarizer is disposed on a first side of the optical device, and the target device is disposed on a second side of the optical device opposite to the first side of the optical device, and the optical retarder is disposed on the second side of the optical device and between the optical device and the target device.

[0285] In some embodiments, the linear polarization state is a first linear polarization state, the target light is deflected by the optical device into a second linear polarization state and incident on a first side of the optical retarder, the second linear polarization state being opposite to the first linear polarization state, and the optical retarder converts the second linear polarization state of the target light into a circular polarization state, the target light is incident on the target device in the circular polarization state, and returns from the target device to a second side of the optical retarder opposite to the first side of the optical retarder in the circular polarization state, and the optical retarder converts the circular polarization state of the target light back into the first linear polarization state, and the target light is incident on the second side of the linear polarizer in the first linear polarization state and transmitted through the linear polarizer.

[0286] In some embodiments, the linear polarization state is a first linear polarization state, the ambient light is incident on a first side of the optical retarder with the first linear polarization state, and the optical retarder converts the first linear polarization state of the ambient light into a circular polarization state, the ambient light returns from the target device to the optical retarder with the circular polarization state, and the optical retarder converts the circular polarization state of the ambient light into a second linear polarization state opposite to the first linear polarization state, and the ambient light is incident on a second side of the linear polarizer with the second linear polarization state and is blocked by the linear polarizer.

[0287] In some embodiments, the first linear polarization state is one of an S-polarization state and a P-polarization state, and the second linear polarization state is the other of an S-polarization state and a P-polarization state. In some embodiments, the first linear polarization state is a P-polarization state, and the second linear polarization state is an S-polarization state.

[0288] In some embodiments, the linear polarizer and the optical retarder are formed on the optical device, and the system further includes an anti-reflection (AR) coating formed on the first side of the linear polarizer.

[0289] In some implementations, the target device includes multiple components that form an irregular pattern.

[0290] In some embodiments, the optical device includes: an optical guiding device configured to guide the target light to propagate within the optical guiding device along a first direction, the light having a spectral bandwidth and a peak wavelength; an ingress coupling diffraction structure configured to diffract the light to propagate within the optical guiding device; and one or more outgress coupling diffraction structures disposed downstream of the ingress coupling diffraction structure along the first direction and configured to diffract at least a portion of the light from the optical guiding device to the target device along a second direction different from the first direction.

[0291] In some embodiments, the ingress coupling diffraction structure is configured to cause a first optical dispersion of the light, and at least one of the one or more outgress coupling diffraction structures is configured to cause a second optical dispersion of the light, and the first optical dispersion and the second optical dispersion compensate for each other such that the light diffracted out of the optical guiding device has little or no optical dispersion.

[0292] In some embodiments, the target light includes light of different colors, and the in-coupled diffraction structure includes a corresponding first diffraction grating for each different color of light, and each of the plurality of out-coupled diffraction structures includes a corresponding second diffraction grating for each different color of light.

[0293] In some embodiments, the linear polarizer and the optical retarder are formed on the same side of the optical device.

[0294] In some embodiments, the linear polarizer and the optical retarder are formed on opposite sides of the optical device.

[0295] In some implementations, the target device includes a display, a light sensor, or a camera.

[0296] In some implementations, the system further includes the target device.

[0297] In some embodiments, the target device is a display, the display including: a backplane including a plurality of circuits; and a plurality of display components disposed on the backplane, the plurality of display components forming an irregular pattern, wherein each of the plurality of display components is coupled to a corresponding circuit of the plurality of circuits.

[0298] In some embodiments, the system further includes: an illuminator configured to emit the target light; and a controller coupled to the display and the illuminator. The controller is configured to: transmit at least one control signal to at least one display component of the display to modulate at least one characteristic of the at least one display component; sequentially modulate the display with information associated with a first color during a first time period and with information associated with a second color during a second, sequential time period; and control the illuminator to sequentially activate a first light-emitting component during the first time period to emit light of the first color and to activate a second light-emitting component during the second, sequential time period to emit light of the second color.

[0299] Another aspect of this disclosure relates to an apparatus comprising: an optical device configured to deflect target light toward the target device, the target light being linearly polarized; a linear polarizer configured to transmit light having a linear polarization state; and an optical retarder configured to change the polarization state of light passing through the optical retarder, wherein the linear polarizer and the optical retarder are configured to cause ambient light to pass through the linear polarizer once and through the optical retarder twice in sequence to be blocked by the linear polarizer, and the optical device, the linear polarizer, and the optical retarder are configured to cause the target light to pass through the optical retarder twice and through the linear polarizer once in sequence, thereby being transmitted through the linear polarizer.

[0300] Another aspect of this disclosure relates to a method comprising: determining, based on a plurality of shapes in a region of a device to be formed, whether the device to be formed is capable of suppressing light of a higher diffraction order relative to a principal order, each of the plurality of shapes uniquely corresponding to a corresponding point of a plurality of points in the region; if the device to be formed is capable of suppressing light of a higher diffraction order, then for each of the plurality of shapes: determining whether a positional relationship between the shape and the corresponding point satisfies one or more conditions, and if the positional relationship between the shape and the corresponding point fails to satisfy the one or more conditions, modifying the shape so that the positional relationship between the modified shape and the corresponding point satisfies the one or more conditions; and generating a profile of the device to be formed based on the shape that satisfies the one or more conditions, the device to be formed including a plurality of components to be formed, each component to be formed corresponding to a corresponding shape of the shape that satisfies the one or more conditions.

[0301] In some embodiments, the method further includes: if the positional relationship between the shape and the corresponding point satisfies one or more conditions, then determining the shape as a shape that satisfies one or more conditions.

[0302] In some embodiments, the method further includes: if the device to be formed cannot suppress light of higher diffraction orders, adjusting one or more parameters used to generate the plurality of shapes to generate a plurality of new shapes in the region of the device based on the plurality of points in the region.

[0303] In some embodiments, the method further includes: generating a plurality of irregularly arranged points in the region based on the plurality of points, each of the plurality of irregularly arranged points corresponding to a corresponding point of the plurality of points; and generating a plurality of shapes in the region of the device to be formed based on the plurality of irregularly arranged points according to an irregular pattern, each of the plurality of shapes uniquely surrounding a corresponding irregularly arranged point of the plurality of irregularly arranged points.

[0304] In some implementations, the plurality of points are regularly arranged in the region, and the plurality of points define a regularly arranged pattern.

[0305] In some implementations, generating the multiple irregularly arranged points in the region based on the multiple points includes adding different offsets to the multiple points to generate the multiple irregularly arranged points.

[0306] In some implementations, the method further includes determining the different offsets based on a Poisson noise distribution.

[0307] In some implementations, determining whether the device to be formed can suppress higher diffraction orders based on the plurality of shapes in the region of the device to be formed includes: performing a discrete Fourier transform on the centroids of the plurality of shapes; and determining whether the device to be formed can suppress higher diffraction orders based on the result of the discrete Fourier transform.

[0308] In some implementations, determining whether the device to be formed can suppress higher diffraction order light based on the result of the discrete Fourier transform includes: determining a first intensity of the principal order light and a second intensity of the higher diffraction order light based on the result of the discrete Fourier transform; and determining whether the ratio of the first intensity of the principal order light to the second intensity of the higher diffraction order light is greater than a predetermined threshold.

[0309] In some embodiments, the method further includes: if, based on the result of the discrete Fourier transform, the device to be formed is capable of suppressing higher diffraction order light, then fabricating a sample on a substrate according to the plurality of shapes, and measuring the diffraction pattern of the sample; determining, based on the measured diffraction pattern of the sample, whether the sample is capable of suppressing higher diffraction order light; if, based on the measured diffraction pattern of the sample, the sample is capable of suppressing higher diffraction order light, then determining that the device to be formed is capable of suppressing higher diffraction order light; and if, based on the measured diffraction pattern of the sample, the sample is unable to suppress higher diffraction order light, then determining that the device to be formed is unable to suppress higher diffraction order light.

[0310] In some embodiments, manufacturing the sample on the substrate according to the plurality of shapes includes etching a metal-coated substrate according to the plurality of shapes.

[0311] In some embodiments, the method further includes: fabricating a sample on a substrate according to the plurality of shapes, and measuring the diffraction pattern of the sample; determining, based on the measured diffraction pattern of the sample, whether the sample can suppress light of higher diffraction orders; if, based on the measured diffraction pattern of the sample, the sample can suppress light of higher diffraction orders, then determining that the device to be formed can suppress light of higher diffraction orders; if, based on the measured diffraction pattern of the sample, the sample cannot suppress light of higher diffraction orders, then determining that the device to be formed cannot suppress light of higher diffraction orders.

[0312] In some implementations, determining whether the positional relationship between the shape and the corresponding point satisfies one or more conditions includes: determining whether the distance between each vertex of the shape and the corresponding point is less than a predetermined threshold; and if the distance between a vertex of the shape and the corresponding point is less than the predetermined threshold, moving the vertex along the line between the vertex and the corresponding point so that the distance between the moved vertex and the corresponding point is greater than or equal to the predetermined threshold, and connecting the moved vertex to one or more other vertices of the shape.

[0313] In some implementations, each of the plurality of points corresponds to a through-hole for connecting to the device to be formed based on a corresponding shape, and the predetermined threshold is determined based on at least one of the radius of the through-hole, manufacturing tolerance, or the gap between adjacent components of the plurality of components to be formed.

[0314] In some implementations, determining whether the positional relationship between the shape and the corresponding point satisfies one or more conditions includes: determining whether the distance between each edge of the shape and the corresponding point is less than a second threshold; and if the distance between the edge of the shape and the corresponding point is less than the second threshold, modifying the edge of the shape.

[0315] In some implementations, modifying the edge of the shape includes: inserting a new vertex between two vertices of the edge with the new vertex spaced from the corresponding point at a distance not less than the predetermined threshold, and modifying the shape by connecting the new vertex to the two vertices of the edge respectively.

[0316] In some implementations, the line connecting the new vertex and the corresponding point is perpendicular to the edge. In some implementations, the distance between the new vertex and the corresponding point is the same as a value greater than or equal to the predetermined threshold. In some implementations, the distances between at least two new vertices and their corresponding points are different.

[0317] In some implementations, the modification of the edge of the shape is performed after determining that the distance between each vertex of the edge and the corresponding point is not less than the corresponding distance of the predetermined threshold.

[0318] In some implementations, the method includes iteratively repeating (i) determining whether the distance between each vertex of the shape and the corresponding point is less than a predetermined threshold and (ii) determining whether the distance between each edge of the shape and the corresponding point is less than a second threshold, until all shapes in the region satisfy one or more of the conditions.

[0319] In some implementations, the second threshold is determined based on the predetermined threshold.

[0320] In some implementations, each of the shapes that satisfy one or more of the conditions has at least one of the following: the distance between each vertex of the shape and the corresponding point is not less than a first threshold, or the distance between each edge of the shape and the corresponding point is not less than a second threshold.

[0321] In some embodiments, the method further includes: performing a discrete Fourier transform on the centroid of the shape that satisfies one or more of the conditions; and determining, based on the result of the discrete Fourier transform, whether the device to be formed is capable of suppressing light of higher diffraction orders.

[0322] In some embodiments, the method further includes: if, based on the result of the discrete Fourier transform, the device to be formed is capable of suppressing higher diffraction order light, then fabricating a sample on a substrate according to the shape and measuring the diffraction pattern of the sample; determining, based on the measured diffraction pattern of the sample, whether the sample is capable of suppressing higher diffraction order light; and if, based on the measured diffraction pattern of the sample, the sample is capable of suppressing higher diffraction order light, then determining that the device to be formed is capable of suppressing higher diffraction order light, wherein, in response to determining that the device to be formed is capable of suppressing higher diffraction order light, the profile of the device to be formed is generated.

[0323] Another aspect of this disclosure relates to a method of manufacturing an irregular device, comprising: forming a plurality of components on a backplane including a plurality of circuits, wherein each of the plurality of components includes a metal electrode, the metal electrodes of the plurality of components being isolated from each other and forming an irregular pattern, wherein each of the metal electrodes is coupled to a corresponding circuit of the plurality of circuits in the backplane through a corresponding through-hole of a plurality of through-holes, and wherein the positional relationship between the metal electrode and the corresponding through-hole satisfies one or more conditions.

[0324] In some embodiments, the positional relationship between the metal electrode and the corresponding through hole includes: the distance between each vertex of the shape of the metal electrode and the center point of the corresponding through hole is not less than a first threshold; and the distance between each edge of the shape and the center point is not less than a second threshold.

[0325] In some implementations, at least one of the first threshold or the second threshold is determined based on at least one of the radius of the corresponding via, manufacturing tolerance, or the gap between adjacent metal electrodes.

[0326] In some embodiments, forming the plurality of components includes: forming a metal layer on top of the plurality of vias; and patterning the metal layer according to the irregular pattern to obtain the metal electrode.

[0327] In some embodiments, the method further includes aligning a patterned beam with the positions of the plurality of through-holes on the backplate before forming the plurality of components.

[0328] In some embodiments, aligning the patterned beam with the positions of the plurality of through-holes on the back panel includes: aligning the patterned beam with at least one alignment mark on a peripheral region of the plurality of components; forming a test pattern in the region of the plurality of components, wherein the test pattern includes one or more shapes; determining whether a corresponding through-hole is located in the region defined by the one or more shapes; and if the calibrated through-hole is located in the region defined by the one or more shapes, determining that the patterned beam is aligned with the positions of the plurality of through-holes, wherein the plurality of components are formed in response to determining that the patterned beam is aligned with the positions of the plurality of through-holes.

[0329] In some embodiments, the method includes: if the calibration via is outside the area defined by the one or more shapes of the test pattern, then aligning the patterned beam with the location of the plurality of vias on the backplate again.

[0330] In some embodiments, the size of the region defined by the one or more shapes is not greater than the tolerance distance of the plurality of vias, and the tolerance distance is determined based on at least one of the radius of the plurality of vias, manufacturing tolerance, or gap between adjacent metal electrodes.

[0331] In some embodiments, the plurality of components are formed on the backplane based on the configuration file of the irregular device. The configuration file of the irregular device includes information on a plurality of shapes, each shape corresponding to a corresponding metal electrode of the metal electrode. The positional relationship between the metal electrode and the corresponding via is determined based on the information on the corresponding shape of the metal electrode and the information on the center point of the corresponding via.

[0332] In some embodiments, the plurality of components are distributed among a plurality of panels disposed adjacent to the back plate, and the method includes: for each of the plurality of panels, aligning the patterned beam with the location of a through-hole in the panel, and after the alignment, forming a corresponding metal electrode in the panel.

[0333] In some embodiments, the plurality of vias are regularly arranged on the plurality of circuits. In some embodiments, at least two pairs of adjacent vias have different spacing.

[0334] In some embodiments, forming the plurality of components includes: forming a first alignment layer on top of the metal electrode; forming a separate spacer on the first alignment layer; forming a liquid crystal layer on the first alignment layer; forming a second alignment layer on top of the liquid crystal layer and the separate spacer; and forming a transparent conductive layer as a common electrode on top of the second alignment layer.

[0335] Another aspect of this disclosure relates to an apparatus comprising: a backplane including a plurality of circuits; and a plurality of components disposed on the backplane, wherein each of the plurality of components includes a metal electrode, wherein each of the metal electrode is coupled to a corresponding circuit of the plurality of circuits in the backplane through a corresponding via of a plurality of vias, and wherein the positional relationship between the metal electrode and the corresponding via satisfies one or more conditions.

[0336] Another aspect of this disclosure relates to a system comprising: an apparatus and a controller. The apparatus includes: a backplane including a plurality of circuits; and a plurality of components disposed on the backplane, each of the plurality of components including a metal electrode, wherein each of the metal electrodes is coupled to a corresponding circuit in the plurality of circuits in the backplane through a corresponding via of a plurality of vias, and wherein a positional relationship between the metal electrode and the corresponding via satisfies one or more conditions. The controller is coupled to the apparatus and configured to transmit at least one control signal to at least one component in the apparatus to modulate at least one characteristic of the at least one component.

[0337] Another aspect of this disclosure relates to an apparatus comprising: a plurality of components arranged in rows and columns; and a controller coupled to the plurality of components, the controller including a plurality of drive circuits and a plurality of row scanners. Each of the plurality of components is coupled to a corresponding drive circuit of the plurality of drive circuits. The plurality of row scanners includes a row scanner having a series of selectors disposed in a column between two adjacent columns of components, each selector being configured to select a corresponding row component via a corresponding drive circuit coupled to the corresponding row component.

[0338] In some implementations, the plurality of components includes column components disposed on the series selector of the row scanner, the column components being between two adjacent column components.

[0339] In some implementations, each of the plurality of components includes a corresponding electrode, and the electrode of the component in one column of the components is coupled to the electrode of the corresponding component in one of the two adjacent columns of components.

[0340] In some implementations, the respective electrodes of the plurality of components are coupled to the plurality of drive circuits through regularly arranged conductive vias.

[0341] In some embodiments, the column assembly includes a first component and a second component adjacent to the first component along the column assembly. The electrodes of the first component are coupled to the electrodes of a first adjacent component in a first column of the two adjacent components, and the electrodes of the second component are coupled to the electrodes of a second adjacent component in a second column of the two adjacent components. The first component and the first adjacent component are in the same first row, and the second component and the second adjacent component are in the same second row adjacent to the same first row.

[0342] In some implementations, each of the plurality of components includes a corresponding electrode, and the corresponding electrodes of the column component are coupled together to a driver configured to set a fixed or randomized value for each refresh of the column component.

[0343] In some embodiments, the plurality of components form an irregular pattern. The irregular pattern includes a Voronoi pattern. In some embodiments, at least one component of the plurality of components has an irregular polygonal shape. In some embodiments, adjacent components of the plurality of components have different shapes.

[0344] In some embodiments, row components extend along a first direction and column components extend along a second direction perpendicular to the first direction. The row scanner is a first row scanner coupled to a first plurality of components coupled to a plurality of first drive circuits in a first panel. The plurality of row scanners include a second row scanner coupled to a second plurality of components coupled to a plurality of second drive circuits in a second panel. The first panel and the second panel are disposed along the second direction.

[0345] In some embodiments, the controller includes control circuitry disposed in a peripheral area adjacent to the plurality of components. The control circuitry includes a first control circuitry and a second control circuitry on opposite sides of the plurality of components. The first control circuitry is adjacent to and coupled to the plurality of first drive circuitry in the first panel, and the second control circuitry is adjacent to and coupled to the plurality of second drive circuitry in the second panel.

[0346] In some embodiments, the first control circuit includes: digital circuitry configured to receive digital data for modulating the first plurality of components, and analog circuitry including: one or more digital-to-analog converters (DACs) coupled to the digital circuitry and configured to convert the digital data into corresponding analog voltage signals, and one or more drivers coupled to the plurality of first drive circuitry and configured to drive each of the analog voltage signals to a corresponding first drive circuitry of the plurality of first drive circuitry to modulate the corresponding component of the first plurality of components.

[0347] In some implementations, the row components extend along a first direction, and the column components extend along a second direction perpendicular to the first direction, and the controller includes control circuitry stacked with the plurality of drive circuits and the plurality of row scanners along a third direction perpendicular to the first and second directions.

[0348] In some embodiments, the plurality of drive circuits and the plurality of line scanners are disposed in a first layer, and the control circuit is disposed in a second layer, and the first layer and the second layer are stacked along the third direction.

[0349] In some embodiments, the plurality of components include a common electrode, and each of the plurality of components includes a corresponding metal electrode. The drive circuit includes: a selection switch, a toggle switch, and a reset switch, which are connected in series between a first input and a second input of the drive circuit, wherein the drive circuit is configured to receive a first input voltage at the first input and a second input voltage at the second input; a first capacitor having a first terminal coupled between the toggle switch and the reset switch and a second terminal coupled to the second input, the first terminal of the first capacitor being coupled to a metal electrode of a corresponding component associated with the drive circuit; and a second capacitor having a first terminal coupled between the selection switch and the toggle switch and a second terminal coupled to the second input, wherein the voltage at the metal electrode of the corresponding component is the same as the voltage at the first terminal of the first capacitor, and the change in the voltage at the first terminal of the first capacitor is based on the change in the first input voltage, the capacitance of the first capacitor, and the capacitance of the second capacitor.

[0350] In some embodiments, the plurality of components include a common electrode, and each of the plurality of components includes a corresponding metal electrode. The driving circuit is a differential circuit, which includes a capacitor having a first terminal coupled to a first circuit portion of the driving circuit and a second terminal coupled to a second circuit portion of the driving circuit. The first terminal is coupled to the metal electrode of the corresponding component associated with the driving circuit, and the voltage at the metal electrode of the corresponding component is the same as the voltage at the first terminal of the capacitor. The change in the voltage at the first terminal is based on the difference between a first input voltage of the first circuit portion and a second input voltage of the second circuit portion.

[0351] In some implementations, the selector of the row scanner includes a shift register with triggers or latches.

[0352] Another aspect of this disclosure relates to an apparatus comprising: a plurality of components, wherein the plurality of components include a common electrode, and each of the plurality of components includes a corresponding metal electrode, the metal electrodes of the plurality of components being isolated from each other; and a controller coupled to the plurality of components, wherein the controller includes a plurality of drive circuits, wherein each of the plurality of components is coupled to a corresponding drive circuit of the plurality of drive circuits. One of the drive circuits includes a capacitor having a first terminal coupled to a first circuit portion of the drive circuit and a second terminal coupled to a second circuit portion of the drive circuit, the first terminal being coupled to a metal electrode of a corresponding component associated with the drive circuit, and the voltage at the metal electrode of the corresponding component being the same as the voltage at the first terminal of the capacitor, and the variation of the voltage at the first terminal being based on the difference between a first input voltage of the first circuit portion and a second input voltage of the second circuit portion.

[0353] In some embodiments, the corresponding component is configured to be modulated based on the difference between the common voltage applied to the common electrode and the voltage at the first terminal. The driving circuit is configured to drive the corresponding component during a refresh period having a negative period and a positive period. The common voltage applied to the common electrode is set to a first fixed voltage during the negative period and a second fixed voltage during the positive period, the first fixed voltage being higher than the second fixed voltage. The first input voltage is configured to change from a first higher input voltage to a first lower input voltage during the negative period and from the first lower input voltage to the first higher input voltage during the positive period. The second input voltage is configured to change from a second lower input voltage to a second higher input voltage during the negative period and from the second higher input voltage to the second lower input voltage during the positive period.

[0354] In some implementations, the first lower input voltage is the same as the second lower input voltage, and the first higher input voltage is the same as the second higher input voltage.

[0355] In some embodiments, the driving circuit includes a first input configured to receive the first input voltage as an input to the first circuit portion, a second input configured to receive the second input voltage as an input to the second circuit portion, and a third input configured to receive a third input voltage. The second terminal of the capacitor is coupled to the third input of the driving circuit and configured to receive the third input voltage, and the sum of the first input voltage and the second input voltage is twice the third input voltage.

[0356] In some embodiments, the capacitor is a first capacitor, and the drive circuit includes a second capacitor, wherein a first terminal of the second capacitor is coupled to a node between the input of the first circuit portion and the first terminal of the first capacitor in the first input portion, and a second terminal of the second capacitor is coupled to a node between the input of the second circuit portion and the second terminal of the first capacitor in the second input portion.

[0357] In some embodiments, the change in voltage at the first terminal is based on the capacitance of the first capacitor and the capacitance of the second capacitor, wherein the change in voltage at the first terminal satisfies the following expression: , in This indicates the change in voltage at the first terminal. Ce This indicates the capacitance of the first capacitor. Cs This indicates the capacitance of the second capacitor. This represents the difference between the first input voltage and the second input voltage.

[0358] In some embodiments, the capacitance of the second capacitor Cs With the capacitance of the first capacitor Ce The ratio is greater than 1.

[0359] In some embodiments, the first circuit portion includes a first selection switch and a first changeover switch connected in series between the input of the first circuit portion and the first terminal of the first capacitor, the first terminal of the second capacitor being coupled between the first selection switch and the first changeover switch, and the second circuit portion includes a second selection switch and a second changeover switch connected in series between the input of the second circuit portion and the second terminal of the first capacitor, the second terminal of the second capacitor being coupled between the second selection switch and the second changeover switch.

[0360] In some embodiments, the first selection switch and the second selection switch are configured to receive the same selection signal to be turned on or off simultaneously, and the first changeover switch and the second changeover switch are configured to receive the same changeover signal to be turned on or off simultaneously.

[0361] In some embodiments, the drive circuit further includes a reset switch coupled between the first terminal of the first capacitor and the second terminal of the first capacitor, wherein the reset switch is configured to receive a reset signal to reset the voltage at the metal electrode.

[0362] In some implementations, at least one of the first selection switch, the second selection switch, the first changeover switch, the second changeover switch, or the reset switch includes a transistor.

[0363] In some implementations, the drive circuit is configured to operate in a series of states, including: i) Waiting state, during which the first selector switch, the second selector switch, the first changeover switch, the second changeover switch, and the reset switch are turned off. ii) Sampling state, during which the first selection switch and the second selection switch are turned on to receive the first input voltage at the first terminal of the second capacitor and the second input voltage at the second terminal of the second capacitor, and the first selection switch, the second selection switch and the reset switch are turned off. iii) Reset state, during which the first selection switch, the second selection switch, the first changeover switch, and the second changeover switch are turned off, and the reset switch is turned on to reset the voltage at the metal electrode to be the same as the reset voltage of the drive circuit, and iv) In the transition state, during which the first selector switch, the second selector switch and the reset switch are turned off, and the first changeover switch and the second changeover switch are turned on, such that the voltage at the first terminal of the first capacitor is the same as the voltage at the first terminal of the second capacitor, and the voltage at the second terminal of the first capacitor is the same as the voltage at the second terminal of the second capacitor.

[0364] In some embodiments, the voltage at the second terminal of the first capacitor and the voltage at the second terminal of the second capacitor are the same as the reset voltage of the drive circuit.

[0365] In some embodiments, during this transition state, the voltage at the first terminal of the first capacitor satisfies the following expression: , in vPe This indicates the voltage at the first terminal of the first capacitor. vSp This indicates the voltage at the first terminal of the second capacitor. Ce This represents the capacitance of the first capacitor. Cs This indicates the capacitance of the second capacitor. vDatp This indicates the first input voltage. vDatn This indicates the second input voltage, and vCm This indicates the reset voltage.

[0366] In some embodiments, the corresponding component is configured to be modulated based on the difference between the common voltage applied to the common electrode and the voltage at the first terminal, wherein the driving circuit is configured to drive the corresponding component during a refresh time period having a negative period and a positive period, wherein the common voltage applied to the common electrode is set to a first fixed voltage during the negative period and to a second fixed voltage during the positive period, the first fixed voltage being higher than the second fixed voltage, and wherein the common voltage changes from the first fixed voltage to the second fixed voltage during the reset state and before the transition state.

[0367] Another aspect of this disclosure relates to an apparatus comprising: a first integrated structure including a plurality of components extending in rows along a first direction and in columns along a second direction perpendicular to the first direction; and a second integrated structure including control circuitry for the plurality of components, the first integrated structure and the second integrated structure being stacked together along a third direction perpendicular to the first direction and the second direction, the plurality of components forming an irregular pattern.

[0368] In some implementations, the first integrated structure includes a plurality of drive circuits, each of which is coupled to a corresponding component of the plurality of components.

[0369] In some embodiments, the first integrated structure includes a plurality of row scanners, wherein the plurality of row scanners includes a series of selectors disposed below column components between two adjacent columns, each of the series of selectors being configured to select the corresponding row component by means of a corresponding drive circuit coupled to the corresponding row component.

[0370] In some embodiments, the first integrated structure includes a plurality of line scanners coupled to the plurality of drive circuits, and the plurality of line scanners and the plurality of drive circuits are stacked together along the third direction.

[0371] In some embodiments, the plurality of components include a common electrode, and each of the plurality of components includes a corresponding metal electrode. The drive circuit of the plurality of drive circuits includes a capacitor having a first terminal coupled to a first circuit portion of the drive circuit and a second terminal coupled to a second circuit portion of the drive circuit. The first terminal is coupled to the metal electrode of the corresponding component associated with the drive circuit, and the voltage at the metal electrode of the corresponding component is the same as the voltage at the first terminal of the capacitor. The change in the voltage at the first terminal is based on the difference between a first input voltage of the first circuit portion and a second input voltage of the second circuit portion.

[0372] In some embodiments, the control circuitry includes: digital circuitry configured to receive digital data for modulating the plurality of components; and analog circuitry, each analog circuit including: one or more digital-to-analog converters (DACs) coupled to the corresponding digital circuitry and configured to convert the corresponding digital data into a corresponding analog voltage signal; and one or more drivers coupled to the corresponding drive circuitry and configured to drive each of the analog voltage signals to a corresponding drive circuitry of the corresponding drive circuitry to modulate the corresponding component of the plurality of components.

[0373] In some embodiments, the first integrated structure and the second integrated structure are integrated together by adhesive bonding. This bonding may include at least one of direct bonding or hybrid bonding.

[0374] This disclosure provides techniques that overcome limitations present in known technologies. As an example, the techniques disclosed herein can be implemented without using bulky wearable devices such as "3D glasses." As another example, the techniques disclosed herein can be optionally implemented without limitations related to the accuracy of the tracking mechanism, the quality of the display device, relatively long processing times and / or relatively high computational requirements, and / or the inability to display objects to multiple viewers simultaneously. As a further example, the techniques can be implemented without specialized tools and software to develop content that extends beyond the tools and software used in conventional 3D content creation. Various embodiments may demonstrate one or more of the foregoing advantages. For example, certain embodiments of this disclosure can generate real-time, full-color, realistic 3D images that appear to be real 3D objects in the world and can be viewed simultaneously and unobstructed by multiple viewers from different points.

[0375] In this disclosure, the term "primitive" refers to a basic element within a computing system used for input or output. This element can be a geometric or graphical element. For example, in vector computer graphics, CAD systems, and geographic information systems, a geometric primitive (or prim) is the simplest (e.g., "atom" or irreducible) geometric structure that the system can process (e.g., draw, store). The term "vertex" refers to a node of a primitive that can be connected to one or more other nodes to form a primitive. The term "hologram" refers to a pattern displayed (or uploaded to) a display that contains amplitude or phase information about an object, or a combination thereof. The term "holographic reconstruction" refers to a volume light field (e.g., a holographic light field) from a display when illuminated.

[0376] As used herein, the term “irregular” means “non-periodic” and / or “non-uniform”. For example, the term “irregular shape” may indicate that a shape has sides and / or angles having different lengths and / or dimensions. The term “irregular pattern” may indicate that: i) components (e.g., phase units) in a region of the pattern are arranged in a non-periodic manner, and said components may be the same or different from each other, or ii) said components have different irregular shapes.

[0377] Shading is a process that adds values ​​to create the illusion of form, space, and light in an image. Shading can make an image appear three-dimensional and create a convincing image. Shading can differ from techniques that add shadows (such as shadow mapping or shadow volumes), which are global behaviors of light. The term "shading information" refers to descriptive information in 3D models (e.g., in the field of 3D computer graphics) or illustrations (e.g., in visual arts) that conveys a sense of depth by varying the darkness. Shading information can approximate the local behavior of light on the surface of an object. Shading information can be obtained through any conventional CGI surface shading method that involves modulating the color or brightness of the surface of primitives. The primitive data disclosed herein may include shading information associated with primitives.

[0378] The term "viewpoint-dependent shading information" can be a broader generalization of the term "geometric specular reflection." Specular reflection is a subset of viewpoint-dependent shading. Specular reflection is somewhat like a blurred, recolored image of a light source described by a two-way reflectance distribution function ("BRDF") of a particular material (such as plastic or glossy wood). Viewpoint-dependent shading can encompass specular BRDFs as well as perfect mirrors and image-based lighting. For example, to render a spherical Christmas decoration, an image of the environment surrounding the decoration, including the position and size of each light source, can be used, and the viewer's position can be part of the reflection calculation. The reflection appears to move with the viewpoint, thus revealing different parts of the environment. Similarly, the position of a bright specular area on a plastic surface can be the sum of the viewpoint-dependent projections of the Christmas lights reflected from the spherical decoration multiplied by the BRDF. The primitive data disclosed herein may include viewpoint-dependent shading information associated with the primitives.

[0379] Details of one or more embodiments of the subject matter of this specification are set forth in the accompanying drawings and associated description. Other features, aspects, and advantages of the subject matter will become apparent from the description, drawings, and claims.

[0380] It should be understood that various aspects of the implementation can be combined in different ways. As an example, features from a particular method, device, or system can be combined with features from other methods, devices, or systems. Attached Figure Description

[0381] Figure 1A A schematic diagram of an exemplary system for 3D display is shown.

[0382] Figure 1B An exemplary system for 3D display is shown.

[0383] Figure 2 An exemplary configuration for electromagnetic (EM) field calculation is shown.

[0384] Figure 3AAn exemplary EM propagation of a dot primitive relative to a display component of a display is shown.

[0385] Figure 3B An exemplary EM propagation of a line element relative to a display component of a display is shown.

[0386] Figure 3C An exemplary EM propagation of a triangular primitive relative to a display component of a display is shown.

[0387] Figure 4A A sample table showing vertex data and primitive data is provided.

[0388] Figure 4B An example table of adjacent primitives is shown.

[0389] Figure 4C An example command from the API is shown.

[0390] Figure 4D An exemplary pipeline calculation using a phase unit processing unit is shown.

[0391] Figure 4E A flowchart of an exemplary procedure for calculating the contribution of an EM field using a processing device.

[0392] Figure 5A An exemplary system for 3D display is shown, including a reflective display that uses optical diffraction illumination.

[0393] Figure 5B Another exemplary system for 3D display is shown, including a reflective display that uses optical diffraction illumination.

[0394] Figure 5C Another exemplary system for 3D display is shown, including a transmissive display that uses optical diffraction illumination.

[0395] Figure 5D Another exemplary system for 3D display is shown, including a transmissive display that uses optical diffraction illumination.

[0396] Figure 6A An exemplary system for 3D display using bottom lighting is shown.

[0397] Figures 6B to 6D Various views of an exemplary system for 3D display using side lighting are shown.

[0398] Figures 6E to 6G An exemplary system for 3D display using side lighting is shown.

[0399] Figure 6H An example of dispersion compensation in a system used for 3D display is shown.

[0400] Figure 7A An example of optical diffraction illumination using single-point extraction is shown.

[0401] Figure 7B An example of optical diffraction illumination using multi-point extraction in one dimension is shown.

[0402] Figure 7C Exemplary stripe patterns for (a) an infeed grating and (b) an outfeed grating used for dispersion compensation are shown.

[0403] Figure 7D An exemplary system using monochromatic multi-point illumination extraction is shown.

[0404] Figure 7D-2 An exemplary system using monochromatic multipoint extraction illumination with display zero-order suppression and / or color crosstalk suppression is shown.

[0405] Figure 7E An exemplary system for extracting illumination using multicolor multipoints is shown.

[0406] Figure 7F An exemplary system for using multi-point extraction lighting in two dimensions is shown.

[0407] Figure 7G It shows a light path Figure 7F An example of a system.

[0408] Figure 7H Exemplary curves showing the diffraction efficiency of holographic gratings with different polarization modes are illustrated.

[0409] Figure 7I An exemplary system for blocking ambient light is shown.

[0410] Figure 7J Another exemplary system for blocking ambient light is shown.

[0411] Figure 8A An exemplary display with display components or phase units is shown.

[0412] Figure 8B An example of calculating the diffraction limit of the phase unit of a display is shown.

[0413] Figure 8C Different implementations of tessellation are shown, including a perfect kiss (a), a flying kiss (b), and a French kiss (c).

[0414] Figure 8D-1 An example of surface subdivision for managing adjacent primitives used for primitive kissing is shown.

[0415] Figure 8D-2 Another example of surface subdivision for managing adjacent primitives used for primitive kissing is shown.

[0416] Figure 8E-1 An example of surface subdivision for managing adjacent primitives for overlapping effects is shown.

[0417] Figure 8E-2 Another example of surface subdivision for managing adjacent primitives for overlapping effects is shown.

[0418] Figure 8F This is a flowchart of an exemplary procedure for managing the tessellation of primitives used for 3D display.

[0419] Figure 9A An example of an irregularly shaped display is shown.

[0420] Figure 9B An example of an irregularly designed display is shown.

[0421] Figure 9C A flowchart of an exemplary procedure for designing an irregularly shaped display.

[0422] Figure 9D-1 This is a flowchart of an exemplary procedure for designing irregular displays based on manufacturing tolerances.

[0423] Figure 9D-2 To depict Figure 9D-1 A flowchart of an exemplary procedure for the steps of the procedure.

[0424] Figure 9E Examples of several design shapes for irregular displays are shown.

[0425] Figure 9F It shows Figure 9E Exemplary results of the Discrete Fourier Transform (DFT) of multiple design shapes.

[0426] Figure 9G Showing according to Figure 9E Images of samples manufactured from multiple design shapes.

[0427] Figure 9H It shows Figure 9G The diffraction pattern of the sample was measured.

[0428] Figure 9I The procedure for modifying the vertices and edges of multiple shapes is shown.

[0429] Figure 9J The area shown includes multiple shapes after modification.

[0430] Figure 9K It shows Figure 9JExemplary results of DFT for multiple shapes.

[0431] Figure 9L It shows that according to Figure 9J The measured diffraction pattern of samples manufactured in multiple shapes.

[0432] Figure 9M The measured diffraction pattern of a sample manufactured according to multiple regular shapes is shown.

[0433] Figure 10A A cross-sectional view of an exemplary irregular display is shown.

[0434] Figure 10B A cross-sectional view of another exemplary irregular display is shown.

[0435] Figures 11A to 11F An exemplary procedure for manufacturing an irregularly shaped display is shown.

[0436] Figure 12A The chip, which includes multiple panels and alignment marks, is depicted.

[0437] Figure 12B The test pattern and an example of alignment using the test pattern are depicted.

[0438] Figure 13A A display with a peripheral line scanner is depicted.

[0439] Figure 13B A display with an embedded line scanner is described.

[0440] Figure 13C A multi-layer device with array components is described.

[0441] Figure 14A This is a schematic diagram of a phase modulation device.

[0442] Figure 14B The driving circuit diagram is depicted.

[0443] Figure 14C The scan voltage was described to modulate Figure 14B A schematic diagram of the phase in the driving circuit.

[0444] Figure 14D-1 A system comprising multiple drive circuits with an embedded line scanner is described.

[0445] Figure 14D-2 A schematic diagram depicts an embedded row scanner between component columns.

[0446] Figure 14D-3 The circuit diagram of the line scanner is depicted.

[0447] Figure 14EDepicting Figure 14B The different states of the sub-circuits of the driving circuit.

[0448] Figure 14F Depicting Figure 14E Timing diagram of voltages in the sub-circuit.

[0449] Figure 15A The differential drive circuit diagram is depicted.

[0450] Figure 15B Two paintings were depicted. Figure 15A The differential drive circuit modulates the phase curve through voltage scanning.

[0451] Figure 15C A system comprising multiple differential drive circuits with a peripheral line scanner is described.

[0452] Figure 15D A system comprising multiple differential drive circuits with an embedded line scanner is described.

[0453] Figure 15E Depicting Figure 15A The different states of the sub-circuits of the differential drive circuit.

[0454] Figure 15F Depicting Figure 15E Timing diagram of voltages in the sub-circuit.

[0455] Figure 16A An exemplary implementation of Maxwellian holographic occlusion for point primitives is shown in the case where online primitives act as occluders.

[0456] Figure 16B An exemplary implementation of Maxwellian holographic occlusion for a line primitive is shown, in which another line primitive acts as an occluder.

[0457] Figure 16C An exemplary implementation of Maxwellian holographic occlusion for a triangular primitive is shown, where the online primitive is used as an occluder.

[0458] The same component symbols and names in the various figures indicate the same components. Detailed Implementation

[0459] The various embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. Numerous specific details are set forth in the following detailed description in order to provide a thorough understanding of the described embodiments. However, it will be apparent to those skilled in the art that the described embodiments can be practiced without these specific details. In other instances, well-known methods, processes, components, circuits, and networks have not been described in detail to avoid unnecessarily obscuring relevant aspects of the embodiments.

[0460] The following describes several technical features, which can be used individually or in combination with any other features. However, it should be noted that any single feature may not solve all the problems described above, or may only solve one of the problems. For some of the problems mentioned above, none of the features described herein may adequately solve them. Although this document uses multiple headings, information related to a specific heading but not appearing in the corresponding heading section may appear elsewhere in this specification.

[0461] Embodiments of this disclosure are described herein according to the following outline: 1. General Overview 2. System Overview 2.1 Application Programming Interface (API) 2.2 Processing Equipment 2.3 Drive Device 2.4 Display 2.5 Exemplary System for 3D Display 3. Electromagnetic (EM) Calculation 3.1 EM Field Contribution of the Primitive Elements 3.2 Calculations for primitives 3.3 Calculation Implementation Method 4. Holographic display system 4.1 Exemplary System Settings 4.2 Bottom lighting 4.3 Side lighting 4.4 Dispersion Compensation 4.5 Field gratings with low diffraction efficiency 4.6 Multi-point extraction lighting 4.7 Ambient light blocking 5. Display Implementation Method 6. Subdivision of primitive surfaces 6.1 Basic Kissing 6.2 Primitive Overlap 6.3 Exemplary Procedure 7. Irregularly shaped display 7.1 Designing Irregularly Shaped Displays 7.2 Design with manufacturing tolerances 7.3 Exemplary irregular display and manufacturing process 8. Integrated circuit design for displays 9. Obstruction and mirrored lighting 10. Texture Mapping 11. Calibration 11.1 Phase Calibration 11.2 Alignment and Calibration 11.3 Color Calibration 1. General Overview This disclosure describes a technique for realizing 3D displays of complex computer-generated scenes using real holograms. The technique provides a novel and deterministic solution to real-time dynamic computational holography based on Maxwell's equations for electromagnetic fields, which can be represented as MAXWELL HOLOGRAPHY® (or MAXWELLHOLOGRAPHY™). Operations (or computations) in MAXWELL HOLOGRAPHY® can be represented as Maxwell holographic operations (or Maxwell holographic computations). In embodiments, this disclosure treats the hologram as a Dirichlet or Cauchy boundary condition problem for a general electric field, utilizing tools including field theory, topology, analytic continuity, and / or groups of symmetries, enabling real-time solution of the hologram without the limitations of older holographic systems. In embodiments, the technique can be used to create pure phase, pure amplitude, or phase and amplitude holograms using a spatial light modulator (SLM) or any other holographic device.

[0462] Implementations of this disclosure provide: 1) a mechanism for approximating holograms as electromagnetic boundary conditions using field theory and contact geometry instead of classical optics; 2) derivation and implementation in computer code and application programming interface (API) of electromagnetic boundary condition methods in computational holography, i.e., implementing hologram computation as a 2D analytic function on the plane of the hologram and subsequently discretizing it into a parallel algorithm; and / or 3) implementations of complete sets of full 3D, holographic versions of standard computer graphics primitives (e.g., points, lines, triangles, and textured triangles) that achieve full compatibility with standard existing computer graphics tools and technologies. These techniques enable devices to display general existing content not specifically created for holography, while simultaneously allowing existing content creators to create holographic works without learning special techniques or using special tools.

[0463] The techniques disclosed herein may involve using mathematical formulas (or expressions) for light as electromagnetic (EM) phenomena instead of classical optical mathematical formulas commonly used in computational holography, such as the Gerchberg-Saxton (GS) algorithm. These mathematical formulas may be derived from Maxwell's equations. In embodiments, the techniques disclosed herein involve treating the displayed image as an electromagnetic field and the hologram as the boundary value conditions (e.g., the Dirichlet problem) that generate that electromagnetic field. Furthermore, the desired image can be constructed using primitive (or vertex) paradigms prevalent in computer graphics; for example, techniques can be used to display any 3D image as a holographic reconstruction (e.g., a holographic light field) rather than as a projected image on a 2D screen. These techniques avoid bandwidth-limited depth point cloud techniques and utilize any suitable type of primitive (e.g., point primitives, line primitives, or polygonal primitives such as triangle primitives). Additionally, color information, texture information, and / or shading information can be used to render the primitives. This facilitates the recording and compression of computer-generated (CG) holographic content, including holographic video.

[0464] In embodiments, the techniques disclosed herein use Maxwell's equations to compute the generated hologram as a boundary condition problem for modeling the electromagnetic field. This eliminates the dependence on Fast Fourier Transform (FFT) and its inherent limitations, eliminates the dependence on aligned light sources (such as lasers or light-emitting diodes (LEDs)), and / or eliminates the limitations of previous methods and nondeterministic solutions for computational holography.

[0465] In embodiments, depending on the parameters of the computer-generated (CG) primitives required to construct the scene, the techniques disclosed herein can be optimized for computational ease and speed through a mathematical optimization procedure constrained to independent inputs to the hologram surface. This allows the work to be performed in a highly parallel and highly optimized manner in computing architectures such as application-specific integrated circuits (ASICs) and multi-core architectures. The procedure for computing the hologram can be viewed as a single instruction executed on input data in the form of a computer-generated image (CGI) scene, and theoretically can be completed per CGI primitive in a single frequency cycle.

[0466] In embodiments, the techniques disclosed herein treat the holographic scene as an assembly of fully 3D holographic primitive apertures, which are functionally compatible with standard primitives of conventional 3D graphics used in, for example, video games, movies, television, computer displays, or any other display technology. The techniques can efficiently implement these aperture primitives in hardware and software without the limitations inherent in standard implementations of computational holography. The amplitude and color of the primitives can be calculated automatically. The computational complexity increases linearly with the number of phase components n compared to n^2 or n*log(n) in standard computational holography. The created image is a fully 3D, not a collection of planar images, and the techniques do not require iterative amplitude correction with an unknown number of steps. Furthermore, the generated hologram does not have “conjugate” images that occupy space on a holographic device.

[0467] Because holographic primitives (or the vertices of primitives) are part of a special set of mathematical objects, computation is relatively simple and relatively fast, and they are uniquely suited to parallel distributed computing methods. Computability and parallelism allow for interactive computation of large holograms to design theoretically infinitely large-area holographic devices that can function as holographic computer displays, telephone displays, home theaters, and even holographic rooms. Furthermore, holograms can be filled with light over large areas, for example, rendering large shaded regions in 3D without the limitations associated with conventional holographic computation methods, which allow components to appear as outlines rather than solids. Moreover, the relatively simple and relatively fast computation allows for the display of real-time holograms at interactive speeds unconstrained by n^2 computational loads and iterative amplitude corrections.

[0468] In embodiments, the technology achieves natural computability on modern ASICs and multi-core architectures, and full compatibility with modern graphics hardware, modern graphics software, and / or modern graphics tools and toolchains. For example, the technology can implement a clear and simple holographic API and enable high-performance rendering of arbitrary CG models using conventional 3D content creation tools or software applications (e.g., 3ds Max®, SOLIDWORKS®, Maya®, or Unity). The API allows developers or users to interact with holographic devices (e.g., light modulators or holographic systems). The holographic API can create computer graphics primitives as discrete holographic scene primitives, allowing for the generation of rich holographic content using general-purpose and specially designed holographic computing hardware. The creation of the mathematical and computational architecture allows for the rendering of holograms using tools and techniques used for creating conventional 3D content and software applications. Optimization of the mathematical and computational architecture allows for the display of high-performance embodiments of conventional graphics and rendering as holographic reconstructions.

[0469] The algorithms disclosed in this paper are implemented relatively simply in hardware. This not only allows for the computational speed required for the high-quality rendering expected by the user, but also allows the algorithms to be implemented in relatively simple circuitry (e.g., ASIC gate architecture or FPGA) as part of the holographic device. Therefore, the bandwidth issues that plague high-density displays may become irrelevant, as scene computation can be distributed across the computing architecture built into the display device (e.g., built-in computing) without having to be computed remotely and then written to the individual display components (or display pixels) of the display for each content frame. This also means that the number of display components and therefore the size of the holographic display can be relatively less constrained by other technologies. In some embodiments, the circuitry implementing the algorithm can be formed as a circuit board to be integrated into the computing device (e.g., via a PCIe slot). The circuitry can generate a hologram to be output to the display device for display. This simplifies the design of the display device for implementation.

[0470] The techniques disclosed herein enable the relatively simple and inexpensive implementation of a variety of interactive techniques using structured light in various applications, including solid-state light detection and ranging (LIDAR) devices, 3D printing and fabrication, smart illuminators, smart microdisplays, optical switching, optical tweezers, or any other application requiring structured light. The techniques disclosed herein can also be used for optical simulations, such as grating simulations.

[0471] 2. System Overview Figure 1A A schematic diagram of an exemplary system 100 for 3D display is shown. System 100 may include a host device 110, a processing device 120, a driving device 130, an illuminator 140, and a display 150. System 100 may be configured to reconstruct 2D / 3D objects generated (e.g., configured or designed) in the host device 110 by illuminating the display 150 with corresponding hologram modulation generated by the processing device 120 and the driving device 130 using the illuminator 140. As discussed in further detail below, various techniques can be implemented in system 100 to achieve 3D reconstruction / display with fast computing speed, high display refresh rate, high image quality, and high performance.

[0472] In some embodiments, host device 110 is configured to prepare data corresponding to a list of primitives for at least one object (e.g., a 3D object) and transmit the data to processing device 120 via interface 115 (e.g., a PCIe slot or any other high-speed connection). Processing device 120 is configured to calculate the electromagnetic (EM) field contribution from each primitive in the primitive list to each of the display components (e.g., modulators) of display 150 and output a hologram to driving device 130. Hereinafter, a hologram refers to modulation data for display 150 containing complex information, amplitude information, or phase information about at least one object, or a combination thereof. Driving device 130 is configured to generate control signals based on the hologram to modulate the display components of display 150, which diffracts light 145 from illuminator 140 to form a holographic light field 160 in 3D space corresponding to at least one object. The holographic light field 160 can be a volumetric light field from display 150 when illuminated and can also be referred to as a holographic reconstruction. Holographic reconstruction includes at least one reconstructed object corresponding to at least one object generated (e.g., configured or designed) in host device 110.

[0473] Processing device 120 may be implemented as, for example, an ASIC, an FPGA, an integrated circuit, one or more computing units, or any combination thereof. In some embodiments, processing device 120 is packaged as a circuit board integrated into host device 110 via a PCIe slot in host device 110. In some embodiments, processing device 120 is integrated with driving device 130, for example, to function as a controller that may be externally coupled to host device 110 and display 150 and / or illuminator 140. In some embodiments, processing device 120 and driving device 130 are integrated (e.g., attached together) with display 150 (and optionally illuminator 140) to form an integrated device that may be referred to as a holographic display device.

[0474] Host device 110 may be a computing device associated with a user (e.g., an operator, developer, programmer, customer, or any suitable entity). Host device 110 may be any suitable type of device, such as a desktop computer, personal computer, laptop computer, tablet computing device, personal digital assistant (PDA), network appliance, smartphone, smartwatch, enhanced general packet radio service (EGPRS) mobile phone, media player, navigation device, email device, game control panel, or any suitable combination of two or more of these computing devices or other computing devices.

[0475] Host device 110 includes an operating system running a number of applications 112 that function as a graphics engine. Applications 112 can use standard 3D content creation tools or 3D software applications (e.g., 3ds Max®, SOLIDWORKS®, Maya®, or Unity) to process or render scenes, such as any arbitrary computer-generated (CG) model. A scene may correspond to one or more real or imaginary 3D objects or object representations. In some implementations, one or more applications 112 (operating in parallel) are configured to render a scene to obtain scene data or a graphical abstraction. In some cases, scene data is obtained by processing the graphical abstraction. Scene data may be stored in the memory 118 of host device 110. Scene data may also be provided to an application programming interface (API) 114 for further processing. In some implementations, scene data is provided directly to processing device 120 for further processing.

[0476] 2.1 Application Programming Interface (API) An API is a software interface type. An API specifies an interface between one software application and another software application, computer program, operating system, computer hardware, or external device. In system 100, API 114 is configured as a holographic API that enables developers or users to interact with a holographic device (e.g., processing device 120) using host device 110. This holographic API can transform computer graphics primitives into discrete holographic scene primitives to allow for the generation of rich holographic content using general-purpose and specially designed holographic computing hardware.

[0477] In some implementations, API 114 specifies, for example, an interface between application 112 and the computer hardware (e.g., memory 118) of host device 110 via driver 116. Driver 116 may include machine-readable or executable programmable instructions or software. Driver 116 is configured to communicate between API 114 and memory 118, for example, to store data (such as tables and commands) from API 114 in memory 118, or to retrieve data from memory 118 to API 114.

[0478] API 114 may obtain scene data from application 112. In some examples, scene data includes data for multiple primitives corresponding to one or more objects in the scene. In some examples, API 114 processes the scene data to obtain data for multiple primitives. The multiple primitives may be indexed in a specific order. Primitives may include at least one of point primitives, line primitives, or polygon primitives (e.g., triangle primitives). The data of a primitive may include primitive data for each of the plurality of primitives. A primitive includes at least one vertex, and the primitive data of the primitive may include vertex data for that at least one vertex. For example, a triangle primitive includes three vertices connected to each other.

[0479] In some examples, the primitive data of a primitive includes at least one of the following: the primitive's coordinates in a 3D coordinate system, the primitive's color information (e.g., textured color, gradient color, or both), the primitive's texture coordinates, view-dependent shading information associated with the primitive (e.g., geometric specular reflection information), shading information associated with the primitive, or occlusion information associated with the primitive. The primitive data may also include a primitive identifier for one of several primitives, and / or at least one vertex identifier for at least one vertex.

[0480] In some examples, vertex data includes at least one of the following: the vertex's coordinates in a 3D coordinate system, color information associated with the vertex (e.g., textured color, gradient color, or both), texture coordinates associated with the vertex, view-dependent shading information associated with the vertex (e.g., geometric specular reflection information), shading information associated with the vertex, or occlusion information associated with the vertex. Vertex data may also include a vertex identifier for the vertex.

[0481] In some implementations, API 114 may, for example, adjust vertex data of vertices of multiple primitives associated with an object or holographic scene in response to receiving user input, a trigger signal or command, or a predetermined command. Based on the result of this adjustment, API 114 may update the vertex data of vertices in memory 118 for further processing. For example, as in Figures 8A to 8F Further details are provided, suggesting that the gap between adjacent primitives can be adjusted to avoid kissing or overlapping, or that an overlapping effect can be generated by adjusting the coordinate information of the vertices.

[0482] API 114 can be configured to process primitive data of multiple primitives and / or vertex data of multiple vertices (vertices / vertexes) of multiple primitives to obtain data that can be processed by processing device 120, including (but not limited to) generating a table displaying information about the vertices of each primitive, organizing vertices for parallel processing, and / or generating commands that cause processing device 120 to draw primitives.

[0483] In some implementations, API 114 is configured to: for each vertex of a plurality of primitives, associate a corresponding vertex identifier of that vertex with corresponding vertex data of that vertex, and store, for example, the association between the corresponding vertex identifier and the corresponding vertex data together with the corresponding vertex data in memory 118. API 114 may determine the corresponding vertex identifiers of the plurality of vertices based on the order of the plurality of vertices in a vertex stream corresponding to the plurality of primitives.

[0484] API 114 can store vertex associations in a table in memory 118. For example... Figure 4A As shown in (a), Table 400 displays information associated with vertices, including (but not limited to) vertex identifiers (numbers), 3D coordinates (x, y, z), color information, texture mapping information, occlusion information, shading information, and / or view-dependent shading information. As an example, vertex V1 has a vertex identifier n, coordinates (x1, y1, z1), color information (C1), texture mapping information (T1), occlusion information (O1), shading information (S1), and view-dependent shading information (VDS1).

[0485] In some implementations, API 114 is configured to: for each of the plurality of primitives, associate a corresponding primitive identifier of that primitive with one or more corresponding vertex identifiers (and optionally corresponding primitive data) of one or more vertices of that primitive in memory 118, and store the association between the corresponding primitive identifier of that primitive and the one or more corresponding vertex identifiers (and optionally corresponding primitive data) in memory 118. API 114 may determine the corresponding primitive identifiers of the plurality of primitives based on the order of the plurality of primitives in a primitive stream corresponding to a scene.

[0486] API 114 can store vertex associations in a table in memory 118. For example... Figure 4A As shown in (b), Table 410 displays information associated with primitives, including (but not limited to) primitive identifiers (numbers), vertex identifiers of the primitive's vertices, color information (PC), texture mapping information (PT), occlusion information (PO), shading information (PS), and / or view-dependent shading information (PVDS). As an example, primitive P1 has a primitive identifier (P1), identifiers of associated vertices (V1, V2, V3), color information (PC1), texture mapping information (PT1), occlusion information (PO1), shading information (PS1), and view-dependent shading information (PVDS1).

[0487] In some implementations, API 114 generates commands to be sent to processing device 120. These commands may be generated based on instructions, for example, from application 112 or the processor of host device 110. The instructions may instruct the reconstruction of a holographic scene including one or more objects. For example, the commands may include command instructions for drawing a series of primitives associated with one or more objects.

[0488] In some cases, API 114 may determine a primitive identifier associated with a command instruction for the family of primitives, and transmit a command including the command instruction and the primitive identifier to processing device 120 for further processing. In some cases, API 114 may determine a vertex identifier associated with a primitive identifier, and transmit a command including a command instruction and the vertex identifier (and optionally a primitive identifier) ​​to processing device 120 for further processing. The command may instruct processing device 120 to draw the family of primitives based on the primitive identifier, vertex identifier, or a combination thereof.

[0489] Figure 4B An example table is shown for a series of primitives associated with a command. This command can be used to draw three connected triangle primitives A, B, and C. For example... Figure 4B As shown in Figure (a), Figure 420 includes three triangular primitives A, B, and C connected together. Each primitive includes three vertices: primitive A has vertices 1, 2, and 3; primitive B has vertices 2, 3, and 4; and primitive C has vertices 3, 4, and 5. API 114 can determine primitive identifiers A, B, and C and the associated vertex identifiers for each primitive identifier. In some examples, API 114 can generate an index table 422 showing the association between each primitive identifier and its associated vertex identifier. API 114 can also generate a vertex table 424 listing the vertex identifiers (e.g., vertices 1, 2, 3, 4, and 5) associated with a command, and optionally vertex data associated with the vertex identifiers. The index table 422 and vertex table 424 for the command can be stored in memory 118. In some cases, the index table 422 and vertex table 424 are stored in a buffer 119 (or cache) of memory 118. Buffer 119 can be a circular buffer.

[0490] Figure 4C An exemplary list 430 of commands transmitted from API 114 to processing device 120 is shown. Figure 4CAs shown, the command list 430 includes several DRAW commands 432. Each DRAW command 432 specifies a command instruction (e.g., DRAW type and count) and an associated vertex (e.g., vertex_ptr) and index (e.g., index_ptr). vertex_ptr can be a vertex identifier associated with the Draw command, and index_ptr can be the association between each primitive and the vertex identifier. For example, for drawing... Figure 4B As shown in Figure 420, the DRAW command 432 can specify: DRAW type as triangle primitive, DRAW count as 3, vertex_ptr as 1, 2, 3, 4, 5, and index_ptr as A (1, 2, 3), B (2, 3, 4), and C (3, 4, 5), such as... Figure 4B As shown in index table 422. In this way, the size of DRAW commands can be very small, and DRAW commands can be transmitted to processing device 120 for high-speed processing.

[0491] API 114 is configured to transmit DRAW command 432 to processing device 120 for further processing. DRAW command 432 can be cached in buffer 119 of memory 118 and then transmitted to processing device 120 via interface 115. Transmitting DRAW command 432 (or command list 430) is more efficient and faster than transmitting primitive data or vertex data corresponding to several primitives of a holographic scene (or one or more objects) from API 114 to processing device 120. Furthermore, vertex_ptr and index_ptr contain information about several primitives within the same DRAW command, enabling processing device 120 to perform parallel processing to increase computational speed.

[0492] 2.2 Processing Equipment Processing device 120 communicates with host device 110 and is configured to generate a hologram corresponding to a holographic scene to be reconstructed based on data transmitted from host device 110. The holographic scene includes one or more objects (e.g., 2D or 3D) in a 3D coordinate system. The data may include information about primitives corresponding to the one or more objects. The hologram corresponds to electromagnetic (EM) contributions from the primitives to display components (or phase units) of display 150. Processing device 120 may be referred to as a phase unit processing unit (PPU). Processing device 120 is configured to compute EM contributions at high speed, for example, through parallel processing, simplified expressions, and / or any other techniques described further in detail below.

[0493] Processing device 120 may include at least one of the following: application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), programmable gate array (PGA), central processing unit (CPU), graphics processing unit (GPU), phased unit processing unit (PPU), or standard computing unit. In some embodiments, processing device 120 communicates with host device 110 via high-speed peripheral component interconnect (PCIe). Interface 115 may be a PCIe slot of host device 110. Processing device 120 may be an integrated chip that can be inserted into a PCIe slot of host device 110. In some embodiments, processing device 120 is configured to be integrated with drive device 130, optionally with display 150 and / or lighting device 140, in a package external to host device 110. Processing device 120 may communicate with host device 110 via a wired or wireless connection (e.g., USB-C connection or any other high-speed cascade connection). In some embodiments, API 114 (and optionally driver 116) may be implemented in processing device 120.

[0494] In some embodiments, the processing device 120 includes a series-coupled command processor 122, local memory 123, a plurality of computing units 124, and at least one accumulator 126. The plurality of computing units 124 may be coupled in parallel (e.g.) for parallel processing. In some embodiments, a group of computing units 124 is coupled in series, and multiple groups of computing units are coupled in parallel to each other. In some embodiments, the processing device 120 includes a plurality of accumulators 126 that are coupled in parallel, and each accumulator 126 is coupled to a corresponding group of computing units 124.

[0495] Command processor 122 communicates with host device 110 (e.g., buffer 119 in memory 118) and is configured to receive commands from host device 110. The command can be... Figure 4C The DRAW command 432 is similar to or identical to this command. This command may include information about multiple primitives corresponding to at least one object. This information may include primitive identifiers for the multiple primitives, vertex identifiers associated with the primitive identifiers, and an index table showing the association between the primitive identifiers and the vertex identifiers. The command may include instructions for drawing the multiple primitives based on the information. As mentioned above, the command may not include primitive data for the multiple primitives or vertex data for the vertices of the multiple primitives.

[0496] Command processor 122 is configured to process commands to identify primitive identifiers or vertex identifiers, and to retrieve primitive data of multiple primitives from host device 110 based on the primitive identifiers or vertex identifiers. For example, command processor 122 may retrieve primitive data of multiple primitives based on the primitive identifiers in the command (e.g., based on...). Figure 4AThe storage table 410) retrieves basic data from memory 118. In some embodiments, the command processor 122 retrieves basic data based on the vertex identifier in the command (e.g., based on...). Figure 4A The vertex data of the vertex is retrieved from the storage table 400.

[0497] In some implementations, objects are represented by a large number of primitives. Drawing objects can be performed via a series of commands, each command being associated with a corresponding group of primitives. In this way, the size of each command can be reduced. The transfer speed for transmitting commands, retrieved primitive data, and / or retrieved vertex data from host device 110 to command processor 122 can be faster. The processing speed of processing device 120 can also be faster.

[0498] In some implementations, as mentioned above, API 114 in host device 110 can decode an object to obtain vertex information of the vertices associated with the object, which can be stored in memory 118 (e.g., in buffer 119). Figure 4A Table 400 in the table) and / or primitive information of primitives associated with the object (e.g., Figure 4B (Table 410). Before sending a command to processing device 120, API 114 may first transmit vertex information of vertices and / or primitive information of primitives (e.g., stored in buffer 119) to processing device 120. Vertex information of vertices and / or primitive information of primitives may be stored in local memory 123. After API 114 sends a command to command processor 122 in processing device 120, command processor 122 may retrieve corresponding index information (e.g., from memory 118 in host device 110) from memory 118. Figure 4B (index table 422) and retrieve the corresponding vertex information from the local memory 123 in the processing device 120 (e.g., in the index ... Figure 4A Table 400 or Figure 4B The API 114 executes commands based on the retrieved index information and the retrieved vertex information (in the vertex table 424). In this way, the API 114 only needs to transmit the index information from the host device 110 to the processing device 120, without transmitting the vertex information, thereby reducing the data transmitted via the interface 115 and increasing the transmission speed.

[0499] Unlike conventional 3D graphics systems that acquire a 3D scene and render it onto a 2D display device, system 100 is configured to generate 3D output (such as holographic reconstruction) in the form of a light field (e.g., a 3D light volume). In the hologram, each display component can contribute to each part of the holographic reconstruction of the scene. Therefore, it is possible to modulate each display component for each part of the scene (e.g., each primitive in the list of primitives generated by application 112) for a complete holographic reproduction of the scene. In some implementations, the modulation of specific components can be omitted or simplified based on, for example, an acceptable level of accuracy in reproducing the scene or in a certain area of ​​the scene, or occlusion.

[0500] In some embodiments, the processing device 120 is configured to calculate the EM field contribution (e.g., phase, amplitude, or both) from each primitive to each display component, and to generate a sum of the EM field contributions from the list of primitives to that display component for each display component. This can be accomplished by iterating through each primitive and accumulating its contribution to a given display component, or by iterating through each display component for each primitive, or by a combination of these two techniques.

[0501] The processing device 120 can calculate the EM field contribution from each primitive to each display component based on a predetermined expression for each primitive. Different primitives may have corresponding expressions. In some cases, the predetermined expression is an analytical expression, as described below. Figures 3A to 3C This will be discussed in further detail. In some cases, a predetermined expression is determined by solving Maxwell's equations with boundary conditions defined at display 150. These boundary conditions may include Dirichlet boundary conditions or Cauchy boundary conditions. The display assembly can then be modulated based on the sum of the EM field contributions, for example, by modulating at least one of the refractive index, amplitude index, birefringence, or retardation of the display assembly.

[0502] If the values ​​of the EM field at each point on the surface defined by the field (e.g., solutions to Maxwell's equations) are known, the precise and unique configuration of the EM field within the volume defined by the boundary surface can be determined. The list of primitives (or a holographic reconstruction corresponding to the hologram) and the display 150 define a 3D space, and the surface of the display 150 forms part of the boundary surface of this 3D space. The boundary conditions of the EM field can be determined by setting the EM field state on the surface of the display 150 (e.g., phase or amplitude, or phase and amplitude states), for example, by illuminating the display surface. Due to the time symmetry of Maxwell's equations, when the display components are modulated based on the EM field contributions from the primitives corresponding to the hologram, the volumetric light field corresponding to the hologram can be obtained as a holographic reconstruction.

[0503] For example, line elements for specific color lighting can be set in front of the display 150. See below for more information. Figure 3BIn further detail, the analytical expression for the linear aperture can be written as a function in space. Next, the EM field contribution from the line primitives on the boundary surface including display 150 can be determined. If an EM field value corresponding to the calculated EM field contribution is set in display 150, the same linear aperture used in the calculation can appear at the corresponding location (e.g., the coordinate position of the linear primitive in the 3D coordinate system) and have a specific color, due to the time symmetry of Maxwell's equations.

[0504] In some examples, such as about Figure 3B To elaborate further, suppose there is a ray of light between two points A and B in 3D space. This ray is uniformly illuminated and the distance between each point is... l It has strength I In each infinitesimal along the line from A to B dl Location, launch and I*dl Proportional light intensity. Infinitesimal. dl It acts as a source of the data (points) and can be determined from infinitesimals. dl The EM field contribution to any point on the boundary surface surrounding the scene corresponding to the primitive list. Therefore, for any display component of display 150, an analytical equation representing the EM field contribution from an infinitesimal segment of the line at the display component can be determined. A special kind of summation / integration along the line, accumulating the EM field contribution of the entire line to the EM field at the display component of the display, can be determined as an expression. A value corresponding to the expression can be set at the display component, for example, by modulating and illuminating the display component. Then, by time reversal and correction constants, a line can be created at the same location defined by points A and B in 3D space.

[0505] refer to Figure 1A After command processor 122 acquires primitive data or vertex data of multiple primitives, it transmits the primitive data or vertex data to multiple computing units 124 for further processing. Computing units 124 are configured to, for each of the multiple primitives, determine the EM field contribution of the primitive to each of the multiple display components of the display 150 in a 3D coordinate system based on the primitive data or vertex data of the multiple primitives. The multiple computing units 124 can operate in parallel. Accumulator 126 is configured to accumulate the EM field contributions of the multiple primitives to each of the multiple display components from the multiple computing units 124, and generate a corresponding sum of the EM field contributions of the multiple primitives to each of the multiple display components. Accumulator 126 can generate a hologram including the corresponding sums of the EM field contributions of the multiple primitives to each of the multiple display components.

[0506] 3D coordinate systems can be, for example, Cartesian coordinates (XYZ), polar coordinates, cylindrical coordinates, or spherical coordinates. This will be discussed further below (e.g., in...). Figure 2 and Figures 3A to 3C In the display 150, multiple display components may also have corresponding coordinate information in a 3D coordinate system. The primitive at the coordinate position may represent a 3D object adjacent to multiple display components (e.g., in front of the display components, behind the display components, or across the display components).

[0507] In some embodiments, the calculation unit 124 is configured to determine at least one distance between the display component and the primitive based on the coordinate information of the display component of the display 150 and the coordinate information of the primitive, and to determine the EM field contribution of the primitive to the display component based on a predetermined expression of the primitive and the at least one distance. The predetermined expression may be determined based on at least one of the following: analytically calculating the EM field propagation from the primitive to the display component, a solution to Maxwell's equations with boundary conditions defined by the display, or at least one function from a group of functions including sine, cosine, and exponential functions, wherein determining the EM field contribution includes identifying the value of the at least one function in a table stored in memory.

[0508] In some implementations, adjacent first and second primitives have at least one shared vertex, for example, such as Figure 4B As shown in the figure. The calculation unit 124 can determine the first EM field contribution of the first primitive to the display component of the display 150 based on the primitive data of the first primitive, and determine the second EM field contribution of the second primitive to the display component of the display based on the first EM field contribution and the primitive data of the second primitive (e.g., by the distance between the coordinates of the first primitive and the second primitive).

[0509] In some embodiments, the computing unit 124 is configured to determine a first EM contribution of a primitive to a first display component of the display 150, and based on the first EM contribution, to determine a second EM contribution of the primitive to a second display component of the display, the second display component being adjacent to the first display component.

[0510] The calculation unit 124 can determine the EM field contribution from a plurality of primitives to the display components of the display 150 in parallel. In some embodiments, the calculation unit 124 is configured to determine the second EM field contribution of a second primitive to the first display component while simultaneously determining the first EM field contribution of a first primitive to the first display component. In some embodiments, the calculation unit 124 is configured to determine the second EM field contribution of a second primitive to a second display component while simultaneously determining the first EM field contribution of a first primitive to the first display component. In some embodiments, the calculation unit 124 is configured to determine the second EM field contribution from the first primitive to the second display component while simultaneously determining the first EM field contribution of the first primitive to the first display component.

[0511] In some embodiments, the calculation unit 124 is configured to determine a first corresponding EM field contribution for each of the plurality of primitives from a first primitive to each of the plurality of display components, and in parallel, to determine a second corresponding EM field contribution for each of the plurality of display components from a second primitive to each of the plurality of display components. The accumulator 126 may be configured to accumulate the EM field contribution for each of the plurality of display components by adding the first corresponding EM field contribution and the second corresponding EM field contribution corresponding to the display component.

[0512] In some embodiments, the processing device 120 is configured to obtain the sum of EM field contributions of the plurality of display components of the display 150 by determining the EM field contribution of each of the plurality of primitives to each of the plurality of display components and pipeline processing that generates the sum of the EM field contributions from the plurality of primitives to each of the plurality of display components.

[0513] Figure 4D An example 440 of pipeline calculation using a phase unit processing unit (e.g., processing device 120) is shown. As mentioned above, processing device 120 obtains the sum of the EM field contributions from multiple primitives to each display component through a series of steps 442. For example, calculating a predetermined expression can be divided into multiple steps. Each line can represent a corresponding series of steps 442 for a corresponding display component. The steps for multiple display components can be executed in parallel.

[0514] like Figure 4DAs shown, after completing the first step for the first display component, a second step for the first display component is executed, while simultaneously executing the first step for the second display component (e.g., based on the result of the first step for the first display component). Next, after both the second step for the first display component and the first step for the second display component are completed, a third step for the first display component is executed, and the second step for the second display component may also be executed (e.g., based on both the result of the second step for the first display component and the result of the first step for the second display component). Simultaneously, a first step for the third display component may be executed (e.g., based on the result of the first step for the second display component and / or the result of the first step for the first display component). In this way, except for calculating the initial delay period, the processing device 120 can perform steps for multiple display components in parallel according to pipeline calculations.

[0515] In some implementations, for example, as discussed in further detail in section 3.3 below, to improve computation speed and / or accuracy, processing device 120 uses fixed-point representation, updated floating-point representation, or a combination thereof to compute one or more mathematical functions.

[0516] In some implementations, processing device 120 calculates the corresponding EM field contribution of each of a plurality of primitives to each of a plurality of display components. This calculation of the corresponding EM field contribution can be performed without at least one of the following: extending the geometry of an object to the plurality of display components; performing a visibility test before packing the wavefront; or decision-making or communication between parallel computations of different primitives of the plurality of primitives. The calculation of the corresponding EM field contribution can be configured to cause at least one of the following: tuning the parallel computation of the plurality of primitives to achieve speed, cost, size, or energy consumption optimization; reducing the latency from the initiation of drawing to the result being ready for display; using fixed-point representation to increase accuracy; skipping the unpacking and repacking of floating-point representations between mathematical calculations; or optimizing computation speed by optimizing mathematical functions.

[0517] After acquiring primitive data or vertex data associated with multiple primitives, the processing device 120 can be configured to adjust the primitive data or vertex data of at least one of the multiple primitives according to a corresponding setting, and calculate the EM field contribution associated with the at least one of the multiple primitives based on the adjusted primitive data or vertex data.

[0518] In some examples, for example, as in Figures 8A to 8FFurther detailed, the processing device 120 adjusts the primitive data or vertex data of at least one of the adjacent primitives to generate a gap between the adjacent primitives such that there are no shared vertices between the adjacent primitives. This gap may be equal to or greater than a preset diffraction limit of the display. The processing device 120 may determine the EM field contribution of at least one of the adjacent primitives based on the adjusted vertex data associated with at least one of the adjacent primitives.

[0519] After obtaining the sum of the EM field contributions of multiple components of display 150, processing device 120 (e.g., accumulator 126) can generate a hologram based on the sum of the EM field contributions. In some examples, the hologram is a complex-valued hologram. Processing device 120 can further convert the complex-valued hologram into a pure amplitude hologram or a pure phase hologram. Processing device 120 can also transmit the complex-valued hologram to driving device 130, which can convert the complex-valued hologram into a pure phase hologram or a pure amplitude hologram.

[0520] In some examples, the hologram is a phase hologram or an amplitude hologram. In some implementations, the hologram is stored in a storage device (e.g., USB). The processing device 120 may also transmit the phase hologram or amplitude hologram to the driving device 130. The driving device 130 may then generate corresponding control signals for modulating a plurality of display components based on the hologram.

[0521] For zero-order suppression of the display, the zero-order light of the display can deviate from the reconstruction cone of the holographic scene formed by the diffracted first-order light from the display. To achieve this, in some embodiments, the processing device 120 can change the hologram used for multiple display components. In some embodiments, instead of the processing device 120, the driving device 130 can change the hologram used for multiple display components after the processing device 120 receives the hologram.

[0522] For example, the hologram can be altered by the processing device 120 or the driving device 130 by adjusting the corresponding phase of each of the plurality of display components. For example, the corresponding phase can be adjusted by adding a corresponding phase to the corresponding phase of each of the plurality of display components.

[0523] In some examples, the corresponding phase of each of the multiple display components can be expressed as: Ø = 2π (xcosθ + ysinθ) / λ , Where Ø represents the corresponding phase of the display component, λ represents the wavelength of the light to be incident on the display component at the incident angle, and θ represents the optical redirection device (e.g., θ) configured to redirect the light from the display 150. Figure 5AThe zero-order redirection grating structure 508-3) has a redirection angle, where x and y represent the coordinates of the display component in a global 3D coordinate system, in which the EM field contribution of each of the multiple display components to the display component is determined. Adding these corresponding phases to the hologram can have the same or similar effect as using a software application (e.g., Unity) to pre-configure the hologram, which includes the construction cone of one or more corresponding virtual objects rotating at the corresponding angle.

[0524] In some examples, the corresponding phase of each of the multiple display components is expressed as follows: , Where Ø represents the corresponding phase of the display component, a and b are constants, and λ represents the wavelength of the light to be incident on the display. f The focal length of the optical diverging component used to diverge light from the display is represented, and x and y represent the coordinates of the display component in a coordinate system in which the EM field contribution of each of a plurality of display components to the display component is determined. Adding these corresponding phases to a hologram can have the same or similar effects as using a software application (e.g., Unity) to pre-configure a hologram, which includes the movement of the construction cone of one or more corresponding virtual objects toward or away from the display 150 such that the zero-order light of the display is diverged by an optical diverging component (e.g., an optical lens) downstream of the display 150.

[0525] In some implementations, instead of adjusting the hologram, the processing device 120 may adjust primitive data or vertex data associated with a plurality of primitives. The adjusted primitive data of the plurality of primitives corresponds to virtual objects that move relative to the display in a global 3D coordinate system. The processing device 120 may then determine the EM field contribution of the primitive to each of the plurality of display components of the display based on the adjusted primitive data of the primitive in the 3D coordinate system.

[0526] In some examples, the primitive data of the adjustment of multiple primitives corresponds to a virtual object rotated relative to the display at an angle in the global 3D coordinate system, and that angle corresponds to an optical repositioning device (e.g., Figure 5A The zero-order redirection grating structure 508-3) has a redirection angle. The optical redirection device is configured to redirect light from the display, such that the light modulated by multiple display components forms a holographic scene, while the display zero-order light from the display is redirected away from the holographic scene.

[0527] In some examples, the adjusted primitive data of multiple primitives corresponds to a virtual object that moves a certain distance relative to the display in a direction perpendicular to the display in the global 3D coordinate system. This distance corresponds to the focal length of an optical diverging component (e.g., an optical lens) configured to diverge light from the display, such that the light modulated by the multiple display components forms a holographic scene without divergence, while the display zero-order light from the display is both diverged and suppressed in the holographic scene.

[0528] In some implementations, the primitive data of a primitive includes the texture coordinate information of that primitive. In some cases, the primitive data obtained from API 114 may include values ​​associated with the discrete cosine transform (DCT) amplitude of pixels of an image on a specified surface of one or more primitives to be mapped to multiple primitives, wherein the DCT amplitude of said pixels of the image is associated with the DCT weights of said pixels of the image. In some cases, after obtaining the primitive data, the processing device 120 may adjust the primitive data to include values ​​associated with the DCT amplitude of pixels of the image. For each of the multiple primitives, the processing device 120 may use said values ​​associated with the DCT amplitude of pixels of the image to calculate the EM field contribution from each of the one or more primitives to each of the multiple display components.

[0529] In some implementations, the primitive data of a primitive includes occlusion information of that primitive. In some examples, processing device 120 may determine one or more specific display components that have not contributed to the reconstruction of a given primitive based on the occlusion information of that primitive. For each of the one or more specific display components, processing device 120 may generate a corresponding sum of the EM field contributions of multiple primitives to that specific display component by excluding the EM field contribution of the given primitive to that specific display component. In some examples, processing device 120 may be configured to: for each of the multiple display components, determine a corresponding portion of the given primitive that has not contributed to the EM field of that display component based on the occlusion information of the given primitive, and generate a sum of the EM field contributions from multiple primitives to that display component by excluding the EM field contribution of the corresponding portion of the given primitive to that display component.

[0530] In some implementations, the primitive data of a primitive includes viewpoint-dependent shading information of that primitive. The processing device 120 may be configured to determine the corresponding EM field contribution of each of a plurality of primitives to each of a plurality of display components by considering the viewpoint-dependent shading information of the primitives.

[0531] In some embodiments, display 150 is a regular display in which a plurality of display components have the same shape and are evenly spaced in the display area (e.g., as described below). Figure 8A(As shown in the diagram). In some embodiments, display 150 is an irregular display, wherein multiple display components form an irregular pattern, for example, having different shapes or sizes and / or being irregularly positioned, for example, as described below. Figure 9A As shown in the image.

[0532] For both regular and irregular displays, the processing device 120 may be configured to acquire information about the display 150, including coordinate information of multiple points corresponding to multiple display components. For each of the multiple primitives, the processing device 120 determines the electromagnetic (EM) field contribution to each of the multiple display components of the display based on the primitive data of the display by calculating the EM propagation from the primitive to the display in a three-dimensional (3D) coordinate system based on the coordinate information of the primitive and the coordinate information of the points corresponding to that display component.

[0533] In some implementations, for an irregularly shaped display, each of the plurality of display components has a corresponding shape of a plurality of shapes within a region of the display, each of the plurality of shapes uniquely surrounding a corresponding point of a plurality of points, and the neighboring shapes of the plurality of shapes being distinct from each other. The coordinate information of the plurality of points includes the coordinate information of a plurality of spaced points within the region of the display and offset data, the offset data including a corresponding offset between each of the plurality of points and a corresponding spaced point of the plurality of spaced points.

[0534] 2.3 Drive Device A driving device 130 is coupled to a processing device 120 and configured to receive a hologram from the processing device 120 (e.g., from an accumulator 126). The hologram is used to modulate a display 150 and may include, for each of a plurality of display components, a corresponding sum of electromagnetic (EM) field contributions from a plurality of primitives corresponding to at least one object to that display component. The driving device 130 may be configured to, for each of the plurality of display components, generate a corresponding modulation control signal (e.g., a voltage signal) based on the corresponding sum of the EM field contributions from the plurality of primitives to that display component, and output the corresponding modulation control signal to each of the plurality of display components to modulate that display component.

[0535] In some implementations, for example, such as Figure 1AAs shown, the driving device 130 includes a driving memory 132 coupled to the processing device 120, an illuminator driver 134 coupled to the driving memory 132 and the illuminator 140, and a display driver 136 coupled to the driving memory 132 and the display 150. The driving memory 132 may include a first storage buffer coupled to the display driver 136 and a second storage buffer coupled to the illuminator driver 134. The second storage buffer may be configured to store information for controlling the amplitude and / or brightness of the light-emitting components in the illuminator 140. The second storage buffer may have a smaller size than the first storage buffer. In some embodiments, the driving memory 132 is included in the local memory 123 of the processing device 120.

[0536] The drive memory 132 is configured to receive and store holograms from the processing device 120. In some cases, the hologram is a pure phase hologram. In some cases, the hologram is a complex-valued hologram. The drive device 130 can convert the complex-valued hologram into a pure phase hologram and generate corresponding modulation control signals for a plurality of display components based on the pure phase hologram. The drive device 130 can also store the pure phase hologram together with the complex-valued hologram in the drive memory 132. The pure phase hologram of the display 150 may include a corresponding phase of each of the plurality of display components of the display 150. The corresponding phase corresponds to the sum of the electromagnetic (EM) field contributions of a plurality of primitives corresponding to at least one object to the display component.

[0537] In some embodiments, the display driver 136 includes a phase converter 137 and a scan output unit 138. The phase converter 137 is configured to convert a corresponding phase of each of a plurality of display components into a corresponding modulation control signal (e.g., a voltage signal), and the scan output unit 138 is configured to transmit the corresponding modulation control signal to the display components. The phase converter 137 can sequentially and continuously convert the corresponding phases of the plurality of display components, and once each corresponding modulation control signal is generated by the phase converter 137, the scan output unit 138 can sequentially and continuously transmit the corresponding modulation control signal to the plurality of display components.

[0538] In some embodiments, a phase converter 137 is included in the processing device 120 and coupled to the accumulator 126. The phase converter 137 can convert a complex-valued hologram from the accumulator 126 into a phase hologram. The phase hologram can be transferred from the processing device 120 to the driving device 130 and can be stored in the driving memory 132 of the driving device 130.

[0539] In some embodiments, both the phase converter 137 and the drive memory 132 are located in the processing device 120, with the drive memory 132 included in the local memory 123 and the phase converter 137 coupled to the accumulator 126 and also coupled to the local memory 123. In this manner, the processing device 120 can directly output a phase hologram to the drive device 130. The drive device 130 may include an illuminator driver 134 and a display driver 136 comprising only a scan output unit 138, which greatly simplifies the drive device 130 and can be integrated with the display 150.

[0540] The display driver 136 and the display 150 can be connected using an interface (e.g., a low-voltage differential signaling (LVDS) interface). The display driver 136 can be configured to use this interface to drive digital signals to the display 150. For example, the digital signal can be a 9-bit digital value, which can be converted into 512 different voltage signals for modulating the display components of the display 150.

[0541] As in Figures 13A to 13C Further detailed, in addition to the display components, the display 150 may also include digital and analog circuitry. The digital circuitry may be configured to receive digital data for modulating the components and optionally perform data processing on the digital phase signals (e.g., to reduce noise in the phase of the display components). The analog circuitry may include a digital-to-analog converter (DAC), a driver, and a row scanner. The DAC is configured to convert digital data from the display components into analog voltage signals. The driver is coupled to the digital circuitry and configured to drive the analog voltage signals to the corresponding display components. The row scanner may be configured to sequentially select a row of display components to modulate that row of display components using the corresponding voltage signals driven by the driver.

[0542] The illuminator driver 134 may be configured to transmit an illumination control signal (e.g., for amplitude and / or brightness control) to the illuminator 140 to activate the illuminator 140 to illuminate the display 150, such that the light is modulated by the display 150's modulation display components to form a volume light field (e.g., a holographic light field 160) corresponding to at least one object. The resulting volume light field corresponds to a solution to Maxwell's equations with boundary conditions defined by the modulation components of the display 150.

[0543] The display driver 136 and the lighting driver 134 can be configured to communicate with each other such that the output of a corresponding modulation control signal to each of the plurality of display components via the display driver 136 and the transmission of lighting control signals to the lighting 140 via the lighting driver 134 are performed in a coordinated manner.

[0544] In some embodiments, the illuminator 140 includes two or more light-emitting components, each configured to emit light of a different color (e.g., red, blue, or green), and the illuminator driver 134 can sequentially transmit corresponding lighting control signals to sequentially activate each of the two or more light-emitting components of the illuminator.

[0545] In some embodiments, the display driver 136 sequentially outputs: i) a first modulation control signal to modulate the display 150 with information associated with a first color during a first time period, and ii) outputs a second modulation control signal to modulate the display 150 with information associated with a second color during a second, sequential time period. The illuminator driver 134 may sequentially output a first illumination control signal to activate the illuminator 140 to turn on a first light-emitting component to emit light of a first color during a first time period, and output a second illumination control signal to activate the illuminator 140 to turn on a second light-emitting component to emit light of a second color during a second time period.

[0546] 2.4 Display Display 150 includes several display components. In some embodiments, display 150 includes a spatial light modulator (SLM). The SLM may be a phase SLM, an amplitude SLM, or a phase and amplitude SLM. In some examples, display 150 is a digital micromirror device (DMD), a liquid crystal on silicon (LCOS) device, an optically addressed spatial light modulator (OASLM), or any other type of light modulator capable of performing holography.

[0547] In some embodiments, display 150 is a regular display in which multiple display components have the same shape and are evenly spaced in the display area (e.g., as described below). Figure 8A (As shown). In some embodiments, the display 150 is an irregular display, wherein multiple display components form an irregular pattern, for example, having different shapes or sizes and / or being arranged irregularly, such as... Figure 9A , Figure 9B , Figure 9E , Figure 9J , Figure 10A or Figure 10B Further details are shown below.

[0548] The display components of the display 150 can be modulated by modulated control signals from the display driver 136. Each modulated control signal modulates the corresponding display component based on the sum of the EM field contributions from multiple primitives corresponding to a scene (e.g., including one or more objects) to the corresponding display component.

[0549] In some embodiments, the number of light-emitting components in illuminator 140 may be less than the number of display components in display 150, provided that light from the light-emitting components can substantially illuminate above the total surface of display 150. For example, an illuminator with 64 x 64 OLEDs (organic light-emitting diodes) can be used in a display with 1024 x 1024 components. Driving device 130 (e.g., illuminator driver 134) may be configured to simultaneously activate several lighting components of illuminator 140.

[0550] The illuminator 140 may include one or more coherent light sources (e.g., lasers), one or more semi-coherent light sources (e.g., LEDs (light-emitting diodes) or superluminescent diodes (SLEDs)), one or more incoherent light sources, or combinations of these light sources. In some embodiments, the illuminator 140 is a monochromatic light source configured to emit substantially monochromatic light (e.g., red, green, yellow, or blue light). In some embodiments, the illuminator 140 includes two or more light-emitting components, such as lasers or light-emitting diodes (LEDs), each configured to emit light of a different color. For example, the illuminator 140 may include red, green, and blue lighting components.

[0551] To display a full-color 3D object, for example, processing device 120 can calculate three or more individual holograms, including at least red, green, and blue colors. That is, at least three EM field contributions from corresponding primitives to display components can be acquired. Display components can be modulated sequentially based on at least three EM field contributions, and illuminators 140 can be controlled sequentially to turn on at least red, green, and blue illumination components. For example, driving device 130 can first transmit a first timing signal to turn on the blue illumination component and transmit a first modulation control signal corresponding to the blue hologram to the display component of display 150. After illuminating the blue hologram on display 150 with blue light for a first time period, driving device 130 can transmit a second timing signal to turn on the green illumination component and transmit a second control signal corresponding to the green hologram to the display component of display 150. After illuminating the green hologram on display 150 with green light for a second time period, driving device 130 can transmit a third timing signal to turn on the red illumination component and transmit a third control signal corresponding to the red hologram to the display component of display 150. After illuminating the red hologram on display 150 with red light during the third time period, the driving device 130 may repeat the above steps. Depending on the temporal coherence of the visual effect in the viewer's eye, the three colors can be combined in that eye to give a full-color appearance. In some cases, the illuminator 140 is turned off during changes in the state of the displayed image (or holographic reconstruction) and turned on after a period of time has elapsed since the effective image (or holographic reconstruction) was presented. This may also depend on the temporal coherence of vision to make the image (or holographic reconstruction) appear stable.

[0552] In some embodiments, the display 150 has a resolution small enough to diffract visible light (e.g., about 0.5 µm or less). The illuminator 140 may include a single white light source and the emitted white light may be diffracted by the display 150 into different colors for use in holographic reconstruction.

[0553] The following text is about Figures 5A to 5D Further details are provided, and different configurations of system 100 may exist. Display 150 may be reflective or transmissive. Display 150 may have various sizes ranging from a small scale (e.g., 1 cm to 10 cm on one side) to a large scale (e.g., 100 cm to 1000 cm on one side). Illumination from illuminator 140 may originate from the front of display 150 (e.g., for reflective or transmissive displays) or from the rear of display 150 (e.g., for transmissive displays). Illuminator 140 may provide uniform illumination across display 150. In some embodiments, optical waveguides may be used to uniformly illuminate the surface of display 150.

[0554] In some embodiments, the illuminator driver 134 and the illuminator 140 are integrated together as a lighting device, and the display driver 136 and the display 150 are integrated together as a display device. The driver memory 132 may be separate from the lighting device and the display device, or the driver memory 132 may be integrated with one of the lighting device and the display device. The lighting device and the display device can communicate with each other.

[0555] In some embodiments, the processing device 120 and the driving device 130 are integrated together as a controller for the display 150 and / or the lighting device 140. In some embodiments, the processing device 120, the driving device 130, and the display 150 are integrated together as a single unit. This single unit may also be integrated with the lighting device 140. This single unit may be arranged (or tiled) in an array to form a larger device.

[0556] In some implementations, the driving device 130, illuminator 140, and display 150 are integrated as a single unit, for example, as a holographic display device. The processing device 120 may be integrated into the host device 110 via, for example, a PCIe slot. As mentioned above, the host device 110 may use a 3D simulation application (e.g., application 112) to generate scene data including information on multiple primitives corresponding to at least one object, and use API 114 to generate primitive data corresponding to the multiple primitives of the at least one object based on the scene data. API 114 may be configured to adjust the initial primitive data of the multiple primitives generated from the scene data to generate primitive data of the multiple primitives, vertex data associated with the multiple primitives, and / or tables and commands, for example, as discussed in detail in Section 2.1.

[0557] In some implementations, such as Figures 5A to 5D As shown, an optical diffraction device (e.g., a field grating device, waveguide device, or light guide device) is coupled between the illuminator 140 and the display 150 and is configured to diffract light from the illuminator 140 into the display 150, which then diffracts the light to the viewer's eye. The optical diffraction device may be positioned adjacent to the display 150, for example, as shown in the image. Figures 5A to 6H As shown.

[0558] In some examples, light from illuminator 140 may be incident on the optical diffraction device from one side at a large angle of incidence, such that illuminator 140 does not obstruct the viewer's view of display 150. In some examples, diffracted light from the optical diffraction device may be diffracted into the display at an almost normal angle of incidence, such that the light illuminates display 150 relatively uniformly and diffracts to the viewer's eye with reduced (e.g., minimized) loss.

[0559] Optical diffraction devices may include those formed on a substrate (e.g., Figure 5A A field grating structure (e.g., on the first side of substrate 508-2) configured to suppress color crosstalk between different colors of light incident on display 150, wherein the field grating structure is located on the first side of substrate 508-2 and is configured to suppress color crosstalk between different colors of light incident on display 150. Figure 5A The field grating structure 508-1), and / or the zero-order redirection structure formed on the second, opposite side of the substrate and configured to suppress zero-order light of the display (e.g., Figure 5A The zero-order redirection grating structure 508-3). In some embodiments, exemplary optical diffraction devices are configured and performed as described in International Application PCT / US2021 / 50271 entitled “Displaying 3D Objects” filed on September 14, 2021, and International Application PCT / US2021 / 50275 entitled “Reconstructing Objects Using Display Zero-Order Light Suppression Technology” filed on September 14, 2021, both of which are commonly owned and are fully incorporated herein by reference.

[0560] In some embodiments, the field grating structure includes at least one optical diffraction device and at least one of one or more color-selective polarizers, or at least one of one or more reflective layers or one or more transmissive layers. In some embodiments, for example, as discussed in further detail in Section 4.5, the field grating structure includes at least one diffraction grating having low diffraction efficiency for light from illuminator 140. This diffraction efficiency may be below a predetermined threshold, for example, 20%, 15%, or 10%.

[0561] In some embodiments, a coupling device is disposed between the illuminator 140 and an optical diffraction device (e.g., a field grating structure). The illuminator 140 may emit light of multiple different colors. The coupling device may be configured to receive the multiple different colors of light from the illuminator 140 and output the multiple different colors of light to the optical diffraction device.

[0562] In some implementations, for example, such as Figures 6E to 6G Further detailed, the coupling device includes: a prism assembly disposed between the illuminator 140 and the optical diffraction device and configured to receive multiple different colors of light from the input surface of the prism assembly; one or more extended gratings adjacent to the exit surface of the prism assembly, each of the one or more extended gratings being configured to extend the beam profile of different corresponding colors of light by a factor in at least one dimension; and one or more reflectors downstream of the one or more extended gratings, each of the one or more reflectors being configured to reflect light of a corresponding color into the optical diffraction device, wherein the tilt angle of each of the one or more reflectors can be independently adjusted to make the diffraction from the optical diffraction device to the display 150 uniform.

[0563] In some embodiments, the optical diffraction device (e.g., a field grating structure) is positioned facing the display surface along a direction perpendicular to the display surface of the display 150. In some embodiments, the coupling device is configured to couple multiple different colors of light from the bottom or top surface of the self-coupling device to the optical diffraction device (e.g., the field grating structure), for example, as described in Section 4.2 and... Figure 6A This will be discussed in further detail. In some embodiments, the coupling device is configured to couple multiple different colors of light from the side surface of the self-coupling device to an optical diffraction structure (e.g., a field grating structure), for example, as described in Section 4.3 and... Figures 6B to 6G This will be discussed in further detail later.

[0564] In some implementations, for example, as described in section 4.4 and Figure 6H Further detailed, a plurality of optical devices disposed between the illuminator 140 and the display 150 may be configured for dispersion compensation. For example, at least one first optical device (e.g., a diffraction grating) is configured to cause positive optical dispersion of light incident on the display, and at least one second optical device (e.g., another diffraction grating) may be configured to cause negative optical dispersion of the light, which has a spectral bandwidth and a peak wavelength. The positive and negative optical dispersions can compensate for each other, such that the holographic scene reconstructed from the light has little or no optical dispersion.

[0565] 2.5 Exemplary System for 3D Display Figure 1BAn exemplary system 170 for 3D display (e.g., displaying objects in 3D space) is shown. System 170 may include a computing device (e.g., Figure 1A The host device 110, optionally having Figure 1A Processing device 120) and holographic display device 172 (e.g., Figure 1A The holographic display 150, optionally featuring Figure 1A Processing equipment 120 and / or Figure 1A The user can operate the system 170 using an input device (e.g., keyboard 174 and / or mouse 176). For example, the user can create CG models of 2D objects 178 and 3D objects 180 using the computing device. The computing device or holographic display device 172 may include, for example, a drive device 130. Figure 1A The processing device 120 implements a holographic renderer to render CG models to generate corresponding graphic data for 2D objects 178 and 3D objects 180. The graphic data may include corresponding primitive data corresponding to the primitive lists of objects 178 and 180.

[0566] The holographic display device 172 may include a processing device (e.g., Figure 1A Processing device 120), drive device (e.g., Figure 1A The drive device 130) and the display 173 (e.g., Figure 1A The processing device can calculate the corresponding sum of the EM field contributions of each display component from the primitive to the display 173, and generate control signals for modulating each display component based on the corresponding sum of the EM field contributions. The holographic display device 172 may further include an illuminator (e.g., Figure 1A (Illuminator 140). The driving device can generate a timing control signal to activate the illuminator. When light from the illuminator illuminates the surface of the display 173, the modulation display components can cause the light to propagate in 3D space to form a volume light field corresponding to the holographic reconstruction of the 2D view of object 178 and the holographic reconstruction of the 3D object 180. Therefore, the 2D view of object 178 and the 3D holographic reconstruction of object 180 are displayed as corresponding holographic reconstructions floating in front of, behind, or across the display 173 in 3D space.

[0567] In some embodiments, the computing device transmits non-primitive data (e.g., recorded light field video) to the holographic display device 172. The holographic display device 172 can calculate and generate corresponding holograms (e.g., a series of sequential holograms) to display as corresponding holographic reconstructions in 3D space. In some embodiments, the computing device transmits both CG holographic content and live holographic content to the holographic display device 172 simultaneously. The holographic display device 172 can also calculate and generate corresponding holograms to display the content as corresponding holographic reconstructions in 3D space.

[0568] 3. Electromagnetic (EM) Calculation 3.1 EM Field Contribution of the Primitive Elements Figure 2 An exemplary configuration 200 for electromagnetic (EM) field calculation is shown. A display 202 (e.g., an LCOS device) including an array of display components 204 and a list of primitives including point primitives 206 are both in a 3D space 208. The 3D space 208 includes a boundary surface 210. In the 3D coordinate system XYZ, the point primitives 206 have coordinate information (x, y, z). Each display component 204 is located in a flat plane relative to the other display components 204 and has a 2D position (u, v). The display components 204 also have a position in the 3D space. Through mathematical point transformation, the 2D position (u, v) can be transformed into six coordinates 250 in the 3D coordinate system. That is, the surface of the display 202 forms part of the boundary surface 210. Therefore, the EM field contribution from the list of primitives to the display components, calculated by defining boundary conditions at the surface of the display 202, represents a portion of the total EM field contribution from the primitives to that display component. The scaling factor (e.g., 6) can be multiplied by the sum of the EM field contributions of each display component to obtain the sum of the scaling of the field contributions, and the display component can be modulated based on the sum of the scaling of the field contributions.

[0569] Primitives can be used for computer graphics rendering. The various types of primitives in computer graphics, as disclosed in this document, correspond to discrete mathematical functions that define a single holographic primitive added to a graphical element of a hologram. Each type of primitive may correspond to an expression used to calculate the EM field contribution to the display components. Primitives can be point primitives, line primitives, or polygonal primitives (e.g., triangle primitives). As shown below, analytical expressions can be derived by calculating the EM field propagation from the corresponding primitive to the display components of the screen.

[0570] 3.2 Calculation of the basic unit Figure 3A An exemplary EM propagation from point primitive 304 to display component 302 of display 300 is illustrated. In the 3D coordinate system XYZ, it is assumed that the z-coordinate is 0 across display 300, meaning that negative z-values ​​are behind display 300 and positive z-values ​​are in front of display 300. Point primitive 304 has coordinates (x, y, z), and display component 302 has coordinates (u, v, 0). The distance d between point primitive 304 and display component 302 is... uv It can be determined based on their coordinates.

[0571] Point element 304 can be considered as a point charge with time-varying amplitude. According to electromagnetic theory, the electric field E generated by this point charge can be expressed as: , in λ This indicates the wavelength of the EM wave, and d This indicates the distance from the point charge.

[0572] Therefore, the electric field E at the display component (u,v) u,v This can be expressed as: , in I This represents the relative intensity of the holographic primitive electric field contributed by the self-point primitive 304 at the display component.

[0573] As mentioned above Figure 2 As discussed, the surface of the display 300 only forms a portion of the boundary surface of the EM field. The electric field E... u,v Apply scaling factor To obtain the scaled electric field at the display component, adjusted for partial boundaries as follows. : , in .

[0574] Figure 3B An example of EM propagation from line element 306 to display component 302 of display 300 in a 3D coordinate system XYZ is shown. As mentioned above, display component 302 may have coordinates (u, v, 0), where z=0. Line element 306 has two endpoints, P0 with coordinates (x0, y0, z0) and P1 with coordinates (x1, y1, z1). The distance d0 between endpoint P0 and display component can be determined based on its coordinates. Similarly, the distance d1 between endpoint P1 and display component can be determined based on its coordinates. The distance d between the two endpoints P0 and P1 can also be determined. 01 For example, d 01 =d1-d0.

[0575] As discussed above, the line primitive can be viewed as a superposition or linear deformation, and the corresponding analytical expression of this line primitive as a linear aperture can be obtained as a distributed delta function in space. This analytical expression can be a closed expression of continuous 3D line segments as a hologram.

[0576] Figure 3CAn exemplary EM propagation from triangle primitive 308 to display component 302 of display 300 in a 3D coordinate system XYZ is illustrated. As mentioned above, display component 302 may have coordinates (u, v, 0), where z = 0. Triangle primitive 308 has three endpoints: P0 (x0, y0, z0), P1 (x1, y1, z1), and P2 (x2, y2, z2). The distances d0, d1, and d2 between the display component and endpoints P0, P1, and P2 can be determined based on their respective coordinates.

[0577] Similar to Figure 3B In the model, the line primitives and triangular primitives can be considered as continuous apertures in space, and the analytical expression for the contribution of the triangular primitives to the EM field of the display components can be obtained through integration. This can be simplified to obtain an expression for efficient calculation.

[0578] As discussed above, processing equipment (e.g., Figure 1A The processing device 120 can calculate the EM field contribution from the primitive to the display component based on an analytical expression that can be determined as shown above. As an example, the EM field contribution of the line primitive is calculated as follows.

[0579] Each display component in a monitor has a physical location in space, and each display component lies in a flat plane relative to other display components. Assuming that the display components and their controllers are arranged according to conventions in display and memory devices, a simple mathematical point transformation can be used to transform the logical location of a given display component based on its logical memory address in the processor into its actual physical location in space. Therefore, as the logical memory address of a display component cycles through the processor's logical memory space, the corresponding actual physical location in space across the surface of the monitor can be identified.

[0580] As an example, if the display has a 5 µm pixel pitch in both the x and y directions, then each logical address increment can move 5 µm in the x direction, and when the display's x resolution limit is reached, the next increment will move back to the initial x physical position and increase the y physical position by 5 µm. It can be assumed that the third spatial coordinate z spans the display surface to be zero, meaning that negative z values ​​are behind the display and positive z values ​​are in front of the display.

[0581] To begin the line calculation, the scaled entity distances between each of the two points of the current display component and the line primitive can be defined as d0 and d1. In fact, since each subsequent calculation of the distance across the display component is a small perturbation of the initial value, d0 and d1 can be calculated once per primitive. In this way, the calculation is performed in one dimension.

[0582] The calculation program is orders of magnitude simpler and faster than the most efficient line drawing routines in conventional 2D display technologies. Furthermore, this calculation algorithm scales linearly with the number of display components. Therefore, the scaling calculation unit, acting as the controller of the 2D network link processing system, can keep up with the computational demands of the increasing surface area of ​​the display.

[0583] 3.3 Calculation Implementation Method Maxwell holographic phase unit computational unit (PPU) (e.g., Figure 1A The processing device 120 can calculate the EM field contribution from the primitive to the display component based on an analytical expression that can be determined as shown above. The PPU can be implemented, for example, in an ASIC, FPGA, or GPU, or any combination thereof.

[0584] In modern GPU or PPU pipelines, the GPU or PPU generates color and depth pixel outputs for one or more output image surfaces (called rendering targets) using geometric features and descriptions of vertex and fragment shader procedures. This procedure involves an explosive fan-out of information, where the geometry is expanded into shaded fragments, followed by a visibility test to select whether work needs to be done on each of these fragments. A fragment is a record containing all the information involved in shading sample points (e.g., centroid coordinates of triangles, interpolated values ​​(such as color or texture coordinates), surface derivatives, etc.). The procedure of creating these records and then discarding those that do not contribute to the final image is called the visibility test. Fragments that pass the visibility test are packaged into workgroups called wavefronts or warps, which are executed in parallel by the shader engine. These generation efforts are written back to memory as pixel values ​​in preparation for display or used as output values ​​for input textures in later rendering passes.

[0585] At Maxwell Hollography ® In Maxwell holographic computation, the rendering process can be greatly simplified. Each primitive contributes to each display component in Maxwell holographic computation. There is no need to extend geometry to pixels or perform visibility tests before packing wavefronts. This also eliminates the need for decision-making or communication between Maxwell holographic pipelines and allows computation to become a parallel problem with many possible solutions, each tuned for speed, cost, size, or energy optimization. The graphics pipeline is significantly shorter, with fewer intermediate steps, no data copying or movement, and fewer decisions, resulting in lower latency between the initial drawing and the result being ready for display. This allows Maxwell holographic rendering to create extremely low-latency displays. As discussed below, this allows Maxwell holographic computation to increase accuracy, for example, by using fixed-point numbers or a newer floating-point system in the Maxwell holographic pipeline, and to optimize computation speed, for example, by optimizing mathematical functions.

[0586] 3.3.1 Using fixed-point numbers When calculating the EM contribution from each primitive at each display component (or "phase unit"), intermediate calculations involve generating very large numbers. These large numbers require special handling because they also need to retain their fractional parts during the calculation.

[0587] For floating-point values, accuracy is highest near the origin (zero on the number line), and one bit of accuracy is lost for every two powers as the value moves away from the origin. For numbers close to the range [-1, 1], floating-point accuracy can be high, but once numbers reach tens of millions—for example, the point where a single-precision 32-bit IEEE-754 floating-point value has no remaining decimal places—the entire significant digit (also known as the mantissa) is used to represent the integer part of the value. However, MAXWELL HOLOGRAPHY® is particularly interested in preserving the fractional part of large numbers.

[0588] In some cases, mathematical functions are computed using at least one of fixed-point or floating-point representation. Fixed-point numbers are used in some instances in Maxwell's holographic computations. A fixed-point number is a number whose decimal point does not change regardless of the context. By choosing the correct number of digits for the integer and fractional parts of the number, the same number of decimal places can be obtained, regardless of the magnitude of the number. A fixed-point number is represented as an integer with an implicit scaling factor; for example, 14.375 can be represented as the number 3680 in a 16-bit fixed-point value with 8 decimal places (binary 0000111001100000). This can also be represented as an "unsigned 16.8" fixed-point number, or simply u16.8. Negative numbers can have an extra sign bit and be stored in "2s complement" format. This greatly improves the accuracy of calculations.

[0589] 3.3.2 Use a newer floating-point system In holographic phase calculations, dividing a "normal-sized" number by a very small value produces a maximum value. On a GPU or PPU in floating-point, this result is large enough to force the number representation to begin losing decimal places, since floating-point numbers have a fixed bit budget to represent values. As the size of the number increases, fewer and fewer bits are allocated to the fractional part, until eventually zero bits are assigned to the value below the decimal point.

[0590] In some implementations, the updated floating-point system performs more accurately and efficiently than both conventional floating-point and fixed-point systems. In the updated floating-point system, the sine / cosine of the large value is obtained immediately after the large value calculation. To achieve this, all integer multiples of Pi are removed before continuing to retain only the decimal part. This procedure is called "range reduction." In effect, sin(pi*x) is calculated as a function sinpi(x) and the angle "x" is formulated such that it is pre-multiplied by pi. This transforms range reduction into removing only the integer part of the number and retaining only the decimal part below the decimal point. For example, sinpi(256824.456029) can be calculated as a function of sinpi(0.465029).

[0591] Using fixed-point values ​​with a fixed number of decimal places requires carrying a large number of redundant bits. Formulating numerical recursion using mathematical calculations allows for the generation of decimal places as needed. The algorithms for division and square roots are essentially floating-point algorithms.

[0592] In newer floating-point systems, techniques for implementing "application-specific arithmetic" can bypass the unpacking and repacking of IEEE-754 floating-point values ​​between mathematical calculations. Instead, parts of the numbers and explicit markings describing the representation of the numbers are swapped. The following shows a comparison between the Floating-Point Unit (FPU) central algorithm and application-specific arithmetic algorithms.

[0593] 3.3.3 Optimization of Mathematical Functions As shown above, Maxwell's holographic computation involves the use of transcendental mathematical functions, such as sine, cosine, arctangent, etc. In a CPU, these functions are implemented as floating-point library functions that can be used with dedicated CPU instructions, or as floating-point units within a PPU or GPU. These functions are written to treat these parameters as floating-point numbers and return the results in the same floating-point representation. These functions are constructed for the general case, to be accurate where floating-point numbers are accurate, to properly round down, and to handle all edge cases in the floating-point representation (+ / - infinity, NaN, signed zero, and non-normal floating-point numbers).

[0594] In Maxwell's holographic computation, fixed-point representation eliminates the need for asymptotic underflows from non-regular floating-point numbers, avoids handling NaN results from calculations such as division by zero, eliminates the need to change floating-point rounding modes, and avoids causing floating-point exceptions in the operating system. All of this allows for simplification (and / or optimization) beyond mathematical functions, as discussed below, for example.

[0595] In some cases, optimizations can be made to take a parameter in a fixed-point format and return that value with different levels of accuracy; for example, input s28.12 and output s15.14. This can be particularly desirable when calculating the sine of a large value in the range of ten parts per million, where the input parameter can be large but the output only needs to represent the value range [-1, 1], or take any value but return the arctangent in the range [-π / 2, π / 2].

[0596] In some cases, depending on the range of inputs involved, optimizations can be made to freely implement the transcendental function as a fully enumerated lookup table, an interpolation table, a semi-table-based polynomial function, or a semi-table-based fully minimax polynomial. This optimization also allows for the application of specialized range-shaving methods for handling large inputs, which can be skipped by general-purpose GPU pipeline computations due to speed considerations.

[0597] In some cases, another optimization can be to transform the trigonometric calculations from the range [-π, π] to the signed 2's complement representation in the range [-1, 1], which has the advantage of not requiring expensive modulo 2π division calculations.

[0598] 3.3.4 Exemplary Procedure Figure 4E A flowchart of an exemplary procedure 450 for calculating the EM field contribution from the primitive to the display component. This procedure can be performed via a processing device (e.g., Figure 1A The processing equipment 120) is used for execution.

[0599] In step 452, the processing device acquires information about a plurality of primitives corresponding to at least one object, wherein the information includes corresponding primitive identifiers for the plurality of primitives. In step 454, the processing device acquires primitive data of the plurality of primitives based on the information about the plurality of primitives.

[0600] In some implementations, the processing device originates from the computing device (e.g., Figure 1A The host device 110 receives a command. This command includes information about multiple primitives, but does not have primitive data for the multiple primitives. The command may include instructions for drawing the multiple primitives based on the information about the multiple primitives. The processing device may receive primitive data for the multiple primitives from the computing device, wherein the primitive data and corresponding primitive identifiers of the multiple primitives are associated and stored in the computing device (e.g., ...). Figure 4A In Table 410).

[0601] Each of the multiple primitives includes one or more vertices, and the primitive data of a primitive may include vertex data of those one or more vertices. Information about the multiple primitives may include: for each of the multiple primitives, one or more vertex identifiers of the one or more vertices, and the association between the primitive identifiers of that primitive and the one or more vertex identifiers of the one or more vertices of that primitive, for example, as in... Figure 4B It is shown in index table 422.

[0602] Multiple primitives comprise multiple vertices. A processing device can retrieve vertex identifiers from memory (e.g., based on the vertex identifiers of the multiple vertices of the multiple primitives) from memory. Figure 1A The memory 118 retrieves primitive data of multiple primitives. This primitive data may include corresponding vertex data for each vertex of the multiple vertices, and the memory stores vertex data of multiple vertices associated with vertex identifiers of the multiple vertices (e.g., ...). Figure 4A Table 400).

[0603] In some implementations, the corresponding vertex data of a vertex includes at least one of the following: a vertex identifier of the vertex, coordinate information of the vertex in a 3D coordinate system, color information associated with the vertex, texture coordinate information associated with the vertex, viewpoint-related shading information associated with the vertex, or occlusion information associated with the vertex.

[0604] In step 456, for each of the plurality of primitives, the processing device determines the display (e.g., based on the primitive data of that primitive) Figure 1A The electromagnetic (EM) field contribution of each of the plurality of display components of the display 150. In step 458, for each of the plurality of display components of the display, the processing device generates the sum of the EM field contributions of the plurality of primitives to that display component.

[0605] In some implementations, the plurality of primitives includes a first primitive and a second primitive that are adjacent to each other. The first primitive and the second primitive have at least one shared vertex. The processing device can determine a first EM field contribution of the first primitive to the display component of the display based on primitive data of the first primitive, and determine a second EM field contribution of the second primitive to the display component of the display based on the first EM field contribution and primitive data of the second primitive.

[0606] In some implementations, the processing device adjusts vertex data associated with at least one of the first or second primitives to generate a gap between the first and second primitives such that there are no shared vertices between them. This gap may be equal to or greater than a preset diffraction limit of the display. The processing device may determine the EM field contribution of at least one of the first or second primitives based on the adjusted vertex data associated with at least one of the first or second primitives.

[0607] In some implementations, for each of a plurality of primitives, the processing device determines at least one distance between the display component and the primitive in a three-dimensional (3D) coordinate system based on the coordinate information of the display component and the coordinate information of the primitive, and determines the EM field contribution of the primitive to the display component based on a predetermined expression of the primitive and the at least one distance. The predetermined expression may be determined based on at least one of the following: analytically calculating the EM field propagation from the primitive to the display component, a solution to Maxwell's equations with boundary conditions defined by the display, or at least one function from a group of functions including sine, cosine, and exponential functions, wherein determining the EM field contribution includes identifying the value of at least one function in a table stored in memory.

[0608] In some embodiments, the processing device determines a first corresponding EM field contribution for each display component from a first primitive of a plurality of primitives to a plurality of display elements; determines a second corresponding EM field contribution for each display component from a second primitive of a plurality of primitives to a plurality of display elements; and accumulates the EM field contribution for each display component of the plurality of display elements by adding the first corresponding EM field contribution and the second corresponding EM field contribution corresponding to the display element. The determination of the first corresponding EM field contribution for each display component from the first primitive to the plurality of display elements is performed in parallel with the determination of the second corresponding EM field contribution for each display component from the second primitive to the plurality of display elements.

[0609] In some implementations, for each of a plurality of primitives, the processing device determines the electromagnetic (EM) field contribution to each of a plurality of display components of the display based on primitive data of the display by at least one of the following: determining the second EM field contribution of a first primitive to the first display component while determining the first EM field contribution of a first primitive to the first display component; determining the second EM field contribution of a second primitive to the second display component while determining the first EM field contribution of a first primitive to the first display component; or determining the second EM field contribution from the first primitive to the second display component while determining the first EM field contribution of the first primitive to the first display component.

[0610] In some implementations, the processing device obtains the sum of the EM field contributions of the plurality of display components to the display by pipeline processing that determines the EM field contribution of each of the plurality of primitives to each of the plurality of display components and generates the sum of the EM field contributions from the plurality of primitives to each of the plurality of display components, for example, as... Figure 4D As shown in the image.

[0611] In some embodiments, the processing device generates a hologram corresponding to an object, and the hologram includes the sum of the EM field contributions of a plurality of display components of the display. The hologram may be a complex-valued hologram. In some embodiments, the processing device converts the complex-valued hologram into a pure phase hologram. In some embodiments, the hologram is a phase hologram or an amplitude hologram. The processing device may store the hologram in a storage device and / or transmit the hologram to a driving device of the display (e.g., Figure 1A (Drive device 130).

[0612] In some implementations, the processing device alters the hologram by adjusting the corresponding phase of each of the plurality of display components (e.g., adding the corresponding phase to the corresponding phase of each of the plurality of display components).

[0613] In some embodiments, the processing device is configured to: after acquiring primitive data of a plurality of primitives, adjust the primitive data of the plurality of primitives, wherein the adjusted primitive data of the plurality of primitives corresponds to a virtual object moving relative to the display in a global 3D coordinate system. For each of the plurality of primitives, the processing device may determine the EM field contribution of that primitive to each of the plurality of display components of the display based on the adjusted primitive data of that primitive in the 3D coordinate system. In some embodiments, the adjusted primitive data of the plurality of primitives corresponds to a virtual object rotating relative to the display in a global 3D coordinate system at an angle. This angle corresponds to the redirection angle of an optical redirection device configured to redirect light from the display such that the light modulated by the plurality of display components forms a holographic scene, while the display zero-order light from the display is redirected away from the holographic scene.

[0614] In some implementations, the adjusted primitive data of the plurality of primitives correspond to a virtual object that moves relative to the display in a direction perpendicular to the display in a global 3D coordinate system at a distance corresponding to the focal length of an optical diverging component configured to diverge light from the display such that light modulated by the plurality of display components forms a holographic scene without divergence, while display zero-order light from the display is diverged and suppressed in the holographic scene.

[0615] In some implementations, the processing device uses at least one of fixed-point representation or floating-point representation to compute one or more mathematical functions, for example, as discussed in detail in section 3.3.

[0616] In some implementations, the processing device acquires information about the display, wherein the information about the display includes coordinate information of multiple points corresponding to multiple display components. For each of the multiple primitives, the processing device calculates the EM propagation from the primitive to the display in a three-dimensional (3D) coordinate system based on the coordinate information of the primitive and the coordinate information of the point corresponding to the display component.

[0617] 4. Holographic display system 4.1 Exemplary System Settings Systems used for 3D displays can have reflective or transmissive displays with front illumination, back illumination, waveguide illumination, or optical diffraction illumination. (For illustrative purposes,...) Figures 5A to 5D An implementation of an exemplary system for 3D display using optical diffraction illumination is shown. Any of the systems may correspond to (for example) Figure 1A System 100. Figure 5A and Figure 5B It demonstrates the use of a transmission grating structure ( Figure 5A ) and reflective grating structure ( Figure 5B An exemplary system for a reflective display that performs optical diffraction illumination. Figure 5C and Figure 5D It demonstrates the use of a reflective grating structure ( Figure 5C ) and transmission grating structure ( Figure 5D An exemplary system for a transmission display that performs optical diffraction illumination.

[0618] Figure 5A A system 500 for 3D display is shown, including a reflective display 504 employing optical diffraction illumination (e.g., using an optical diffraction device 508). The optical diffraction device 508 can be considered a light guide (or waveguide) device for guiding light. The optical diffraction device 508 can be a structure based on a transmission field grating, which may include one or more transmission holographic gratings. The reflective display 504 can be... Figure 1A The display 150. In some examples, the reflective display 504 is a reflective LCOS device.

[0619] Controller 502 can be configured to control computer 501 (e.g., Figure 1A The host device 110 receives graphic data corresponding to one or more objects, performs calculations on the graphic data, and / or generates control signals for modulation and passes them through a storage buffer 503 (e.g., Figure 1A The memory 132) is transmitted to the display 504. The controller 502 may also be coupled to the lighting 506 (e.g., Figure 1A The illuminator 506 is configured to provide a timing signal to activate the illuminator 506 to provide light. In some embodiments, the controller 502 includes a processing device (e.g., Figure 1A The processing equipment 120) and the drive equipment (e.g., Figure 1A (Driver device 130). In some embodiments, the controller 502 includes a drive device, and the processing device is integrated into the computer 501.

[0620] Light is diffracted by optical diffraction device 508 to incident on display 504 and then diffracted by display 504 to form a holographic light field 509 corresponding to one or more objects. Display 504 may include a rearview mirror on the back of display 504 that can reflect light toward the viewer. Optical diffraction device 508 may be optically transparent. Illuminator 506 may be located below display 504, which allows illuminator 506 to be mounted or housed with other components of system 500 and located below the viewer's line of sight.

[0621] Bragg selectivity allows off-axis illumination light to diffract from optical diffraction device 508 toward display 504, while the returning light diffracted from display 504 can approach the axis and thus deviate from the Bragg grating in optical diffraction device 508, and therefore pass almost perfectly through optical diffraction device 508 to the viewer without being diffracted again by the grating in optical diffraction device 508. In some embodiments, light from illuminator 506 can be incident on optical diffraction device 508 from one side of display 504 at a large angle of incidence, such that illuminator 506 does not obstruct the viewer's field of view and does not intrude into holographic light field 509. The angle of incidence can be a positive or negative angle relative to the normal of display 504. For illustration, the angle of incidence is presented as a positive angle. For example, the angle of incidence can be in the range of 70 degrees to 90 degrees, for example, in the range of 80 degrees to 90 degrees. In a particular example, the angle of incidence is 84 degrees. Diffracted light from optical diffraction device 508 can be incident and diffracted into display 504 near normal, allowing the light to uniformly illuminate display 504 and diffract back to the viewer's eye almost normally through optical diffraction device 508, thereby minimizing power loss due to unintended reflection, diffraction, and / or scattering within or at the surface of optical diffraction device 508. In some examples, the diffraction angle from optical diffraction device 508 to reflective display 504 can be in the range of -10° (or 10 degrees) to 10° (or 10 degrees), for example, from -7° to 7°, or from 5° to 7°. In a particular example, the diffraction angle is 6°. In another example, the diffraction angle is 0°.

[0622] In some implementations, such as Figure 5AAs shown, an optical diffraction device 508 (e.g.) is disposed in front of a reflective display 504 along the Z direction toward the viewer. The optical diffraction device 508 may include a field grating structure 508-1 located on a substrate 508-2. The back surface of the field grating structure 508-1 faces the front surface of the reflective display 504, and the front surface of the field grating structure 508-1 is attached to the substrate 508-2. Light from the illuminator 506 can pass through the substrate 508-2 (e.g., from the side surface of the substrate 508-2) and be incident on the front surface of the field grating structure 508-1. For example, the substrate 508-2 may have a wedge-shaped side surface, such that light at large incident angles has low reflection loss.

[0623] If the diffraction efficiency of the diffraction structure (e.g., a holographic grating) is less than 100%, light incident at the angle of incidence can be diffracted by the diffraction structure into zero-order and first-order light. First-order light (or first-order beam) is diffracted by the diffraction structure at a diffraction angle toward the display to be diffracted again in the display to reconstruct the holographic light field 509. The first order can also be referred to as the first diffraction order. Zero-order light (or zero-order beam, or non-diffractive beam, or non-diffractive order) is not diffracted (or deflected) by the diffraction structure and is transmitted by the diffraction structure at an angle corresponding to the angle of incidence. For example, when zero-order light is incident directly on the reflective display 504, or after reflection from a surface within the optical diffraction device 508, zero-order light can cause unintended effects (such as ghosting).

[0624] To eliminate unintended effects, the field grating structure 508-1 may be spaced from the display 504. In some embodiments, the back surface of the field grating structure 508-1 is spaced from the front surface of the display 504 by a certain gap. This gap may have any suitable distance (e.g., 1 mm). This gap may be filled with air or any material with a lower refractive index to satisfy total internal reflection (TIR) ​​at the interface. For example, air has a refractive index much lower than that of the back layer of the field grating structure 508-1 (e.g., n≈1.5) (e.g., n≈1.0), and therefore any residual light at the incident angle (e.g., >70°) can be totally internally reflected by the back surface of the field grating structure 508-1 when the incident angle is greater than the critical angle (e.g., for n≈1.5, the critical angle is ≈41.8°). That is, the residual light at the incident angle cannot reach the reflective display 504 to cause unintended effects. In some examples, at least one of the front surface of the reflective display 504 or the back surface of the field grating structure 508-1 is treated with an anti-reflective coating. This anti-reflective coating can substantially reduce a portion of the holographic light field reflected from the back of the field grating structure 508-1 back towards the reflective display 504, which could otherwise cause further ghosting. In some examples, the back surface of the field grating structure 508-1 may be protected by an additional layer (e.g., a glass layer).

[0625] In some embodiments, instead of using gaps to separate the back surface, the back surface of the field grating structure 508-1 can be attached to the front surface of the reflective display 504 using an intermediate layer. This intermediate layer can be an optically transparent adhesive (OCA) layer with a refractive index substantially lower than that of the back layer of the field grating structure 508-1, allowing total inte...

Claims

1. A computer-implemented method for manipulating data of a plurality of primitives corresponding to at least one object, the data comprising primitive data of each primitive of the plurality of primitives, a primitive comprising at least one vertex, the primitive data of the primitive comprising data of the at least one vertex, the computer-implemented method comprising: for each of a plurality of vertices of the plurality of primitives, associating a respective vertex identifier of the vertex with respective vertex data of the vertex, and storing the association between the respective vertex identifier of the vertex and the respective vertex data in a memory; and for each of the plurality of primitives, associating a respective primitive identifier of the primitive with one or more respective vertex identifiers of one or more vertices of the primitive in the memory, and storing the association between the respective primitive identifier of the primitive and the one or more respective vertex identifiers in the memory. 2.The computer-implemented method of claim 1, further comprising: determining primitive identifiers of a plurality of primitives associated with a command instruction; determining vertex identifiers associated with the primitive identifiers; and transmitting a command comprising the command instruction, the vertex identifiers associated with the primitive identifiers, and the primitive identifiers of the plurality of primitives to a processing device, optionally, wherein the command instructs rendering of the plurality of primitives according to the command instruction and based on at least one of the primitive identifiers of the plurality of primitives or the vertex identifiers associated with the primitive identifiers, optionally, wherein the computer-implemented method further comprises at least one of: determining the respective vertex identifiers of the plurality of vertices based on an order of the plurality of vertices in a vertex stream corresponding to the plurality of primitives, or determining the respective primitive identifiers of the plurality of primitives based on an order of the plurality of primitives in a primitive stream corresponding to the at least one object.

3. The computer-implemented method of claim 1 or 2, wherein, the at least one object comprising a representative object in a three-dimensional (3D) simulation application configured to generate the data of the plurality of primitives, wherein the computer-implemented method further comprises obtaining the data of the plurality of primitives from the 3D simulation application.

4. The computer-implemented method of any of claims 1 to 3, wherein, the respective vertex data of the vertex comprising at least one of: a vertex identifier of the vertex, coordinate information of the vertex in a 3D coordinate system, color information associated with the vertex, texture coordinate information associated with the vertex, view-dependent shading information associated with the vertex, shading information associated with the vertex, or occlusion information associated with the vertex, optionally, wherein the primitive data of the primitive comprises at least one of: a primitive identifier of the primitive, at least one vertex identifier of the at least one vertex, coordinate information of the primitive in a 3D coordinate system, color information of the primitive, texture coordinate information of the primitive, shading information of the primitive, view-dependent shading information associated with the primitive, or occlusion information of the primitive. 5.The computer-implemented method of any one of claims 1 to 4, further comprising: adjusting vertex data of the plurality of vertices of the plurality of primitives to generate a gap or an overlap between adjacent primitives of the plurality of primitives; and Based on a result of the adjusting, updating the vertex data of the plurality of vertices in the memory.

6. A method comprising: obtaining primitive data of a plurality of primitives based on information of the plurality of primitives comprising respective primitive identifiers of the plurality of primitives corresponding to at least one object; for each primitive of the plurality of primitives, determining an electromagnetic (EM) field contribution to each display component of a plurality of display components of a display based on primitive data of the primitive; and for each display component of the plurality of display components of the display, generating a sum of the EM field contributions to the display component by the plurality of primitives.

7. The method of claim 6, further comprising: obtaining the information of the plurality of primitives corresponding to the object by receiving a command from a computing device, wherein the command comprises the information of the plurality of primitives without the primitive data of the plurality of primitives, and the command comprises instructions for rendering the plurality of primitives based on the information of the plurality of primitives, optionally, wherein obtaining the primitive data of the plurality of primitives based on the information of the plurality of primitives comprises: receiving the primitive data of the plurality of primitives from the computing device, wherein the primitive data of the plurality of primitives and the respective primitive identifiers are associated and stored in the computing device.

8. The method of claim 6 or 7, wherein, each primitive of the plurality of primitives comprises one or more vertices, and the primitive data of the primitive comprises vertex data of the one or more vertices, optionally, wherein the information of the plurality of primitives comprises: for each primitive of the plurality of primitives, one or more vertex identifiers of the one or more vertices, and an association between a primitive identifier of the primitive and the one or more vertex identifiers of the one or more vertices of the primitive, optionally, wherein the plurality of primitives comprises a plurality of vertices, optionally, wherein obtaining the primitive data of the plurality of primitives based on the information of the plurality of primitives comprises: retrieving the primitive data of the plurality of primitives from a memory based on vertex identifiers of the plurality of vertices of the plurality of primitives, optionally, wherein the primitive data comprises respective vertex data of each vertex of the plurality of vertices, and the memory stores the vertex data of the plurality of vertices associated with the vertex identifiers of the plurality of vertices, optionally, wherein the respective vertex data of the vertex comprises at least one of: a vertex identifier of the vertex, coordinate information of the vertex in a 3D coordinate system, color information associated with the vertex, texture coordinate information associated with the vertex, viewpoint-dependent shading information associated with the vertex, shading information associated with the vertex, or occlusion information associated with the vertex.

9. The method of any of claims 6 to 8, wherein the plurality of primitives comprises a first primitive and a second primitive adjacent to each other, optionally, wherein the first primitive and the second primitive have at least one shared vertex, Optionally, wherein, for each primitive of the plurality of primitives, determining the EM field contribution to each display component of the plurality of display components of the display based on the primitive data of the primitive comprises: determining a first EM field contribution of the first primitive to a display component of the display based on primitive data of the first primitive; and determining a second EM field contribution of the second primitive to the display component of the display based on primitive data of the second primitive. determining a second EM field contribution of the second primitive to a second display component of the display based on the first EM field contribution and primitive data of the second primitive, Optionally, wherein the method further comprises: adjusting vertex data associated with at least one of the first primitive or the second primitive to generate a gap between the first primitive and the second primitive such that there is no shared vertex between the first primitive and the second primitive, Optionally, wherein the gap is equal to or greater than a preset diffraction limit of the display, Optionally, wherein, for each primitive of the plurality of primitives, determining the electromagnetic EM field contribution to each display component of the plurality of display components of the display based on the primitive data of the display comprises: determining the EM field contribution of at least one of the first primitive or the second primitive based on the adjusted vertex data associated with at least one of the first primitive or the second primitive.

10. The method of any one of claims 6 to 9, wherein, For each primitive of the plurality of primitives, determining the electromagnetic EM field contribution to each display component of the plurality of display components of the display based on the primitive data of the display comprises: determining a first EM contribution of the primitive to a first display component of the display; and determining a second EM contribution of the primitive to a second display component of the display based on the first EM contribution, the second display component being adjacent to the first display component, Optionally, wherein, for each primitive of the plurality of primitives, determining the electromagnetic EM field contribution to each display component of the plurality of display components of the display based on the primitive data of the display comprises: determining at least one distance between the display component and the primitive based on coordinate information of the display component and coordinate information of the primitive in a three-dimensional 3D coordinate system, and determining the EM field contribution of the primitive to the display component based on a predetermined expression of the primitive and the at least one distance, Optionally, wherein the predetermined expression is determined based on at least one of: analytically computing EM field propagation from the primitive to the display component, a solution of Maxwell equations with boundary conditions defined by the display, or at least one function from a group of functions comprising a sine function, a cosine function, and an exponential function, wherein determining the EM field contribution comprises identifying a value of the at least one function in a table stored in a memory.

11. The method of any one of claims 6 to 10, comprising: determining a first respective EM field contribution from a first primitive of the plurality of primitives to each display component of the plurality of display components; determining a second respective EM field contribution from a second primitive of the plurality of primitives to each display component of the plurality of display components; and accumulating the EM field contribution to each display component of the plurality of display components by adding the first respective EM field contribution and the second respective EM field contribution corresponding to the display component, Optionally, wherein determining the first respective EM field contribution from the first primitive to each display component of the plurality of display components is performed in parallel with determining the second respective EM field contribution from the second primitive to each display component of the plurality of display components. ​ 12. The method of any one of claims 6 to 11, wherein, For each of the plurality of primitives, determining the electromagnetic EM field contribution of the primitive to each of the plurality of display components of the display comprises at least one of: determining a first EM field contribution of a first primitive to a first display component while determining a second EM field contribution of a second primitive to the first display component, determining a first EM field contribution of a first primitive to a first display component while determining a second EM field contribution of a second primitive to a second display component, or determining a first EM field contribution of a first primitive to a first display component while determining a second EM field contribution of the first primitive to a second display component.

13. The method of any one of claims 6 to 12, further comprising: obtaining the sum of the EM field contributions to the plurality of display components of the display by pipeline processing of determining the EM field contribution of each of the plurality of primitives to each of the plurality of display components and generating the sum of the EM field contributions from the plurality of primitives to each of the plurality of display components; and generating a hologram corresponding to the object, the hologram comprising the sum of the EM field contributions to the plurality of display components of the display, optionally, the hologram is a complex-valued hologram, and optionally, the method further comprises: converting the complex-valued hologram to a pure phase hologram, optionally, wherein the hologram is a phase hologram or an amplitude hologram, optionally, wherein the method further comprises at least one of: storing the hologram in a storage device, or transmitting the hologram to a driving device for the display.

14. The method of claim 13, further comprising: altering the hologram by adjusting a respective phase of each of the plurality of display components, optionally, wherein adjusting the respective phase of each of the plurality of display components comprises: adding a corresponding phase to the respective phase of each of the plurality of display components, optionally, wherein the corresponding phase of each of the plurality of display components is expressed as: wherein the corresponding phase of each of the plurality of display components is expressed as: ， wherein, Ø represents the corresponding phase of the display assembly, l represents the wavelength of light to be incident on the display assembly at an angle of incidence, 0 represents an angle corresponding to a redirection angle of an optical redirection device configured to redirect light from the display, and x and y represent coordinates of the display assembly in a global 3D coordinate system in which each display assembly of the plurality of display assemblies contributes to the EM field of the display assembly, 15. The method of any one of claims 6 to 14, further comprising: ， wherein, Ø represents the corresponding phase of the display assembly, a and b represent constants, and l represents the wavelength of light to be incident on the display, f represents the focal length of an optical divergence assembly configured to cause light from the display to diverge, x and y represent coordinates of the display assembly in a coordinate system in which each display assembly of the plurality of display assemblies contributes to the EM field of the display assembly. after obtaining the primitive data of the plurality of primitives, adjusting the primitive data of the plurality of primitives, wherein the adjusted primitive data of the plurality of primitives corresponds to a virtual object moving relative to the display in a global 3D coordinate system, wherein, for each of the plurality of primitives, determining the electromagnetic EM field contribution of the primitive to each of the plurality of display components of the display comprises: determining the EM field contribution of the primitive to each of the plurality of display components of the display based on the adjusted primitive data of the primitive in the 3D coordinate system, ​ Optionally, wherein the adjusted primitive data of the plurality of primitives corresponds to the virtual object being rotated at an angle relative to the display in the global 3D coordinate system, and wherein the angle corresponds to a redirection angle of an optical redirection device configured to redirect light from the display such that light modulated by the plurality of display components forms a holographic scene while display zero order light from the display is redirected away from the holographic scene, Optionally, wherein the adjusted primitive data of the plurality of primitives corresponds to the virtual object being moved at a distance along a direction perpendicular to the display in the global 3D coordinate system, and wherein the distance corresponds to a focal length of an optical divergence component configured to cause light from the display to diverge such that light modulated by the plurality of display components forms a holographic scene without divergence while display zero order light from the display is diverged and suppressed in the holographic scene.

16. The method of any one of claims 6 to 15, wherein the method comprises at least one of: computing one or more mathematical functions using at least one of fixed-point number representation or floating-point number representation, computing a respective electromagnetic (EM) field contribution of each primitive of the plurality of primitives to each display component of the plurality of display components, wherein the computing of the respective EM field contribution is performed without including at least one member selected from a group consisting of: extending geometry of the object to the plurality of display components; performing visibility test prior to packing wavefronts; and decision making or communication between parallel computations for different primitives of the plurality of primitives, wherein the computing of the respective EM field contribution is configured such that at least one member is selected from a group consisting of: tuning parallel computations of the plurality of primitives to achieve speed, cost, size, or energy consumption optimization; reducing latency between initiating rendering and result being ready for display; using fixed-point number representation to increase accuracy; bypassing unpacking and repacking of floating-point number representation between mathematical computations; and optimizing computation speed by optimizing mathematical functions.

17. The method of any one of claims 6 to 16, wherein, the plurality of primitives comprises at least one of point primitive, line primitive, and polygon primitive, wherein the primitive data of the primitive comprises at least one of: a primitive identifier of the primitive, coordinate information of the primitive in a 3D coordinate system, color information of the primitive, texture coordinate information of the primitive, viewpoint-dependent shading information associated with the primitive, shading information of the primitive, or occlusion information of the primitive.

18. The method of claims 6-17, wherein, the primitive data of the primitive comprises texture coordinate information of the primitive, the texture coordinate information comprising values associated with discrete cosine transform (DCT) amplitudes of pixels of an image to be mapped onto a designated surface of one or more primitives of the plurality of primitives, wherein the DCT amplitudes of the pixels of the image are associated with DCT weights of the pixels of the image, wherein, for each primitive of the plurality of primitives, determining the electromagnetic (EM) field contribution of the primitive to each display component of the plurality of display components of the display based on the primitive data of the primitive comprises: calculating the EM field contribution from each of the one or more primitives to each of the plurality of display components with the values associated with the DCT amplitudes of the pixels of the image.

19. The method of any one of claims 6 to 18, wherein, the primitive data of the primitive includes occlusion information of the primitive, wherein the method comprises at least one of: determining, based on the occlusion information of a given primitive, one or more particular display components to which the reconstruction of the given primitive does not contribute; and for each of the one or more particular display components, generating a respective sum of the EM field contributions of the plurality of primitives to the particular display component by excluding the EM field contribution of the given primitive to the particular display component, or for each of the plurality of display components, determining, based on the occlusion information of a given primitive, a respective portion of the given primitive that does not contribute EM field contribution to the display component; and for each of the plurality of display components, generating a sum of the EM field contributions from the plurality of primitives to the display component by excluding the EM field contribution of the respective portion of the given primitive to the display component.

20. The method of any one of claims 6 to 19, wherein, the primitive data of the primitive includes view-dependent shading information of the primitive, wherein the method comprises: determining, by taking into account the view-dependent shading information of the primitive, a respective EM field contribution of each of the plurality of primitives to each of the plurality of display components.

21. The method of any one of claims 6 to 20, further comprising: obtaining information of the display, wherein the information of the display comprises coordinate information of a plurality of points corresponding to the plurality of display components, wherein, for each of the plurality of primitives, determining the EM field contribution to each of the plurality of display components of the display based on the primitive data of the display comprises, in a three-dimensional (3D) coordinate system, calculating EM propagation from the primitive to the display based on the coordinate information of the primitive and coordinate information of a point corresponding to the display component, optionally, wherein each of the plurality of display components has a respective shape of a plurality of shapes in a region of the display, each shape of the plurality of shapes uniquely encloses a respective point of the plurality of points, adjacent shapes of the plurality of shapes differ from each other, and wherein the coordinate information of the plurality of points comprises coordinate information of a plurality of spaced points in the region of the display and offset data, the offset data comprising a respective offset between each point of the plurality of points and a corresponding spaced point of the plurality of spaced points.

22. An apparatus comprising: at least one processor; and at least one memory coupled to the at least one processor and having instructions executable by the at least one processor to perform a method as claimed in any one of claims 1 to 21.

23. An apparatus comprising: a command processor configured to: receive a command from a computing device, the command comprising information of a plurality of primitives corresponding to at least one object, the information comprising respective primitive identifiers of the plurality of primitives, and process the command to obtain primitive data of the plurality of primitives from the computing device based on the information of the plurality of primitives; a plurality of computing units configured to calculate, based on the primitive data of the plurality of primitives, a contribution of each primitive of the plurality of primitives to an electromagnetic, EM, field of each display component of the plurality of display components; and an accumulator configured to: accumulate the contributions of the plurality of primitives to the EM field of each display component of the plurality of display components, and generate a hologram comprising a respective sum of the contributions of the plurality of primitives to the EM field of each display component of the plurality of display components.

24. The apparatus of claim 23, wherein, the command processor, the plurality of computing units, and the accumulator are connected in series, and the plurality of computing units are connected in parallel between the command processor and the accumulator, optionally, wherein the device comprises at least one of an application-specific integrated circuit, ASIC, a field-programmable gate array, FPGA, a programmable gate array, PGA, a central processing unit, CPU, a graphics processing unit, GPU, or a standard computing unit, optionally, wherein the device is configured to communicate with the computing device over a peripheral component interconnect express, PCIe, optionally, wherein the device is an integrated chip that is insertable into a PCIe slot of the computing device, optionally, wherein the device is configured to be integrated with the display in a package external to the computing device.

25. A method comprising: generating, based on a hologram of a display, modulation control signals for a plurality of display components of the display, wherein, for each display component of the plurality of display components, the hologram comprises a respective sum of contributions of a plurality of primitives corresponding to at least one object to an electromagnetic, EM, field of the display component, wherein generating the modulation control signals comprises: for each display component of the plurality of display components, generating a respective modulation control signal based on the respective sum of the contributions of the plurality of primitives to the EM field of the display component.

26. The method of claim 25, wherein, the hologram is a complex-valued hologram, the method further comprising: converting the complex-valued hologram to a pure-phase hologram, wherein the respective modulation control signals of the plurality of display components are generated based on the pure-phase hologram, optionally, the method comprises: receiving the complex-valued hologram from a processing device; and storing the complex-valued hologram in a memory; and after converting the complex-valued hologram to the pure-phase hologram, storing the pure-phase hologram in the memory, optionally, wherein the method further comprises at least one of: outputting the respective modulation control signal to each display component of the plurality of display components by successively outputting the respective modulation control signal to each display component of the plurality of display components in a sequential manner, transmitting an illumination control signal to an illuminator to activate the illuminator to shine light onto the display such that the light is shaped by the modulated display components of the display to form a volumetric light field corresponding to the at least one object, or outputting the respective modulation control signal to each display component of the plurality of display components and transmitting the illumination control signal to the illuminator are performed in coordination, optionally, wherein the illuminator comprises two or more light-emitting components each configured to emit light of a different color, and wherein the method comprises: transmitting respective illumination control signals in sequence to sequentially activate each of the two or more light-emitting components of the illuminator, Optionally, wherein the method comprises: outputting a first modulation control signal to modulate the display with information associated with a first color during a first time period, and outputting a second modulation control signal to modulate the display with information associated with a second color during a second, sequential time period; and outputting a first illumination control signal to activate the illuminator to turn on a first light-emitting component to emit light having the first color during the first time period, and outputting a second illumination control signal to activate the illuminator to turn on a second light-emitting component to emit light having the second color during the second time period.

27. An apparatus comprising: a memory configured to store a hologram for a display; and a display driver coupled to the memory and the display, wherein the display comprises a plurality of display components, and for each display component of the plurality of display components, the hologram comprises a respective sum of contributions of a plurality of basis elements to an electromagnetic (EM) field of the display component corresponding to at least one object, wherein the display driver is configured to: for each display component of the plurality of display components, generate a respective modulation control signal based on the respective sum of contributions of the plurality of basis elements to an EM field of the display component, and output the respective modulation control signal to each display component of the plurality of display components to modulate the display component.

28. The apparatus of claim 27, further comprising a luminaire driver coupled to the luminaire, wherein, the illuminator driver is configured to generate and transmit an illumination control signal to an illuminator to activate the illuminator to shine light onto the display such that the light is shaped by the modulated display components of the display to form a volumetric light field corresponding to the at least one object, optionally, wherein the display driver and the illuminator driver are configured to communicate with each other such that outputting the respective modulation control signal by the display driver to each display component of the plurality of display components is coordinated with transmitting the illumination control signal by the illuminator driver to the illuminator, optionally, wherein the memory comprises a first memory buffer coupled to the display driver and a second memory buffer coupled to the illuminator driver, and the second memory buffer has a capacity smaller than the first memory buffer, and optionally, the apparatus is configured to perform the method of claim 25 or 26.

29. An apparatus comprising: a backplane comprising a plurality of circuits; and a plurality of components on the backplane, the plurality of components forming an irregular pattern, wherein the plurality of components are coupled to the plurality of circuits through regularly arranged conductive vias.

30. The apparatus of claim 29, wherein, the irregular pattern comprises a Voronoi pattern, optionally, wherein at least one component of the plurality of components has an irregular polygonal shape, optionally, wherein adjacent components of the plurality of components have different shapes, optionally, wherein a size distribution of the plurality of components is around a same value as a spatial frequency response of the apparatus.

31. The apparatus of claim 29 or 30, wherein the apparatus comprises: a liquid crystal layer; a transparent conductive layer on a top side of the liquid crystal layer as a common electrode; and a plurality of metal electrodes on a bottom side of the liquid crystal layer, wherein each of the plurality of metal electrodes is electrically isolated from each other and can be individually controlled by the backplane, wherein each of the plurality of metal electrodes is electrically coupled to a respective circuit of the plurality of circuits in the backplane one-to-one via a corresponding conductive via of the conductive vias, wherein the plurality of metal electrodes form the irregular pattern, and each of the plurality of metal electrodes corresponds to a respective component of the plurality of components, optionally, wherein for each of the plurality of metal electrodes, the corresponding conductive via is located at a centroid of the metal electrode, optionally, wherein each of the plurality of metal electrodes is configured to reflect light through the liquid crystal layer, optionally, wherein the apparatus further comprises: a first alignment layer on top of the liquid crystal layer; a second alignment layer underneath the liquid crystal layer; and a spacer, wherein the liquid crystal layer is between the first and second alignment layers, and the first and second alignment layers are separated by the spacer to maintain a thickness of the liquid crystal layer.

32. The apparatus of claim 31, wherein, the apparatus comprises a plurality of pairs of metal electrodes and conductive via layers stacked in sequence along a first direction between the liquid crystal layer and the plurality of circuits, wherein a first conductive via of a first pair of the plurality of pairs is located between the plurality of circuits and a first metal electrode of the first pair, and is regularly arranged along a second direction perpendicular to the first direction, wherein a second conductive via of a second pair of the plurality of pairs is located between the first metal electrode of the first pair and a second metal electrode of the second pair, and is regularly arranged along the second direction, wherein adjacent first and second conductive vias are offset from each other along the second direction, optionally, wherein the first metal electrode of the first pair forms a first irregular pattern, and the second metal electrode of the second pair forms a second irregular pattern, and wherein the irregular pattern is associated with the first irregular pattern and the second irregular pattern.

33. A method comprising: generating, by at least one processor, a plurality of shapes based on a plurality of points according to an irregular pattern, the plurality of points irregularly located in a region of an apparatus, each of the plurality of shapes uniquely enclosing a respective point of the plurality of points; and generating, by the at least one processor, a configuration file of the apparatus according to the plurality of shapes, the apparatus comprising a plurality of components each corresponding to a respective shape of the plurality of shapes.

34. The method of claim 33, wherein, the irregular pattern comprises a Voronoi pattern.

35. The method of claim 33 or 34, further comprising determining the plurality of points irregularly located in the region of the apparatus by: determining a plurality of spaced points in the region of the apparatus; and adding different offsets to the plurality of spaced points to generate the plurality of points irregularly located in the region of the apparatus, wherein, the plurality of spaced points defining a regularly arranged pattern, optionally, wherein the method further comprises determining the different offsets based on a Poisson noise distribution, optionally, wherein a first spaced point in a first zone of the region has a first spaced period, and a second spaced point in a second zone of the region has a second spaced period different from the first spaced period.

36. The method of any one of claims 33 to 35, further comprising: storing the different offsets in a repository; and associating the different offsets with the plurality of spaced points in the repository.

37. A method of fabricating an irregular device, comprising: fabricating the irregular device according to a profile of the irregular device, the profile of the irregular device comprising information of a plurality of shapes, wherein each information of a shape corresponds to a respective component of a plurality of components of the irregular device, the plurality of shapes forming an irregular pattern; 38. The method of claim 37, wherein, fabricating the irregular device according to the profile of the irregular device comprises: forming a plurality of metal electrodes corresponding to the plurality of shapes, the plurality of metal electrodes having the irregular pattern, optionally, wherein fabricating the irregular device according to the profile of the irregular device comprises: forming a plurality of circuits on a substrate; forming a plurality of conductive vias on top of the plurality of circuits, wherein each of the plurality of conductive vias is conductively coupled to a respective circuit of the plurality of circuits; forming a metal layer on top of the plurality of conductive vias; and patterning the metal layer according to the irregular pattern to obtain the plurality of metal electrodes, optionally, wherein the plurality of conductive vias are regularly arranged on top of the plurality of circuits, and wherein first conductive vias in a first region are regularly arranged with a first pitch period, and second conductive vias in a second region are regularly arranged with a second pitch period different from the first pitch period, optionally, wherein two or more conductive vias are conductively coupled to corresponding circuits of the plurality of circuits in the backplane, and wherein at least one of the plurality of metal electrodes is conductively coupled to the respective circuit of the plurality of circuits in the backplane via two or more corresponding conductive vias conductively coupled to the respective circuit of the plurality of circuits in the backplane, optionally, wherein, among the plurality of conductive vias, at least two pairs of adjacent conductive vias have different pitches, optionally, wherein the metal layer is configured as a mirror.

39. The method of claim 37 or 38, wherein, fabricating the irregular device according to the profile of the irregular device comprises: forming a first alignment layer on top of the plurality of metal electrodes; forming a plurality of individual spacers on the first alignment layer; forming a liquid crystal layer on the first alignment layer; forming a second alignment layer on top of the liquid crystal layer and the plurality of individual spacers; and forming a transparent conductive layer as a common electrode on top of the second alignment layer.

40. A system, comprising: a display, comprising: a backplane comprising a plurality of circuits; and a plurality of display components disposed on the backplane, the plurality of display components forming an irregular pattern, wherein the plurality of display components are coupled to the plurality of circuits through regularly arranged conductive vias; and a controller coupled to the display and configured to transmit at least one control signal to at least one display component of the display to modulate at least one property of the at least one display component.

41. The system of claim 40, wherein the controller comprises at least one of: an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a programmable gate array (PGA), a central processing unit (CPU), a graphics processing unit (GPU), a phase processing unit (PPU), or a standard computing unit.

42. The system of claim 40 or 41, wherein, the controller is configured to: For each of a plurality of primitives corresponding to at least one object, determining an electromagnetic, EM, field contribution to each of a plurality of display components of the display by calculating an EM field propagation from the primitive to the display component in a three-dimensional, 3D, coordinate system; and For each of the plurality of display components, generating a sum of the EM field contributions from each of the plurality of primitives to the display component, wherein the at least one control signal corresponds to the corresponding sum of the EM field contributions from each of the plurality of primitives to the at least one display component.

43. The system of any one of claims 40 to 42, wherein, each of the plurality of display components is associated with a respective interval point of a plurality of interval points and a respective offset associated with the respective interval point, Optionally, wherein the controller is configured to: for each of the plurality of display components, obtain a position of the respective interval point and the respective offset associated with the respective interval point; and calculate the EM field propagation from the primitive to the display component based on the position of the respective interval point and the respective offset associated with the respective interval point, wherein the respective offset represents a distance between the respective interval point and a seed point of the display component.

44. The system of any one of claims 40 to 43, wherein, the controller is configured to: modulate the display with information associated with a first color during a first time period and with information associated with a second color during a second, sequential time period in sequence; and control the luminaire to turn on a first light emitting component to emit light having the first color during the first time period and to turn on a second light emitting component to emit light having the second color during the second, sequential time period in sequence.

45. A system comprising: a display comprising a plurality of display components; and a driving device coupled to the display and configured to: obtain a hologram for the display, wherein for each of the plurality of display components, the hologram comprises a respective sum of electromagnetic, EM, field contributions to the display component by a plurality of primitives corresponding to at least one object; and for each of the plurality of display components, generate a respective modulation control signal based on the respective sum of the EM field contributions to the display component by the plurality of primitives.

46. The system of claim 45, wherein, the driving device comprises: a memory configured to store the hologram; and a display driver coupled to the memory and the display.

47. The system of claim 45 or 46, further comprising a processing device coupled to the driving device and configured to: acquiring information of the plurality of primitives corresponding to the at least one object, wherein, the information comprises respective primitive identifiers of the plurality of primitives; obtain primitive data of the plurality of primitives based on the information of the plurality of primitives; for each of the plurality of primitives, determine an electromagnetic, EM, field contribution to each of a plurality of display components of a display based on primitive data of the primitive; and for each of the plurality of display components of the display, generate a sum of the EM field contributions to the display component by the plurality of primitives, optionally, wherein the processing device comprises: a command processor configured to: receive a command from a computing device, the command comprising the information of the plurality of primitives corresponding to the at least one object, and processing the command to obtain the primitive data of the plurality of primitives from the computing device based on the information of the plurality of primitives; a plurality of computing units configured to calculate a contribution of each primitive of the plurality of primitives to an electromagnetic, EM, field of each display component of the plurality of display components based on the primitive data of the plurality of primitives; and an accumulator configured to: accumulate the contributions of the plurality of primitives to the EM field of each display component of the plurality of display components, and generate the hologram comprising a respective sum of the contributions of the plurality of primitives to the EM field of each display component of the plurality of display components.

48. The system of claim 46 or 47, wherein, the driving device and the processing device are integrated in a package as a controller of the display, optionally, wherein the controller is integrated with the display, optionally, wherein the controller, the illuminator, and the display are integrated in a package.

49. The system of any one of claims 45 to 48, further comprising a computing device, the processing device is configured to be integrated with the computing device, wherein, optionally, wherein the processing device is insertable into a PCIe slot of the computing device, optionally, wherein the computing device is configured to: generate scene data using a 3D simulation application running on the computing device, wherein the scene data comprises information of a plurality of primitives corresponding to at least one object, and generate the primitive data of the plurality of primitives corresponding to the at least one object based on the scene data using an application program interface, API, optionally, wherein the API is configured to adjust initial primitive data of the plurality of primitives generated from the scene data to generate the primitive data of the plurality of primitives. the display is an irregular display, and the plurality of display components form an irregular pattern.

50. The system of any one of claims 45 to 49, wherein, the optical device comprises a substrate and an optical diffraction component disposed on the substrate and configured to diffract light to the display, 51. The system of any of claims 45 to 50, further comprising an optical device adjacent to the display, wherein, optionally, wherein the optical diffraction component comprises a diffraction grating having a diffraction efficiency for the light, the diffraction efficiency being lower than a predetermined threshold, optionally, wherein the predetermined threshold is 20%, 15%, or 10%, optionally, wherein the holographic grating comprises a photopolymer material or a silver halide material, optionally, the system further comprises a polarization controller disposed between the optical device and the display, wherein the polarization controller is configured to: cause the light from the optical device to be incident on the display to have an S-polarization state, and cause return light from the display to be incident on the optical device to have a P-polarization state or an intermediate state between the S-polarization state and the P-polarization state, optionally, wherein the polarization controller comprises a Faraday rotator, ​ Optionally, wherein the optical diffraction assembly is configured such that, when a plurality of different colors of light is incident on the optical diffraction assembly, the optical diffraction assembly separates or combines individual colors of light of the different colors while suppressing cross-talk between the different colors, optionally, wherein the optical diffraction assembly comprises: at least one optical diffraction device; and at least one of one or more color-selective polarizers or at least one of one or more reflective layers or one or more transmissive layers.

52. The system of any one of claims 45 to 51, wherein, The optical device further comprises an optical redirection assembly disposed on the substrate, wherein the display is configured to diffract a portion of the light illuminating one or more display components, and wherein the optical redirection assembly is configured to transmit the diffracted portion of the light to form a holographic scene and to redirect display zero-order light away from the holographic scene in a three-dimensional (3D) space, the display zero-order light comprising reflected light from the display, Optionally, wherein the optical diffraction assembly is disposed on a first side of the substrate facing a display surface of the display, and the optical redirection assembly is disposed on a second side of the substrate opposite the first side of the substrate, Optionally, wherein the system further comprises: an illuminator disposed adjacent to the optical device and configured to provide a plurality of different colors of light to the optical device, wherein the illuminator comprises a plurality of light-emitting components each configured to emit light of a corresponding color; and a coupling device disposed between the illuminator and the optical device and configured to receive the plurality of different colors of light from the illuminator and output the plurality of different colors of light to the optical device, Optionally, wherein the coupling device comprises: a prism assembly disposed between the illuminator and the optical device and configured to receive the plurality of different colors of light from an input surface of the prism assembly; one or more expansion gratings adjacent to an exit surface of the prism assembly, each of the one or more expansion gratings configured to expand a beam profile of light of a different corresponding color by a factor in at least one dimension; and one or more reflectors downstream of the one or more expansion gratings, each of the one or more reflectors configured to reflect light of a respective color into the optical diffraction assembly, wherein a tilt angle of each of the one or more reflectors is independently adjustable to enable diffraction uniformity from the optical device to the display, Optionally, wherein the optical device is positioned facing a display surface of the display along a direction perpendicular to the display surface, Optionally, the coupling device is configured to couple the plurality of different colors of light into the optical diffraction assembly from a side surface of the coupling device, Optionally, wherein the coupling device is configured to couple the plurality of different colors of light into the optical diffraction assembly from a bottom surface or a top surface of the coupling device.

53. The system of any one of claims 45 to 52, wherein, The system comprises a plurality of optical devices, the plurality of optical devices comprising at least one first optical device configured to cause light incident on the display to produce positive optical dispersion, and at least one second optical device configured to cause the light to produce negative optical dispersion, the light having a spectral bandwidth and a peak wavelength, Optionally, wherein the positive optical dispersion and the negative optical dispersion mutually compensate such that a holographic scene reconstructed from the light has no or almost no optical dispersion, Optionally, wherein the at least one first optical device comprises a first diffraction grating and the at least one second optical device comprises a second diffraction grating, Optionally, wherein the first diffraction grating and the second diffraction grating are configured to cause the light to produce the same magnitude of dispersion, Optionally, wherein the system is configured to cause the light to produce an odd number of reflections between the first diffraction grating and the second diffraction grating, Optionally, wherein the first diffraction grating and the second diffraction grating are configured to cause the light to produce the same dispersion, Optionally, wherein the system is configured to cause the light to produce an even number of reflections between the first diffraction grating and the second diffraction grating, and wherein the first diffraction grating and the second diffraction grating are configured to cause the light to produce opposite dispersion of the same magnitude, Optionally, wherein the positive optical dispersion produced by the at least one first optical device has a first dispersion magnitude and the negative optical dispersion produced by the at least one second optical device has a second dispersion magnitude, and wherein a magnitude ratio of the second dispersion magnitude to the first dispersion magnitude is different from 1, Optionally, wherein the at least one second optical device is disposed downstream of the at least one first optical device along an optical path of the light to be incident on the display, Optionally, wherein the system is configured to change a beam width of the light from the at least one first optical device to the at least one second optical device by a width factor in one dimension, and wherein the width factor is the same as the magnitude ratio, Optionally, wherein the system is configured to change the beam width of the light from the at least one first optical device to the at least one second optical device by a first width factor in a first dimension and by a second width factor in a second dimension different from the first dimension, and wherein each of the first width factor and the second width factor is the same as the magnitude ratio, Optionally, wherein the at least one first optical device is disposed downstream of the at least one second optical device along an optical path of the light to be incident on the display, wherein the system is configured to change a beam width of the light from the at least one second optical device to the at least one first optical device by a width factor in one dimension, and wherein the width factor is the same as an inverse of the magnitude ratio, Optionally, wherein the system is configured to change the beam width of the light from the at least one second optical device to the at least one first optical device by a first width factor in a first dimension and by a second width factor in a second dimension different from the first dimension, and wherein each of the first width factor and the second width factor is the same as an inverse of the magnitude ratio, Optionally, wherein the plurality of optical devices comprises at least one third optical device configured to cause the light to produce optical dispersion, and wherein the at least one first optical device, the at least one second optical device, and the at least one third optical device are configured to compensate for optical dispersion produced by each of the light, Optionally, wherein the plurality of optical devices comprises: a first optical device configured for optical dispersion compensation of light of a first color, and a second optical device configured for optical dispersion compensation of light of a second color, the second color being different from the first color, Optionally, wherein the plurality of optical devices comprises: a first set of optical devices each configured to induce a first optical dispersion of light of a respective color of a plurality of colors of light, and a second set of optical devices each configured to induce a second optical dispersion of light of the respective color of the plurality of colors of light, wherein the first set of optical devices and the second set of optical devices are configured to compensate for optical dispersion of each of the plurality of colors of light, optionally, wherein at least one of the first set of optical devices and the second set of optical devices comprises a series of holographic gratings made of a same material, Optionally, wherein the plurality of optical devices are configured to compensate for optical dispersion of light of a first color having a first spectral width, without compensating for light of a second color having a second spectral width narrower than the first spectral width.

54. A method comprising: recording a diffraction grating in a recording material by illuminating an object beam and a reference beam having mismatched polarization states into the recording material.

55. The method of claim 54, wherein, the diffraction grating has a diffraction efficiency below a predetermined threshold, Optionally, wherein the predetermined threshold is 10%, 15%, or 20%.

56. The method of claim 54 or 55, wherein, one of the object beam and the reference beam has one of an S-polarization state and a P-polarization state, and the other of the object beam and the reference beam has an intermediate polarization state between the S-polarization state and the P-polarization state, Optionally, wherein one of the object beam and the reference beam has a first intermediate polarization state between the S-polarization state and the P-polarization state, and the other of the object beam and the reference beam has a second intermediate polarization state between the S-polarization state and the P-polarization state, and wherein the second intermediate polarization state is different from the first intermediate polarization state, Optionally, wherein each of the object beam and the reference beam has a P-polarization state, Optionally, the method further comprises: measuring a diffraction efficiency of the diffraction grating; and adjusting a polarization state of at least one of the object beam or the reference beam based on the measured diffraction efficiency.

57. The method of any one of claims 54 to 56, wherein, adjusting a polarization state of at least one of the object beam or the reference beam based on the measured diffraction efficiency comprises, in response to determining that the measured diffraction efficiency is above a predetermined threshold, adjusting the polarization state of at least one of the object beam and the reference beam to increase a degree of mismatch between polarization states of the object beam and the reference beam, Optionally, wherein adjusting the polarization state of at least one of the object beam or the reference beam to increase a degree of mismatch between polarization states of the object beam and the reference beam comprises adjusting the polarization state of at least one of the object beam and the reference beam to be closer to a P-polarization state than to an S-polarization state, Optionally, wherein a beam between angle between the object beam and the reference beam is in a range of 70° to 80°, Optionally, wherein a beam ratio between the object beam and the reference beam is in a range of 1 to 30, Optionally, wherein the method further comprises: measuring a diffraction efficiency of the diffraction grating; and adjusting a beam ratio between the object beam and the reference beam based on the measured diffraction efficiency, Optionally, wherein adjusting the beam ratio between the object beam and the reference beam based on the measured diffraction efficiency comprises: in response to determining that the measured diffraction efficiency is higher than a predetermined threshold, increasing the beam ratio between the object beam and the reference beam, Optionally, wherein the method further comprises: inducing a movement in at least one of the object beam and the reference beam during recording the diffraction grating, and Optionally, wherein the method further comprises: wherein the recording material comprises a photopolymer material or a silver halide material.

58. A method comprising: adjusting, by at least one processor, primitive data corresponding to a plurality of primitives of an object to generate a gap between adjacent primitives of the plurality of primitives.

59. The method of claim 58, wherein, for at least one pair of adjacent primitives, the gap is not less than a predetermined value, Optionally, wherein, prior to the adjusting, the adjacent primitives are in contact and have at least one shared edge, Optionally, wherein adjusting the primitive data corresponding to the plurality of primitives of the object to generate the gap between the adjacent primitives of the plurality of primitives comprises: for each primitive of the adjacent primitives, shrinking the primitive towards a center of the primitive by a distance of half the gap, Optionally, wherein coordinate data of the center of the primitive in a three-dimensional (3D) coordinate system remains unchanged, and a perpendicular distance between an edge of the primitive and the center of the primitive is reduced to half the gap, Optionally, wherein coordinate data of the center of the primitive in a 3D coordinate system remains unchanged, and coordinate data of vertices defining the primitive are adjusted relative to the center of the primitive to generate the gap.

60. The method of claim 58 or 59, wherein, adjusting the primitive data corresponding to the plurality of primitives of the object to generate the gap between the adjacent primitives of the plurality of primitives comprises: scaling a shared edge of a first primitive adjacent to a second primitive; and updating respective primitive data of the first primitive based on a result of the scaling, Optionally, wherein scaling the shared edge of the first primitive adjacent to the second primitive comprises: moving two vertices of the shared edge of the first primitive towards at least one adjacent vertex of the first primitive, Optionally, wherein the first primitive has only the second primitive as an adjacent primitive, and wherein one or more other edges of the first primitive remain unscaled.

61. The method of any one of claims 58 to 60, further comprising: receiving an input to generate the gap among the plurality of primitives, wherein, in response to receiving the input, the primitive data corresponding to the plurality of primitives of the object is adjusted to generate the gap between the adjacent primitives of the plurality of primitives, Optionally, wherein at least one of the plurality of primitives comprises a triangular primitive or a polygonal primitive, Optionally, wherein primitive data of a primitive comprises at least one of: texture information of the primitive, shading information on one or more surfaces of the primitive, color information of the primitive, or coordinate information of the primitive in a 3D coordinate system, Optionally, wherein the method further comprises: generating, by the at least one processor, the primitive data of the plurality of primitives based on scene data of the object, the scene data comprising information of the plurality of primitives, and generating, by the at least one processor, the scene data of the object using a 3D simulation application.

62. A method comprising: obtaining primitive data corresponding to a plurality of primitives of an object, wherein the primitive data indicates a gap between adjacent primitives of the plurality of primitives; for each primitive of the plurality of primitives, determining an electromagnetic (EM) field contribution to a display component by calculating an EM field propagation from the primitive to the display component in a three-dimensional (3D) coordinate system using the primitive data of the primitive and coordinate data of each display component of a plurality of display components of a display; and for each display component of the plurality of display components, generating a sum of the EM field contributions from each primitive of the plurality of primitives to the display component.

63. The method of claim 62, further comprising at least one of: transmitting a respective control signal to each of the plurality of display components of the display to modulate at least one property of the display component based on the sum of the EM field contributions to the display component, or illuminating light on a modulating display component of the display to form a volumetric light field in a three-dimensional (3D) space, the volumetric light field corresponding to a reconstruction of the object, wherein the reconstruction of the object comprises reconstructed adjacent primitives corresponding to the adjacent primitives with the gap, optionally, wherein the gap is configured to make the reconstructed adjacent primitives distinguishable from each other, optionally, wherein the gap is configured to be small enough to make the reconstructed adjacent primitives appear seamless, and optionally, wherein the gap is configured such that there is no overlap between the reconstructed adjacent primitives.

64. The method of claim 62 or 63, wherein the gap is configured to be equal to or greater than a preset diffraction limit of the display, optionally, wherein a ratio between the gap and the preset diffraction limit of the display is in a range of 1 to 10, optionally, wherein the ratio is in a range of 3 to 5, optionally, wherein the preset diffraction limit of the display complies with a Rayleigh criterion, optionally, wherein the preset diffraction limit of the display is determined based on a size of a display component of the display and a wavelength of light to be incident on the display, optionally, wherein the preset diffraction limit of the display is expressed as: res = 0.61λ / tanθ o ， wherein res represents the predetermined diffraction limit of the display, represents the wavelength of light in air, and represents the output angle from the surface of the display, optionally, wherein the display comprises a cover on top of the plurality of display components of the display, and wherein the output angle is expressed as: , and ， wherein θ i denotes the angle of incidence on the interface between the cover and the surrounding medium, n i and n o denotes the refractive index of the material of the cover and the refractive index of the surrounding medium, denotes the wavelength of the light in the material of the cover, and denotes the display element period of the display, optionally, wherein the display component period of the display is one of a period along a first direction of the display components of the display or a period along a second direction of the display components of the display perpendicular to the first direction.

65. A method comprising: generating control signals for a plurality of display components of a display based on primitive data corresponding to a plurality of primitives of at least one object, wherein the primitive data indicates a gap between adjacent primitives of the plurality of primitives.

66. The method of claim 65, further comprising: transmitting timing control signals to the illumination source to illuminate light on the plurality of display components modulated with the control signals to form a volumetric light field in a three-dimensional (3D) space, the volumetric light field corresponding to a reconstruction of the object, wherein the reconstruction of the object includes reconstructed neighboring primitives corresponding to the neighboring primitives with the gap, and wherein the gap is configured to make the reconstructed neighboring primitives distinguishable from each other.

67. A method comprising: obtaining primitive data corresponding to a plurality of primitives of an object; adjusting the primitive data of the plurality of primitives to generate a gap between neighboring primitives of the plurality of primitives; generating control signals for a plurality of display components of a display using the adjusted primitive data of the plurality of primitives; modulating the plurality of display components of the display based on the control signals; and illuminating light on the modulated display components of the display to form a volumetric light field in a three-dimensional (3D) space, the volumetric light field corresponding to a reconstruction of the object, wherein the reconstruction of the object includes reconstructed neighboring primitives corresponding to the neighboring primitives with the gap, and wherein the gap is configured to make the reconstructed neighboring primitives distinguishable from each other.

68. The method of claim 67, wherein, the gap is configured to be small enough to make the reconstructed neighboring primitives appear seamless and large enough to make no overlap between the reconstructed neighboring primitives, optionally, wherein generating the control signals for the plurality of display components of the display using the adjusted primitive data of the plurality of primitives comprises, for each primitive in the plurality of primitives, determining an electromagnetic (EM) field contribution to each display component in the plurality of display components of the display by calculating an EM field propagation from the primitive to the display component in a 3D coordinate system using the adjusted primitive data of the primitive and coordinate data of the display component, and for each display component in the plurality of display components, generating a sum of the EM field contributions from each primitive in the plurality of primitives to the display component, and generating a respective control signal based on the sum of the EM field contributions to the display component, optionally, wherein the method further comprises generating scene data of the object using a 3D simulation application, and generating the primitive data of the plurality of primitives based on the scene data of the object, the scene data including information of the plurality of primitives, optionally, wherein the gap is configured to be equal to or larger than a preset diffraction limit of the display determined according to a Rayleigh criterion.

69. A method comprising: adjusting, by at least one processor, primitive data corresponding to a plurality of primitives of an object to generate an overlap between neighboring primitives of the plurality of primitives.

70. The method of claim 69, wherein, adjusting the primitive data of the plurality of primitives to generate the overlap between the neighboring primitives comprises: for each primitive of the neighboring primitives, scaling up the primitive away from a center of the primitive, optionally, wherein coordinate data of the center of the primitive in a 3D coordinate system remains unchanged, and coordinate data of vertices defining the primitive are adjusted with respect to the center of the primitive to generate the overlap, Optionally, adjusting the primitive data of the plurality of primitives to generate the overlap between the adjacent primitives comprises, for each primitive of the adjacent primitives, moving a first primitive relative to a second primitive adjacent to the first primitive to generate the overlap, Optionally, the method further comprises: receiving an input to generate the overlap among the plurality of primitives, wherein, in response to receiving the input, adjusting the primitive data of the plurality of primitives to generate the overlap between the adjacent primitives of the plurality of primitives.

71. A method comprising: generating control signals of a plurality of display components of a display based on primitive data of a plurality of primitives corresponding to at least one object, wherein the primitive data indicates an overlap between adjacent primitives of the plurality of primitives.

72. The method of claim 71, further comprising: transmitting timing control signals to an illumination source to illuminate light on the plurality of display components modulated by the control signals to form a volumetric light field in a three-dimensional (3D) space, the volumetric light field corresponding to a reconstruction of the object, wherein the reconstruction of the object comprises reconstructed adjacent primitives corresponding to the adjacent primitives with the overlap, wherein the overlap is configured to cause the reconstructed adjacent primitives to overlap with each other.

73. A system comprising: a display; and a controller coupled to the display, wherein the controller is configured to: obtain primitive data of a plurality of primitives corresponding to an object, wherein the primitive data indicates a gap between adjacent primitives of the plurality of primitives; for each primitive of the plurality of primitives, determine an electromagnetic (EM) field contribution to each display component of a plurality of display components of the display by calculating an EM field propagation from the primitive to the display component in a three-dimensional (3D) coordinate system using the primitive data of the primitive and coordinate data of each display component of the plurality of display components; and for each display component of the plurality of display components, generate a sum of the EM field contributions from each primitive of the plurality of primitives to the display component.

74. A system comprising: a display; and a controller coupled to the display, wherein the controller is configured to: obtain primitive data of a plurality of primitives corresponding to an object, wherein the primitive data indicates a gap between adjacent primitives of the plurality of primitives; generate control signals for a plurality of display components of a display using the primitive data of the plurality of primitives; and transmit the control signals to the display to modulate the plurality of display components of the display based on the control signals.

75. A system comprising: a display; and a controller coupled to the display, wherein the controller is configured to: obtain primitive data of a plurality of primitives corresponding to an object, wherein the primitive data indicates an overlap between adjacent primitives of the plurality of primitives; generate control signals for a plurality of display components of a display using the primitive data of the plurality of primitives; and transmit the control signals to the display to modulate the plurality of display components of the display based on the control signals.

76. The system of claim 75, wherein, the controller is coupled to a computing device, wherein the computing device is configured to: generating scene data using a 3D simulation application, wherein the scene data includes information of the plurality of primitives of the object; and generating, using an application program interface (API), the primitive data corresponding to the plurality of primitives of the object based on the scene data, optionally, wherein the API is configured to adjust initial primitive data of the plurality of primitives generated from the scene data to generate the primitive data of the plurality of primitives.

77. An apparatus comprising: an optical guiding device configured to guide light to propagate within the optical guiding device along a first direction, the light having a spectral bandwidth and a peak wavelength; an in-coupling diffractive structure configured to diffract the light to propagate in the optical guiding device; and one or more out-coupling diffractive structures disposed downstream of the in-coupling diffractive structure along the first direction and configured to diffract at least part of the light out of the optical guiding device along a second direction different from the first direction, wherein the in-coupling diffractive structure is configured to induce a first optical dispersion of the light, and at least one of the one or more out-coupling diffractive structures is configured to induce a second optical dispersion of the light, and wherein the first optical dispersion and the second optical dispersion mutually compensate so that the light diffracted out of the optical guiding device has no or almost no optical dispersion.

78. The apparatus of claim 77, wherein, the in-coupling diffractive structure comprises a first diffraction grating, and at least one of the one or more out-coupling diffractive structures comprises a second diffraction grating, wherein the first diffraction grating and the second diffraction grating are configured to cause the first optical dispersion and the second optical dispersion to produce opposite dispersions of the light of the same magnitude.

79. The apparatus of claim 78, wherein, the first diffraction grating has a first grating plane having a first grating tilt angle, and the second diffraction grating has a second grating plane having a second grating tilt angle, and wherein the first grating tilt angle and the second grating tilt angle have the same value and opposite directions, wherein the first diffraction grating has a first grating pitch perpendicular to the first grating plane, and the second diffraction grating has a second grating pitch perpendicular to the second grating plane, and wherein the first grating pitch and the second grating pitch are the same, optionally, wherein light diffracted by the first diffraction grating has a first beam width, and light diffracted by the second diffraction grating has a second beam width, and wherein the first beam width and the second beam width are the same, optionally, wherein a first diffraction efficiency of the first diffraction grating for light having the peak wavelength is greater than a second diffraction efficiency of the second diffraction grating for the light having the peak wavelength, optionally, wherein the first diffraction efficiency is not less than 60% and the second diffraction efficiency is not greater than 20%, optionally, wherein the optical guiding device is configured to guide the light via total internal reflection (TIR), optionally, wherein the first diffraction grating is a reflective grating, a transmissive grating, or a transreflective grating, and wherein the second diffraction grating is a reflective grating or a transmissive grating.

80. The apparatus of any one of claims 77 to 79, wherein, the in-coupling diffractive structure is disposed in or on the optical guiding device, and wherein the one or more out-coupling diffractive structures comprise a plurality of out-coupling diffractive structures disposed in or on the optical guiding device along the first direction, Optionally, wherein the in-coupling diffractive structure and the plurality of out-coupling diffractive structures are disposed on the same side of the optical guiding device, Optionally, wherein the in-coupling diffractive structure and the plurality of out-coupling diffractive structures are disposed on opposite sides of the optical guiding device, Optionally, wherein the plurality of out-coupling diffractive structures contact or overlap each other along the first direction, and wherein the in-coupling diffractive structure is spaced apart from the plurality of out-coupling diffractive structures, Optionally, wherein along the first direction, a width of the in-coupling diffractive structure is the same as a width of each of the plurality of out-coupling diffractive structures, Optionally, wherein the in-coupling diffractive structure comprises a first diffractive grating, and each of the plurality of out-coupling diffractive structures comprises a respective second diffractive grating, and wherein the first diffractive grating and the respective second diffractive gratings are configured to cause the light to have a same magnitude of opposite dispersion, Optionally, wherein the respective second diffractive gratings are configured to cause the light to have a same dispersion of a same magnitude and a same direction.

81. The apparatus of claim 80, wherein, the plurality of out-coupling diffractive structures comprises a first out-coupling diffractive structure and a second out-coupling diffractive structure, the second out-coupling diffractive structure disposed further away from the in-coupling diffractive structure than the first out-coupling diffractive structure, wherein the second out-coupling diffractive structure has a higher diffraction efficiency for the light having the peak wavelength than the first out-coupling diffractive structure, Optionally, wherein the first out-coupling diffractive structure is configured to diffract a first portion of the light incident on the first out-coupling diffractive structure out of the optical guiding device, the diffracted first portion of the light having a first optical power, Optionally, wherein the second out-coupling diffractive structure is configured to diffract a second portion of the light incident on the second out-coupling diffractive structure out of the optical guiding device, the diffracted second portion of the light having a second optical power, Optionally, wherein the first portion of the light has a higher optical power than the second portion of the light, and the first and second out-coupling structures are configured such that the second optical power is the same as the first optical power, Optionally, wherein a portion of the first portion of the light that is not diffracted by the first out-coupling diffractive structure propagates in the optical guiding device along the first direction via total internal reflection (TIR) to be incident on the second out-coupling diffractive structure.

82. The apparatus of claim 80 or 81, wherein, the diffracted light from the in-coupling diffractive structure propagates in the optical guiding device along the first direction via total internal reflection to be incident on each of the plurality of out-coupling diffractive structures in turn along the first direction, wherein the plurality of out-coupling diffractive structures are configured to have a diffraction efficiency for the light that gradually increases along the first direction, such that light diffracted out of the optical guiding device by each of the plurality of out-coupling diffractive structures has a same optical power, Optionally, wherein the diffracted light from the in-coupling diffractive structure is incident on each of the plurality of out-coupling diffractive structures at a same angle of incidence, and wherein each of the plurality of out-coupling diffractive structures is configured such that the diffracted light through each of the plurality of out-coupling diffractive structures has a same angle of diffraction, Optionally, wherein the in-coupling diffractive structure is configured to receive the light at a first incidence angle and diffract the light at a first diffraction angle, and wherein the first incidence angle is the same as the same diffraction angle, and the first diffraction angle is the same as the same incidence angle, Optionally, wherein the incidence angle is not less than 60°, and wherein the diffraction angle is about 0°, and Optionally, wherein the optical guiding device comprises a waveguide or a light guide.

83. The apparatus of any one of claims 77 to 82, wherein, The light comprises different colors of light, and wherein the in-coupling diffractive structure comprises a first corresponding diffraction grating for each different color of light, and wherein each of the one or more out-coupling diffractive structures comprises a second corresponding diffraction grating for each different color of light, Optionally, wherein the first corresponding diffraction gratings of the different colors of light are recorded in a same first recording medium, or the second corresponding diffraction gratings of the different colors of light are recorded in a same second recording medium, or Optionally, wherein each of the first corresponding diffraction gratings of the different colors of light is recorded in a respective first recording medium, or Optionally, wherein each of the second corresponding diffraction gratings of the different colors of light is recorded in a respective second recording medium.

84. A system comprising: a display; and an optical device comprising: an optical guiding device configured to guide light to propagate within the optical guiding device along a first direction, the light having a spectral bandwidth and a peak wavelength; an in-coupling diffractive structure configured to diffract the light to propagate in the optical guiding device; and a plurality of out-coupling diffractive structures disposed downstream of the in-coupling diffractive structure along the first direction and configured to diffract at least part of the light out of the optical guiding device along a second direction different from the first direction, wherein the in-coupling diffractive structure is configured to induce a first optical dispersion of the light, and each of the plurality of out-coupling diffractive structures is configured to induce a second optical dispersion of the light, and wherein the first optical dispersion and the second optical dispersion mutually compensate such that light diffracted out of the optical guiding device has no or almost no optical dispersion.

85. The system of claim 84, wherein, The in-coupling diffractive structure comprises a first diffraction grating, and each of the plurality of out-coupling diffractive structures comprises a respective second diffraction grating, wherein the first diffraction grating and the respective second diffraction grating are configured to cause the light to produce the same magnitude of opposite dispersion, Optionally, wherein each of the first diffraction grating and the respective second diffraction grating is a reflective grating, Optionally, wherein the first diffraction grating is a reflective grating or a transmissive grating, and wherein the respective second diffraction grating is a reflective grating or a transmissive grating.

86. The system of claim 84 or 85, wherein, The diffracted light from the in-coupling diffractive structure propagates in the optical guiding device along the first direction via total internal reflection to sequentially impinge on each of the plurality of out-coupling diffractive structures along the first direction, wherein the plurality of out-coupling diffractive structures are configured to have a gradually increasing diffraction efficiency along the first direction for the light, such that light diffracted out of the optical guiding device by each of the plurality of out-coupling diffractive structures has the same optical power, Optionally, wherein the plurality of out-coupling diffractive structures are configured such that the diffracted light passing through each of the plurality of out-coupling diffractive structures propagates to illuminate a respective portion of the display, a sum of the respective portions of the display is not less than an area of the display, Optionally, wherein the respective portions of the display have a width along the first direction and a length along a third direction perpendicular to the first direction and the second direction, Optionally, wherein the widths of the respective portions of the display are the same as each other, Optionally, wherein, along the first direction, a width of the in-coupling diffractive structure is the same as a width of each of the plurality of out-coupling diffractive structures, Optionally, wherein the in-coupling diffractive structure is configured to receive the light at a first incidence angle and diffract the light at a first diffraction angle, and wherein each of the plurality of out-coupling diffractive structures is configured to receive reflected light from the optical directing device at a second incidence angle and diffract the reflected light at a second diffraction angle, wherein the first incidence angle is the same as the second diffraction angle, and the first diffraction angle is the same as the second incidence angle, Optionally, wherein the second incidence angle is not less than 60°, and wherein the second diffraction angle is about 0°.

87. The system of any one of claims 84 to 86, wherein, The display includes a plurality of display components extending along the first direction and a third direction perpendicular to the first direction and the second direction, wherein the optical directing device is a first optical directing device, the in-coupling diffractive structure is a first in-coupling diffractive structure, and the plurality of out-coupling diffractive structures is a plurality of first out-coupling diffractive structures, wherein the system further includes: a second optical directing device extending along the first direction and the third direction, a plurality of second in-coupling diffractive structures disposed in or on the second optical directing device along the first direction, and a plurality of sets of second out-coupling diffractive structures, each set of second out-coupling diffractive structures disposed in or on the second optical directing device along the third direction, wherein, for each of the plurality of second in-coupling diffractive structures, the second in-coupling diffractive structure is configured to receive first light diffracted from a corresponding first out-coupling diffractive structure and diffract the first light to propagate in the second optical directing device along the third direction via TIR to sequentially be incident on a corresponding set of second out-coupling diffractive structures, and each second out-coupling diffractive structure of the corresponding set of second out-coupling diffractive structures is configured to receive second light reflected from the second optical directing device and diffract the second light out of the second optical directing device toward the display along the second direction.

88. The system of claim 87, wherein, the second in-coupling diffractive structure has a higher diffraction efficiency than the corresponding first out-coupling diffractive structure and each second out-coupling diffractive structure of the corresponding set of second out-coupling diffractive structures, wherein the second in-coupling diffractive structure includes a first diffraction grating and each second out-coupling diffractive structure of the corresponding set of second out-coupling diffractive structures includes a respective second diffraction grating, and wherein the first diffraction grating and the respective second diffraction grating are configured to cause the light to produce the same magnitude of opposite dispersion, Optionally, wherein the corresponding set of second out-coupling diffractive structures is configured to have a gradually increasing diffraction efficiency for the light along the third direction, such that the light diffracted by each second out-coupling diffractive structure of the corresponding set of second out-coupling diffractive structures from the optical directing device towards the display has the same optical power, Optionally, wherein the first in-coupling diffractive structure, the plurality of first out-coupling diffractive structures, the plurality of second in-coupling diffractive structures, and the plurality of sets of second out-coupling diffractive structures are configured such that the diffracted light from each set of second out-coupling diffractive structures of the plurality of sets of second out-coupling diffractive structures towards the display has a uniform optical power along the second direction, Optionally, wherein the plurality of sets of second out-coupling diffractive structures are configured such that the diffracted light by each set of second out-coupling diffractive structures of the plurality of sets of second out-coupling diffractive structures propagates to illuminate a respective portion of the display, a sum of the respective portions of the display is not less than an area of the display, Optionally, wherein the respective portions of the display have a same size along the first direction and the third direction, Optionally, wherein the respective portions of the display are identical to each other, Optionally, wherein the first optical directing device and the second optical directing device are integrated into one, Optionally, wherein the system further comprises one or more absorbers disposed in or on an end face of the optical directing device and configured to absorb light propagating out of the optical directing device.

89. The system of any one of claims 84 to 88, wherein, The light comprises different colors of light, and wherein the in-coupling diffractive structure comprises a corresponding first diffractive grating for each different color of light, and wherein each of the plurality of out-coupling diffractive structures comprises a corresponding second diffractive grating for each different color of light, Optionally, wherein the display comprises: a backplane comprising a plurality of electrical circuits; and a plurality of display components disposed on the backplane, the plurality of display components forming an irregular pattern, wherein each of the plurality of display components is coupled to a respective electrical circuit of the plurality of electrical circuits; Optionally, wherein the system further comprises: an illuminator configured to emit the light; and a controller coupled to the display and the illuminator, wherein the controller is configured to: transmit at least one control signal to at least one display component of the display to modulate at least one property of the at least one display component, sequentially modulate the display with information associated with a first color during a first time period and with information associated with a second color during a second, sequential time period; and control the illuminator to sequentially turn on a first light-emitting component to emit light having the first color during the first time period and turn on a second light-emitting component to emit light having the second color during the second, sequential time period.

90. An optical device, comprising: a first optical directing device configured to direct light to propagate within the first optical directing device along a first direction via total internal reflection, the light having a spectral bandwidth and a peak wavelength; a first in-coupling diffractive structure configured to diffract the light to propagate in the first optical directing device; a plurality of first out-coupling diffractive structures disposed downstream of the first in-coupling diffractive structures along the first direction and configured to diffract at least part of the light out of the first optical directing device along a second direction different from the first direction; a second optical directing device extending along the first direction and a third direction perpendicular to the first direction and the second direction; a plurality of second in-coupling diffractive structures disposed in or on the second optical directing device along the first direction; a plurality of sets of second out-coupling diffractive structures, each set of second out-coupling diffractive structures disposed in or on the second optical directing device along the third direction, wherein the first in-coupling diffractive structures are configured to induce a first optical dispersion of the light, and each of the plurality of first out-coupling diffractive structures is configured to induce a second optical dispersion of the light, and wherein the first optical dispersion and the second optical dispersion mutually compensate such that light diffracted out of the first optical directing device has no or almost no optical dispersion, wherein, for each of the plurality of second in-coupling diffractive structures, the second in-coupling diffractive structure is configured to receive first light diffracted from a respective first out-coupling diffractive structure and diffract the first light to propagate in the second optical directing device along the third direction via total internal reflection to sequentially impinge on a corresponding set of second out-coupling diffractive structures, each second out-coupling diffractive structure of the corresponding set of second out-coupling diffractive structures is configured to receive second light reflected from the second optical directing device and diffract the second light out of the second optical directing device along the second direction, wherein the second in-coupling diffractive structure and each second out-coupling diffractive structure of the corresponding set of second out-coupling diffractive structures are configured to induce mutually compensating opposite dispersions such that light diffracted out of the second optical directing device has no or almost no optical dispersion, optionally, wherein the first in-coupling diffractive structures, the plurality of first out-coupling diffractive structures, the plurality of second in-coupling diffractive structures, and the plurality of sets of second out-coupling diffractive structures are configured such that diffracted light from each set of second out-coupling diffractive structures of the plurality of sets of second out-coupling diffractive structures has a uniform etendue along the second direction towards the display.

91. A system comprising: an optical device configured to deflect target light towards a target device; a linear polarizer configured to transmit light having a linear polarization state; and an optical retarder configured to change a polarization state of light passing through the optical retarder, wherein the linear polarizer and the optical retarder are configured such that ambient light from a first side of the linear polarizer, after passing through the linear polarizer and the optical retarder, impinges on the target device and returns from the target device to pass through the optical retarder to be blocked by the linear polarizer from a second side of the linear polarizer opposite the first side of the linear polarizer, and wherein the optical device, the linear polarizer, and the optical retarder are configured to cause the target light to impinge on the target device and return from the target device to be transmitted through the linear polarizer from the second side of the linear polarizer.

92. The system of claim 91, wherein, The optical device is configured to direct the target light along a first direction and to diffract to the target device along a second direction different from the first direction, and the target light does not pass through the first side of the linear polarizer.

93. The system of claim 91 or 92, wherein, The linear polarizer and the optical retarder are configured to cause the ambient light to pass through the linear polarizer once and the optical retarder twice in sequence, and wherein the optical device, the linear polarizer and the optical retarder are configured to cause the target light to pass through the optical retarder twice and the linear polarizer once in sequence.

94. The system of any one of claims 91 to 93, wherein, The linear polarizer and the optical retarder are configured to cause the ambient light incident on the second side of the linear polarizer and the ambient light transmitted out of the first side of the linear polarizer to be in opposite polarization states.

95. The system of any one of claims 91 to 94, wherein, The optical retarder is configured to perform at least one of: change linearly polarized light passing through the optical retarder to circularly polarized light, or change circularly polarized light passing through the optical retarder to linearly polarized light, optionally wherein the optical retarder comprises a quarter wave plate (QWP), optionally wherein the optical retarder comprises an achromatic quarter wave plate (QWP) or a wide angle quarter wave plate (QWP), optionally wherein the quarter wave plate is at 45° with respect to the transmission angle of the linear polarizer.

96. The system of any one of claims 91 to 95, wherein, The target device is configured to: deflect the ambient light without changing the polarization state of the ambient light, and deflect the target light without changing the polarization state of the target light, optionally wherein the intensity of the target light transmitted from the linear polarizer is about half of the intensity of the target light deflected from the display, optionally wherein the target device is a reflective device.

97. The system of any one of claims 91 to 96, wherein, The linear polarizer and the optical retarder are disposed on a first side of the optical device, and the target device is disposed on a second side of the optical device opposite the first side of the optical device, wherein the optical retarder is between the linear polarizer and the optical device, optionally wherein the target light is deflected by the optical device in a first polarization state that is the same as the linear polarization state of the linear polarizer, the target light is incident on the linear polarizer from the second side of the linear polarizer in a circular polarization state, and wherein the target light is incident on the target device in the first polarization state and returns from the target device in the first polarization state, optionally wherein the linear polarization state is a first linear polarization state, the ambient light is incident on a first side of the optical retarder in the first linear polarization state, and the optical retarder converts the first linear polarization state of the ambient light to a circular polarization state, the ambient light returns from a second side of the optical retarder opposite the first side of the optical retarder in the circular polarization state, and the optical retarder converts the circular polarization state of the ambient light to a second linear polarization state opposite the first linear polarization state, optionally wherein the first linear polarization state is one of an S-polarization state and a P-polarization state, and the second linear polarization state is the other of the S-polarization state and the P-polarization state, Optionally, wherein the first linear polarization state is an S-polarization state and the second linear polarization state is a P-polarization state.

98. The system of any one of claims 91 to 96, wherein, The linear polarizer is disposed on a first side of the optical device, and the target device is disposed on a second side of the optical device opposite the first side of the optical device, and wherein the optical retarder is disposed on the second side of the optical device and between the optical device and the target device, Optionally, wherein the linear polarization state is a first linear polarization state, the target light is deflected by the optical device to be incident on a first side of the optical retarder with a second linear polarization state opposite the first linear polarization state, and the optical retarder converts the second linear polarization state of the target light to a circular polarization state, the target light is incident on the target device with the circular polarization state and returns from the target device to a second side of the optical retarder opposite the first side of the optical retarder with the circular polarization state, and the optical retarder converts the circular polarization state of the target light to the first linear polarization state, and the target light is incident on the second side of the linear polarizer with the first linear polarization state and transmits through the linear polarizer, Optionally, wherein the linear polarization state is a first linear polarization state, the ambient light is incident on a first side of the optical retarder with the first linear polarization state, and the optical retarder converts the first linear polarization state of the ambient light to a circular polarization state, the ambient light returns from the target device to the optical retarder with the circular polarization state, and the optical retarder converts the circular polarization state of the ambient light to a second linear polarization state opposite the first linear polarization state, and the ambient light is incident on the second side of the linear polarizer with the second linear polarization state and is blocked by the linear polarizer, Optionally, wherein the first linear polarization state is one of an S-polarization state and a P-polarization state, and the second linear polarization state is the other of the S-polarization state and the P-polarization state, Optionally, wherein the first linear polarization state is a P-polarization state and the second linear polarization state is an S-polarization state.

99. The system of any one of claims 91 to 98, wherein, The linear polarizer and the optical retarder are formed on the optical device, and wherein the system further comprises an anti-reflection (AR) coating formed on the first side of the linear polarizer.

100. The system of any one of claims 91 to 99, wherein, The target device comprises a plurality of components forming an irregular pattern.

101. The system of any one of claims 91 to 100, wherein, The optical device comprises: an optical directing device configured to direct the target light to propagate within the optical directing device along a first direction, the light having a spectral bandwidth and a peak wavelength; an in-coupling diffractive structure configured to diffract the light to propagate in the optical directing device; and one or more out-coupling diffractive structures disposed downstream of the in-coupling diffractive structure along the first direction and configured to diffract at least a portion of the light out of the optical directing device along a second direction different from the first direction to the target device, Optionally, wherein the in-coupling diffractive structure is configured to induce a first optical dispersion of the light, and at least one of the one or more out-coupling diffractive structures is configured to induce a second optical dispersion of the light, and wherein the first optical dispersion and the second optical dispersion complement each other such that light diffracted out of the optical steering device has no or almost no optical dispersion, Optionally, wherein the target light comprises different colors of light, and wherein the in-coupling diffractive structure comprises a corresponding first diffractive grating for each different color of light, and wherein each of the plurality of out-coupling diffractive structures comprises a corresponding second diffractive grating for each different color of light.

102. The system of any one of claims 91 to 101, wherein, The linear polarizer and the optical retarder are formed on the same side of the optical device, or wherein the linear polarizer and the optical retarder are formed on opposite sides of the optical device.

103. The system of any one of claims 91 to 102, wherein, The target device comprises a display, a light sensor, or a camera.

104. The system of any of claims 91-103, further comprising the target device.

105. The system of any one of claims 91 to 104, wherein, The target device is a display, the display comprising: a backplane comprising a plurality of circuits; and a plurality of display components disposed on the backplane, the plurality of display components forming an irregular pattern, wherein each of the plurality of display components is coupled to a respective circuit of the plurality of circuits; and wherein the system further comprises: an illuminator configured to emit the target light; and a controller coupled to the display and the illuminator, wherein the controller is configured to: transmit at least one control signal to at least one display component of the display to modulate at least one property of the at least one display component, modulate the display with information associated with a first color during a first time period and with information associated with a second color during a second, sequential time period; and control the illuminator to sequentially turn on a first light-emitting component to emit light having the first color during the first time period and a second light-emitting component to emit light having the second color during the second, sequential time period.

106. A device comprising: an optical device configured to deflect target light toward a target device, the target light being linearly polarized; a linear polarizer configured to transmit light having a linear polarization state; and an optical retarder configured to change a polarization state of light passing through the optical retarder, wherein the linear polarizer and the optical retarder are configured to cause ambient light to pass through the linear polarizer once and the optical retarder twice in sequence to be blocked by the linear polarizer, and wherein the optical device, the linear polarizer, and the optical retarder are configured to cause the target light to pass through the optical retarder twice and the linear polarizer once in sequence to be transmitted through the linear polarizer.

107. A method comprising: determining, based on a plurality of shapes in a region of a device to be formed, whether the device to be formed is capable of suppressing light of a higher diffraction order relative to a principal order, each of the plurality of shapes uniquely corresponding to a respective point of a plurality of points in the region; if the device to be formed is capable of suppressing light of the higher diffraction order, then for each of the plurality of shapes: determining whether a positional relationship between the shape and the respective point satisfies one or more conditions, and if the positional relationship between the shape and the respective point fails to satisfy the one or more conditions, modifying the shape such that a positional relationship between the modified shape and the respective point satisfies the one or more conditions; and generating a configuration file of the to-be-formed device based on the shape that satisfies the one or more conditions, the to-be-formed device comprising a plurality of components to be formed, each to-be-formed component corresponding to a respective shape of the shape that satisfies the one or more conditions.

108. The method of claim 107, further comprising at least one of: if the positional relationship between the shape and the respective point satisfies the one or more conditions, determining that the shape is a shape that satisfies the one or more conditions, or if the to-be-formed device fails to suppress light of a higher diffraction order, adjusting one or more parameters used to generate the plurality of shapes to generate a plurality of new shapes in the region of the device based on the plurality of points in the region.

109. The method of claim 107 or 108, further comprising: generating a plurality of irregularly arranged points in the region based on the plurality of points, each of the plurality of irregularly arranged points corresponding to a respective point of the plurality of points; and generating the plurality of shapes in the region of the to-be-formed device based on the plurality of irregularly arranged points according to an irregular pattern, each of the plurality of shapes uniquely enclosing a respective irregularly arranged point of the plurality of irregularly arranged points, optionally, wherein the plurality of points are regularly arranged in the region, and wherein the plurality of points define a regularly arranged pattern, optionally, wherein generating the plurality of irregularly arranged points in the region based on the plurality of points comprises adding different offsets to the plurality of points to generate the plurality of irregularly arranged points, optionally, wherein the method further comprises determining the different offsets based on a Poisson noise distribution.

110. The method of any one of claims 107 to 109, wherein, determining whether the to-be-formed device is capable of suppressing light of a higher diffraction order based on the plurality of shapes in the region of the to-be-formed device comprises: performing a discrete Fourier transform on centroids of the plurality of shapes; and determining whether the to-be-formed device is capable of suppressing light of a higher diffraction order based on a result of the discrete Fourier transform, optionally, wherein determining whether the to-be-formed device is capable of suppressing light of a higher diffraction order based on the result of the discrete Fourier transform comprises determining a first intensity of light of the primary order and a second intensity of light of the higher diffraction order based on the result of the discrete Fourier transform, and determining whether a ratio of the first intensity of light of the primary order to the second intensity of light of the higher diffraction order is greater than a predetermined threshold value, Optionally, the method further comprises: if, based on the result of the discrete Fourier transform, the device-to-be-formed is capable of suppressing light of higher diffraction orders, fabricating a sample on the substrate according to the plurality of shapes, and measuring a diffraction pattern of the sample; determining whether the sample is capable of suppressing light of higher diffraction orders based on the measured diffraction pattern of the sample; if, based on the measured diffraction pattern of the sample, the sample is capable of suppressing light of higher diffraction orders, determining that the device-to-be-formed is capable of suppressing light of higher diffraction orders; and if, based on the measured diffraction pattern of the sample, the sample is incapable of suppressing light of higher diffraction orders, determining that the device-to-be-formed is incapable of suppressing light of higher diffraction orders, Optionally, fabricating the sample on the substrate according to the plurality of shapes comprises etching a metal-coated substrate according to the plurality of shapes.

111. The method of any one of claims 107 to 110, wherein, Determining whether the positional relationship between the shape and the corresponding point satisfies the one or more conditions comprises: Determining whether a distance between each vertex of the shape and the corresponding point is less than a predetermined threshold; and If the distance between a vertex of the shape and the corresponding point is less than the predetermined threshold, moving the vertex along a line between the vertex and the corresponding point such that a distance between the moved vertex and the corresponding point is greater than or equal to the predetermined threshold, and connecting the moved vertex with one or more other vertices of the shape, Optionally, each point of the plurality of points corresponds to a via for connecting a corresponding shape to a component of the device-to-be-formed, and wherein the predetermined threshold is determined based on at least one of a radius of the via, a manufacturing tolerance, or a gap between adjacent components of the plurality of components to be formed, Optionally, determining whether the positional relationship between the shape and the corresponding point satisfies the one or more conditions comprises: determining whether a distance between each edge of the shape and the corresponding point is less than a second threshold; and if the distance between an edge of the shape and the corresponding point is less than the second threshold, modifying the edge of the shape, Optionally, modifying the edge of the shape comprises: inserting a new vertex between two vertices of the edge at a distance from the corresponding point that is not less than the predetermined threshold, and modifying the shape by connecting the new vertex with the two vertices of the edge, respectively, Optionally, a line connecting the new vertex and the corresponding point is perpendicular to the edge, Optionally, the distance between the new vertex and the corresponding point is the same as a value greater than or equal to the predetermined threshold, Optionally, the distances between at least two new vertices and the corresponding point are different, Optionally, modifying the edge of the shape is performed after determining that each vertex of the edge is spaced from the corresponding point by a corresponding distance that is not less than the predetermined threshold, Optionally, the method comprises: iteratively repeating (i) determining whether a distance between each vertex of the shape and the corresponding point is less than the predetermined threshold and (ii) determining whether a distance between each edge of the shape and the corresponding point is less than the second threshold until all shapes in the region satisfy the one or more conditions, Optionally, the second threshold is determined based on the predetermined threshold.

112. The method of any one of claims 107 to 111, wherein, Each of the shapes that satisfy the one or more conditions has at least one of: a distance between each vertex of the shape and the respective point is not less than a first threshold, or a distance between each edge of the shape and the respective point is not less than a second threshold.

113. The method of any of claims 107-112, further comprising: performing a discrete Fourier transform on a centroid of the shapes that satisfy the one or more conditions; and determining, based on a result of the discrete Fourier transform, whether the to-be-formed device is capable of suppressing light of higher diffraction orders, optionally, wherein the method further comprises: if, based on the result of the discrete Fourier transform, the to-be-formed device is capable of suppressing light of higher diffraction orders, fabricating a sample on a substrate according to the shapes, and measuring a diffraction pattern of the sample; determining, based on the measured diffraction pattern of the sample, whether the sample is capable of suppressing light of higher diffraction orders; and if, based on the measured diffraction pattern of the sample, the sample is capable of suppressing light of higher diffraction orders, determining that the to-be-formed device is capable of suppressing light of higher diffraction orders, wherein, in response to determining that the to-be-formed device is capable of suppressing light of higher diffraction orders, generating the configuration file of the to-be-formed device.

114. A method of fabricating an irregular device, comprising: forming a plurality of components on a backplane comprising a plurality of circuits, wherein each of the plurality of components comprises a metal electrode, the metal electrodes of the plurality of components are isolated from each other and form an irregular pattern, wherein each of the metal electrodes is coupled to a respective circuit of the plurality of circuits in the backplane through a corresponding via of a plurality of vias, and wherein a positional relationship between the metal electrode and the corresponding via satisfies one or more conditions.

115. The method of claim 114, wherein, the positional relationship between the metal electrode and the corresponding via comprises: a distance between each vertex of a shape of the metal electrode and a center point of the corresponding via is not less than a first threshold; and a distance between each edge of the shape and the center point is not less than a second threshold, optionally, wherein at least one of the first threshold or the second threshold is determined based on at least one of a radius of the corresponding via, a fabrication tolerance, or a gap between adjacent metal electrodes, and optionally, wherein forming the plurality of components comprises: forming a metal layer on top of the plurality of vias; and patterning the metal layer according to the irregular pattern to obtain the metal electrodes.

116. The method of claim 114 or 115, further comprising: prior to forming the plurality of components, aligning a patterned light beam with positions of the plurality of vias on the backplane, wherein aligning the patterned light beam with the positions of the plurality of vias on the backplane comprises: aligning the patterned light beam with at least one alignment mark on a peripheral region of the plurality of components; forming a test pattern in a region of the plurality of components, wherein the test pattern comprises one or more shapes; determining whether a corresponding via is located in a region bounded by the one or more shapes; and if the alignment via is located in the region bounded by the one or more shapes, determining that the patterned light beam is aligned with the positions of the plurality of vias, wherein the plurality of components are formed in response to determining that the patterned light beam is aligned with the locations of the plurality of through-holes, Optionally, wherein the method comprises: if the calibration through-hole is outside the area defined by the one or more shapes of the test pattern, aligning the patterned light beam with the locations of the plurality of through-holes on the backplane again, Optionally, wherein a size of the area defined by the one or more shapes is not greater than a tolerance distance of the plurality of through-holes, and wherein the tolerance distance is determined based on at least one of a radius of the plurality of through-holes, a manufacturing tolerance, or a gap between adjacent metal electrodes, Optionally, wherein the plurality of components are formed on the backplane based on a profile of the irregular device, the profile of the irregular device comprising information of a plurality of shapes, each information of a shape corresponding to a respective metal electrode of the metal electrodes, and wherein the positional relationship between the metal electrode and the corresponding through-hole is determined based on the information of the corresponding shape of the metal electrode and information of a center point of the corresponding through-hole, Optionally, wherein the plurality of components are distributed into a plurality of panels that are adjacently arranged on the backplane, Optionally, wherein the method comprises: for each panel of the plurality of panels, aligning the patterned light beam with locations of through-holes in the panel, and forming corresponding metal electrodes in the panel after the aligning.

117. The method of any one of claims 114 to 116, wherein, Forming the plurality of components comprises: forming a first alignment layer on top of the metal electrodes; forming individual spacers on the first alignment layer; forming a liquid crystal layer on the first alignment layer; forming a second alignment layer on top of the liquid crystal layer and the individual spacers; and forming a transparent conductive layer on top of the second alignment layer as a common electrode, Optionally, wherein the plurality of through-holes are regularly arranged on the plurality of circuits, Optionally, wherein, among the plurality of through-holes, at least two pairs of adjacent through-holes have different pitches.

118. An apparatus comprising: a backplane comprising a plurality of circuits; and a plurality of components arranged on the backplane, wherein each of the plurality of components comprises a metal electrode, wherein each of the metal electrodes is coupled to a respective circuit of the plurality of circuits in the backplane through a corresponding through-hole of a plurality of through-holes, and wherein a positional relationship between the metal electrode and the corresponding through-hole satisfies one or more conditions.

119. A system comprising: an apparatus comprising: a backplane comprising a plurality of circuits; and a plurality of components arranged on the backplane, wherein each of the plurality of components comprises a metal electrode, wherein each of the metal electrodes is coupled to a respective circuit of the plurality of circuits in the backplane through a corresponding through-hole of a plurality of through-holes, and wherein a positional relationship between the metal electrode and the corresponding through-hole satisfies one or more conditions; and a controller coupled to the apparatus and configured to transmit at least one control signal to at least one component in the apparatus to modulate at least one property in the at least one component.

120. An apparatus comprising: a plurality of components configured in rows and columns; and a controller coupled to the plurality of components, the controller comprising a plurality of drive circuits and a plurality of row scanners, wherein each of the plurality of components is coupled to a respective drive circuit of the plurality of drive circuits, and wherein the row scanner comprises a row scanner having a series of selectors disposed in a column between two adjacent columns of components, each selector of the series of selectors being configured to select a corresponding row component by coupling to a corresponding drive circuit of the corresponding row component.

121. The apparatus of claim 120, wherein, the plurality of components comprises a column component disposed on the series of selectors of the row scanner, the column component being between the two adjacent columns of components, optionally, wherein each of the plurality of components comprises a respective electrode, and wherein the electrode of a component of the column component is coupled to the electrode of a corresponding component in a column of the two adjacent columns of components, optionally, wherein the respective electrodes of the plurality of components are coupled to the plurality of drive circuits by a regular arrangement of conductive vias, optionally, wherein the column component comprises a first component and a second component adjacent to the first component along the column component, wherein the electrode of the first component is coupled to the electrode of a first adjacent component in a first column of the two adjacent columns of components, and the electrode of the second component is coupled to the electrode of a second adjacent component in a second column of the two adjacent columns of components, and wherein the first component and the first adjacent component are in a same first row, and the second component and the second adjacent component are in a same second row adjacent to the same first row, and optionally, wherein each of the plurality of components comprises a respective electrode, and the respective electrodes of the column component are coupled together to a driver configured to set a fixed value or a randomized value for each refresh of the column component.

122. The apparatus of claim 120 or 121, wherein, the plurality of components forms an irregular pattern, optionally, wherein the irregular pattern comprises a Voronoi pattern, optionally, wherein at least one component of the plurality of components has an irregular polygonal shape, optionally, wherein adjacent components of the plurality of components have different shapes.

123. The apparatus of any one of claims 120 to 122, wherein, the row components extend along a first direction, and the column components extend along a second direction perpendicular to the first direction, wherein the row scanner is a first row scanner coupled to a first plurality of components coupled to a first plurality of drive circuits in a first panel, and wherein the plurality of row scanners comprises a second row scanner coupled to a second plurality of components coupled to a second plurality of drive circuits in a second panel, wherein the first panel and the second panel are disposed along the second direction, optionally, wherein the controller comprises control circuitry disposed on a peripheral region adjacent to the plurality of components, wherein the control circuitry comprises first control circuitry and second control circuitry on opposite sides of the plurality of components, and wherein the first control circuitry is adjacent to and coupled to the first plurality of drive circuits in the first panel, and the second control circuitry is adjacent to and coupled to the second plurality of drive circuits in the second panel, Optionally, wherein the first control circuit comprises: a digital circuit configured to receive digital data for modulating the first plurality of components, and an analog circuit comprising: one or more digital-to-analog converters (DACs) coupled to the digital circuit and configured to convert the digital data into corresponding analog voltage signals, and one or more drivers coupled to the plurality of first drive circuits and configured to drive each of the analog voltage signals to a respective first drive circuit of the plurality of first drive circuits to modulate a corresponding component of the first plurality of components.

124. The apparatus of any one of claims 120 to 123, wherein, The row components extend along a first direction, and the column components extend along a second direction perpendicular to the first direction, and wherein the controller comprises a control circuit stacked with the plurality of drive circuits and the plurality of row scanners along a third direction perpendicular to the first direction and the second direction, Optionally, wherein the plurality of drive circuits and the plurality of row scanners are disposed in a first layer, and the control circuit is disposed in a second layer, and the first layer and the second layer are stacked along the third direction.

125. The apparatus of any one of claims 120 to 124, wherein, The plurality of components comprises a common electrode, and each of the plurality of components comprises a respective metal electrode, wherein the drive circuit comprises: a selection switch, a conversion switch, a reset switch, which are coupled in series between a first input and a second input of the drive circuit, wherein the drive circuit is configured to receive a first input voltage at the first input and a second input voltage at the second input, a first capacitor having a first terminal coupled between the conversion switch and the reset switch and a second terminal coupled to the second input, the first terminal of the first capacitor being coupled to a metal electrode of a corresponding component associated with the drive circuit; and a second capacitor having a first terminal coupled between the selection switch and the conversion switch and a second terminal coupled to the second input, wherein a voltage at the metal electrode of the corresponding component is the same as a voltage at the first terminal of the first capacitor, and a change in the voltage at the first terminal of the first capacitor is based on a change in the first input voltage, a capacitance of the first capacitor, and a capacitance of the second capacitor.

126. The apparatus of any one of claims 120 to 125, wherein, The plurality of components comprises a common electrode, and each of the plurality of components comprises a respective metal electrode, wherein the drive circuit is a differential circuit comprising a capacitor having a first terminal coupled to a first circuit portion of the drive circuit and a second terminal coupled to a second circuit portion of the drive circuit, the first terminal being coupled to a metal electrode of a corresponding component associated with the drive circuit, and wherein a voltage at the metal electrode of the corresponding component is the same as a voltage at the first terminal of the capacitor, and a change in the voltage at the first terminal is based on a difference between a first input voltage of the first circuit portion and a second input voltage of the second circuit portion, Optionally, wherein the selector of the row scanner comprises a shift register having a flip-flop or a latch.

127. An apparatus comprising: a plurality of components, wherein the plurality of components comprises a common electrode, and each of the plurality of components comprises a respective metal electrode, the metal electrodes of the plurality of components being isolated from each other; and a plurality of drive circuits coupled to the plurality of components, wherein each of the plurality of drive circuits is configured to drive a corresponding component of the plurality of components based on a voltage at a first input of the drive circuit, and a controller coupled to the plurality of components, wherein the controller comprises a plurality of drive circuits, wherein each of the plurality of components is coupled to a respective drive circuit of the plurality of drive circuits, wherein a drive circuit of the plurality of drive circuits comprises a capacitor having a first terminal coupled to a first circuit portion of the drive circuit and a second terminal coupled to a second circuit portion of the drive circuit, the first terminal is coupled to a metal electrode of a corresponding component associated with the drive circuit, and wherein a voltage at the metal electrode of the corresponding component is the same as a voltage at the first terminal of the capacitor, and a change of the voltage at the first terminal is based on a difference between a first input voltage of the first circuit portion and a second input voltage of the second circuit portion.

128. The apparatus of claim 127, wherein, the corresponding component is configured to modulate based on a difference between a common voltage applied on a common electrode and the voltage at the first terminal, wherein the drive circuit is configured to drive the corresponding component during a refresh period having a negative cycle and a positive cycle, wherein the common voltage applied on the common electrode is set to a first fixed voltage during the negative cycle and a second fixed voltage during the positive cycle, the first fixed voltage is higher than the second fixed voltage, wherein the first input voltage is configured to change from a first higher input voltage to a first lower input voltage during the negative cycle and from the first lower input voltage to the first higher input voltage during the positive cycle, and wherein the second input voltage is configured to change from a second lower input voltage to a second higher input voltage during the negative cycle and from the second higher input voltage to the second lower input voltage during the positive cycle, optionally, wherein the first lower input voltage is the same as the second lower input voltage, and the first higher input voltage is the same as the second higher input voltage.

129. The apparatus of claim 127 or 128, wherein, the drive circuit comprises a first input configured to receive the first input voltage as an input of the first circuit portion, a second input configured to receive the second input voltage as an input of the second circuit portion, and a third input configured to receive a third input voltage, wherein the second terminal of the capacitor is coupled to the third input of the drive circuit and is configured to receive the third input voltage, and wherein a sum of the first input voltage and the second input voltage is the same as twice of the third input voltage.

130. The apparatus of any one of claims 127 to 129, wherein, the capacitor is a first capacitor, and the drive circuit comprises a second capacitor, and wherein a first terminal of the second capacitor is coupled to a node between an input of the first circuit portion and the first terminal of the first capacitor in the first circuit portion, and a second terminal of the second capacitor is coupled to a node between an input of the second circuit portion and the second terminal of the first capacitor in the second circuit portion, optionally, wherein the change of the voltage at the first terminal is based on a capacitance of the first capacitor and a capacitance of the second capacitor, wherein the change of the voltage at the first terminal satisfies an expression as follows: ， wherein represents the change in the voltage at the first terminal, Ce represents the capacitance of the first capacitor, Cs represents the capacitance of the second capacitor, represents the difference between the first input voltage and the second input voltage, Optionally, a ratio of a capacitance of the second capacitor Cs to a capacitance of the first capacitor Ce is greater than 1. Optionally, wherein the first circuit portion comprises a first selection switch and a first transfer switch coupled in series between an input of the first circuit portion and the first terminal of the first capacitor, the first terminal of the second capacitor is coupled between the first selection switch and the first transfer switch, and wherein the second circuit portion comprises a second selection switch and a second transfer switch coupled in series between an input of the second circuit portion and the second terminal of the first capacitor, the second terminal of the second capacitor is coupled between the second selection switch and the second transfer switch, Optionally, wherein the first selection switch and the second selection switch are configured to receive a same selection signal to be turned on or off simultaneously, and wherein the first transfer switch and the second transfer switch are configured to receive a same transfer signal to be turned on or off simultaneously, Optionally, wherein the drive circuit further comprises a reset switch coupled between the first terminal of the first capacitor and the second terminal of the first capacitor, wherein the reset switch is configured to receive a reset signal to reset the voltage at the metal electrode, Optionally, wherein at least one of the first selection switch, the second selection switch, the first transfer switch, the second transfer switch, or the reset switch comprises a transistor, Optionally, wherein the drive circuit is configured to operate in a series of states, the series of states comprising: i) a wait state, during which the first selection switch, the second selection switch, the first transfer switch, the second transfer switch, and the reset switch are turned off, ii) a sampling state, during which the first selection switch and the second selection switch are turned on to receive the first input voltage at the first terminal of the second capacitor and the second input voltage at the second terminal of the second capacitor, and the first transfer switch, the second transfer switch, and the reset switch are turned off, iii) a reset state, during which the first selection switch, the second selection switch, the first transfer switch, and the second transfer switch are turned off, and the reset switch is turned on to reset the voltage at the metal electrode to be the same as a reset voltage of the drive circuit, and iv) a transfer state, during which the first selection switch, the second selection switch, and the reset switch are turned off, and the first transfer switch and the second transfer switch are turned on such that the voltage at the first terminal of the first capacitor is the same as the voltage at the first terminal of the second capacitor, and the voltage at the second terminal of the first capacitor is the same as the voltage at the second terminal of the second capacitor, Optionally, wherein the voltage at the second terminal of the first capacitor and the voltage at the second terminal of the second capacitor are the same as the reset voltage of the drive circuit, Optionally, wherein, during the transfer state, the voltage at the first terminal of the first capacitor satisfies the following expression: ， wherein vPe V1represents the voltage at the first terminal of the first capacitor, vSp V2represents the voltage at the first terminal of the second capacitor, Ce C1represents the capacitance of the first capacitor, Cs C2represents the capacitance of the second capacitor, vDatp Vin1represents the first input voltage, vDatn Vin2represents the second input voltage, and vCm Vresetrepresents the reset voltage, Optionally, wherein the corresponding component is configured to modulate based on a difference between a common voltage applied on the common electrode and the voltage at the first terminal, wherein the driving circuit is configured to drive the corresponding component during a refresh period having a negative period and a positive period, wherein the common voltage applied on the common electrode is set to a first fixed voltage during the negative period and a second fixed voltage during the positive period, the first fixed voltage being higher than the second fixed voltage, and wherein the common voltage changes from the first fixed voltage to the second fixed voltage during the reset state and before the transfer state.

131. An apparatus comprising: a first integrated structure comprising a plurality of components extending in rows along a first direction and in columns along a second direction perpendicular to the first direction; and a second integrated structure comprising control circuitry for the plurality of components, wherein the first integrated structure and the second integrated structure are stacked together along a third direction perpendicular to the first direction and the second direction, wherein the plurality of components form an irregular pattern.

132. The apparatus of claim 131, wherein, The first integrated structure comprises a plurality of driving circuits, each of the plurality of driving circuits being coupled to a respective component of the plurality of components, Optionally, wherein the first integrated structure comprises a plurality of row scanners, wherein the plurality of row scanners comprises a row scanner having a series of selectors disposed below column components between two adjacent columns of components, each selector of the series of selectors being configured to select a corresponding row component by a corresponding driving circuit coupled to the corresponding row component, Optionally, wherein the first integrated structure comprises a plurality of row scanners coupled to the plurality of driving circuits, and wherein the plurality of row scanners and the plurality of driving circuits are stacked together along the third direction.

133. The apparatus of claim 132, wherein, The plurality of components comprises a common electrode, and each of the plurality of components comprises a respective metal electrode, wherein a driving circuit of the plurality of driving circuits comprises a capacitor having a first terminal coupled to a first circuit portion of the driving circuit and a second terminal coupled to a second circuit portion of the driving circuit, the first terminal being coupled to a metal electrode of a corresponding component associated with the driving circuit, and wherein a voltage at the metal electrode of the corresponding component is the same as a voltage at the first terminal of the capacitor, and a change in the voltage at the first terminal is based on a difference between a first input voltage of the first circuit portion and a second input voltage of the second circuit portion.

134. The apparatus of any one of claims 131 to 133, wherein, The control circuitry comprises: digital circuitry configured to receive digital data for modulating the plurality of components, and analog circuitry, each analog circuitry comprising: one or more digital-to-analog converters (DACs) coupled to a corresponding digital circuitry and configured to convert corresponding digital data into a corresponding analog voltage signal, and one or more drivers coupled to a corresponding driving circuit and configured to drive each of the analog voltage signals to a respective driving circuit of the corresponding driving circuit to modulate a corresponding component of the plurality of components.

135. The apparatus of any one of claims 131 to 134, wherein, The first integrated structure and the second integrated structure are integrated together by bonding, Optionally, wherein the bonding comprises at least one of direct bonding or hybrid bonding.

Images