Four-dimensional energy guidance system and method

Abstract

An energy directing system may include one or more energy sources and a plurality of energy directing surfaces configured to direct incident energy therefrom along a plurality of energy propagation paths. The plurality of energy directing surfaces are arranged such that the energy propagation paths from each energy directing surface are respectively defined as four-dimensional coordinates, the four-dimensional coordinates comprising two spatial coordinates corresponding to the position of the respective energy directing surface and two angular coordinates defining the angular direction of the respective propagation paths. Instructions for operating the one or more energy sources and the energy directing surfaces may be determined using energy attribute data.

Description

Technical Field

[0001] The present disclosure relates to energy guiding systems, and more particularly, to energy guiding systems in which energy guiding surfaces are arranged and configured to guide energy in a four-dimensional coordinate system. Background Art

[0002] The dream of an interactive virtual world in a "holodeck" room, popularized by Gene Roddenberry's Star Trek, was originally conceived by writer Alexander Moszkowski in the early 20th century, and has been an inspiration for science fiction and technological innovation for nearly a century. However, no convincing implementation of this experience exists outside of literature, the media, and the collective imagination of children and adults alike. The present application teaches systems and methods for rendering information from a 3D environment into a format that allows a 4D energy field projection system to output a 4D energy field modeled on a scene from a 3D environment. Summary of the invention

[0003] An energy field is a vector function that describes the flow of energy in multiple directions at multiple points in space. An energy directing system may include multiple energy directing surfaces where energy is directed in multiple directions with different energy properties. Each physical location on an energy directing surface has two-dimensional ("2D") spatial coordinates (x, y), and each direction of an output energy propagation path is described in three-dimensional ("3D") space as two angular coordinates Or equivalently, by the normalized coordinates (u,v). The 2D spatial coordinates (x,y) and the 2D angular coordinates together form the 4D coordinates Each energy propagation ray is described as the position and angle of energy projection from that position.

[0004] Energy can be directed from a fixed location along a series of energy propagation paths by deflecting the energy beam using energy directing surfaces configured to implement the angular coordinates θ and θ of the energy pointing. constant or continuous change.

[0005] An embodiment of an energy directing system according to the principles of the present disclosure comprises: 1) a plurality of energy sources; 2) a plurality of energy directing surfaces, each configured to receive energy from at least one of the plurality of energy sources and direct energy therefrom along a plurality of energy propagation paths; and 3) a controller, in communication with the plurality of energy sources and the plurality of energy directing surfaces, the controller being operable to provide synchronization signals to the energy sources and the energy directing surfaces to selectively direct energy along different energy propagation paths. The plurality of energy directing surfaces are arranged such that the energy propagation paths from each energy directing surface are respectively defined as four-dimensional coordinates, the four-dimensional coordinates comprising two spatial coordinates corresponding to the position of the corresponding energy directing surface and two angular coordinates defining the angular direction of the corresponding propagation path.

[0006] An embodiment of an energy directing system according to principles of the present disclosure includes: 1) an energy source configured to provide collimated energy;

[0007] 2) an array of energy directing surfaces, each energy directing surface configured to receive the collimated energy and deflect the received energy therefrom along a plurality of energy propagation paths; and 3) a controller in communication with the energy directing surfaces, the controller being operable to provide signals to the energy directing surfaces to selectively direct energy along different energy propagation paths. The plurality of energy directing surfaces are arranged in an array such that the energy propagation paths from each energy directing surface are respectively defined as four-dimensional coordinates, the four-dimensional coordinates comprising two spatial coordinates corresponding to the position of the corresponding energy directing surface and two angular coordinates defining the angular direction of the corresponding propagation path.

[0008] An embodiment of a method for guiding energy according to a four-dimensional function in accordance with the principles of the present disclosure comprises the following steps: 1) receiving a data set including energy property data of a plurality of 4D coordinates in a four-dimensional (“4D”) coordinate system, the plurality of 4D coordinates respectively including two spatial coordinates defining the spatial positions of a plurality of energy guiding surfaces in the 4D coordinate system and two angular coordinates defining the angular directions of the energy propagation paths from each energy guiding surface, the plurality of energy guiding surfaces being configured to each receive energy from one or more energy sources and guide the energy therefrom along a plurality of energy propagation paths; 2) processing the data set into data subsets, each data subset including the energy property data of the two angular coordinates of the energy propagation paths having the same two spatial coordinates in the 4D coordinate system; 3) determining, based on a first data subset, a first instruction for operating a first energy guiding surface, the instruction including a sequence of guiding energy along different energy propagation paths of the first energy guiding surface, the first data subset including the energy property data of the angular coordinates of the energy propagation paths of the first energy guiding surface; and 4) operating the first energy guiding surface to guide energy in a time-continuous manner in accordance with the determined first instruction. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1A An orthogonal view of an energy guiding device including a configurable reflective metasurface that can be used to deflect incident energy along multiple propagation paths is shown;

[0010] Figure 1B An orthogonal view of an energy guiding device including a configurable transmissive metasurface that can be used to deflect incident energy along multiple propagation paths is shown;

[0011] Figure 1C An orthogonal view showing one embodiment of an energy directing device having a tilted energy reflector tilted about two axes, shown in a zero tilt state;

[0012] Figure 1D Show Figure 1C Orthogonal view of an energy guiding system, wherein the tilted reflector is tilted at an angle θ on one axis and at an angle θ on another orthogonal axis.

[0013] Figure 2A is an orthogonal side view of an energy directing module including an energy source and a configurable energy directing surface;

[0014] Figure 2Bis an orthogonal side view of an energy directing module including an energy source and a configurable energy directing surface operable to direct energy along a plurality of energy propagation paths arranged about an energy propagation axis orthogonal to a base of the module;

[0015] Figure 2C is an orthogonal side view of an energy directing module including an energy source and a configurable energy directing surface operable to direct energy along a plurality of energy propagation paths arranged about an energy propagation axis that is not orthogonal to a base of the module;

[0016] Figure 2D is an orthogonal side view of an energy directing module including an energy source and a configurable transmissive energy directing surface of an energy directing device;

[0017] Figure 2E is an orthogonal side view of an energy directing module including an energy source and a configurable transmissive energy directing surface of an energy directing device, the configurable transmissive energy directing surface being operable to deflect incident energy along an energy propagation path about an energy propagation axis;

[0018] Figure 2F is an orthogonal side view of an energy guiding module, which is similar to Figure 2E An energy directing module as shown in , but with a different deflection angle of the energy propagation axis tilted relative to the normal of the mechanical base of the module;

[0019] Figure 2G is an orthogonal side view of an energy guiding module including an energy guiding layer including three reconfigurable transmissive energy guiding sites defined within a common substrate;

[0020] Figure 2H is an orthogonal side view of a modular energy source;

[0021] Fig.2I showing an orthogonal view of an energy guiding system having an energy guiding layer including a plurality of independently controlled energy guiding sites defined in a single substrate, each energy guiding site deflecting energy from an energy source module;

[0022] Figure 3A is an orthogonal side view of a modular energy source including a single point-like energy source and a focusing element;

[0023] Figure 3B An orthogonal view of an energy guiding system having an energy guiding device including a plurality of independently controllable reconfigurable energy guiding sites defined in a single substrate and a plurality of energy source modules is shown;

[0024] Figure 3Cis an orthogonal view of an energy directing system including an array of energy directing modules at a first time instance t1;

[0025] Figure 3D At the second time instance t2 Figure 3C The energy guidance system shown in ;

[0026] Figure 4A is an orthogonal side view of an energy directing module including a single point energy source and a configurable transmissive energy directing device that produces collimated and deflected output energy;

[0027] Figure 4B is an orthogonal side view of an energy directing module containing a single point-like energy source and a configurable transmissive energy directing device that produces substantially collimated but slightly focused output energy;

[0028] Figure 4C is an orthogonal side view of an energy directing module including a single point energy source and a configurable transmissive energy directing device that produces energy that is collimated and about an energy projection axis that is tilted relative to a normal to the energy directing surface.

[0029] Figure 5A is a schematic diagram illustrating the operation of a first energy directing module;

[0030] Figure 5B It is shown Figure 5A A schematic diagram of an embodiment of an energy directing module shown in ;

[0031] Figure 5C is a schematic diagram illustrating the operation of the second energy directing module;

[0032] Figure 5D It is shown Figure 5C A schematic diagram of an embodiment of an energy directing module shown in ;

[0033] Figure 5E is a schematic diagram illustrating the operation of the third energy directing module;

[0034] Fig. 5F It is shown Figure 5E A schematic diagram of an embodiment of an energy directing module shown in ;

[0035] Figure 6 is a perspective view of one embodiment of an energy directing system including an array having eight energy directing modules, each module including an energy directing device that redirects energy from a modulated energy source into an energy propagation path;

[0036] Figure 7is a perspective view of one embodiment of an energy guiding system including an array having eight energy guiding modules, each module including a reconfigurable transmissive energy guiding device that redirects energy from a modulated energy source into an energy propagation path;

[0037] Fig. 8A is a perspective view of one embodiment of an energy guiding system having an energy guiding layer including a plurality of independently controlled energy guiding sites defined in a single substrate, each energy guiding site deflecting energy from an energy source;

[0038] Figure 8B is a perspective view of another embodiment of an energy guiding system having an energy guiding layer including a plurality of independently controlled energy guiding sites defined in a single substrate, each energy guiding site deflecting a portion of incident collimated energy;

[0039] Figure 8C is a perspective view of an energy guiding system including an array of 2-axis energy guiding devices that each reflect a portion of incident large-area collimated energy into a reflected energy propagation path;

[0040] Fig. 9 is an orthogonal view of one embodiment of an energy guiding system having an energy guiding layer including a plurality of independently controlled energy guiding sites defined in a common substrate, each energy guiding site deflecting an energy beam from one or more energy sources located on a common backplane into an energy propagation path;

[0041] Fig.10 orthogonal views showing a light field display system with a variable deflection angle; and

[0042] Fig.11 A flow chart is included illustrating a method for directing energy using the energy directing system of the present disclosure. DETAILED DESCRIPTION

[0043] One aspect of the present disclosure relates to embodiments for directing energy from a fixed location along a series of energy propagation paths by deflecting energy from an energy source using energy directing surfaces configured to change the angular coordinates θ and θ of the direction of the energy propagation paths. An example of such an energy guiding device is a metasurface. Metasurfaces can be used to create flat, compact, and reconfigurable systems that are capable of dynamically creating engineered energy wavefronts from incident energy wavefronts by spatially arranging nano-scattering elements of different sizes and subwavelength periodicity. For example, in the optical domain, a metasurface may contain multiple sites with subwavelength resolution that can be dynamically adjusted for wavelengths of light in the ultraviolet to infrared wavelength range to manipulate the phase, amplitude, and polarization of the incident light. Embodiments of these optical metasurfaces may utilize the electro-optical characteristics of nematic liquid crystals (LC) to control the phase distribution of the metasurface, thereby guiding energy reflected from or transmitted through one or more metasurface layers. The reconfiguration of the metasurface can be very fast, even on the order of microseconds, to achieve the two angular coordinates θ and Fast scanning over a wide angle range.

[0044] Another example of an energy-guiding surface is a micro-reflector that is tilted on two axes. Such a micro-reflector can be a micro-electromechanical (MEMS) device, which can be produced using micro-fabrication techniques. The physical dimensions of a MEMS device can vary from the lower end of the dimensional spectrum - well below one micron - to a few millimeters. For example, a MEMS energy reflector such as a micromirror can have a reflective surface with a diameter ranging from tens of microns to tens of millimeters and can be rotated by tens of degrees in two orthogonal axes. A MEMS energy reflector can be constructed as a 2D scanning mirror that can operate at a scanning frequency greater than 100 Hz and sometimes exceeding 1000 Hz. MEMS energy reflectors are durable because some reflectors can be tilted more than 1 billion times without causing significant wear to any moving parts.

[0045] Energy can be modulated at a high enough frequency and directed to an energy directing surface to create a distribution of energy propagation paths. In an embodiment of a scanning mirror projector, light from red, green, and blue lasers (collimated energy sources) can be modulated, combined, and reflected from a mirror that is scanned along two different tilt axes onto a screen or surface where it can be viewed. Due to the persistence of vision, a video image can be displayed on the screen or surface for the viewer to see. The number of energy propagation paths for this system can be considered to be equal to the total resolution of the projected video. For example, if the resolution of the video is 720p, then the number of discrete energy propagation paths associated with a single position of the micromirror can be the total number of pixels associated with 720p = 1280x720 or 9.2x10 5 In the context of a four-dimensional (4D) coordinate system, there are 1280 energy propagation path directions in the horizontal angle range θ and 1280 energy propagation path directions in the vertical angle range There are 720 energy propagation path directions in the image, all with the same position coordinates (x,y) of the micromirrors. The energy guiding system can use many such modules including energy sources such as lasers and energy deflection surfaces such as micromirrors to project many 4D propagation paths at each time interval, where the time interval can be the inverse of the video refresh rate. The energy sources can be configured to be modulated separately, and the energy deflection surface can only be reconfigured when the corresponding energy source is substantially turned off.

[0046] In embodiments of energy guiding systems for 4D light fields, they may be designed with high angular resolution, which may involve hundreds or thousands of angular resolution coordinates for u and v for each spatial location. For example, for a 90 degree field of view and a resolution of 60 energy propagation paths per degree in the horizontal direction, there are 5400 energy propagation paths in the horizontal range θ. Limiting factors on the number of discrete energy propagation paths in the angular range may include the modulation frequency achievable for the energy source and the speed at which the energy guiding surface can be reconfigured in a controlled and predictable manner.

[0047] In an embodiment, a 4D energy guiding system capable of achieving the above-mentioned technical effects may be constructed to include a plurality of energy sources and a plurality of energy guiding surfaces, wherein the plurality of energy guiding surfaces are configured to each receive energy from at least one of the plurality of energy sources and guide energy therefrom along a plurality of energy propagation paths. In an embodiment, the 4D energy guiding system further includes a controller communicating with the plurality of energy sources and the plurality of energy guiding surfaces, wherein the controller may be used to provide synchronization signals to the energy sources and the energy guiding surfaces to selectively guide energy along different energy propagation paths. The plurality of energy guiding surfaces may be arranged such that the energy propagation paths from each energy guiding surface are respectively defined as four-dimensional coordinates, wherein the four-dimensional coordinates include two spatial coordinates x and y corresponding to the position of the corresponding energy guiding surface and two angular coordinates θ and y defining the angular direction of the corresponding propagation path.

[0048] The energy guiding system according to the present disclosure above can be implemented in various ways. In an embodiment, the multiple energy guiding surfaces and the multiple energy sources are housed in an array of modular energy guiding modules. The array of energy guiding modules can each include an energy guiding surface that continuously deflects energy in multiple directions within a certain area or volume. In the optical domain, the energy module can be configured to combine separately modulated red, green, and blue lasers into a single beam that is reflected from an integrated scanning mirror that operates fast enough to project VGA or higher resolution video (e.g., TriLite Technologies, Inc.). In addition, the metasurface can be used as an energy guiding surface, both as a transmission device and as a reflective surface device.

[0049] In embodiments, the present disclosure provides various examples of implementing energy directing systems using an array of energy directing surfaces and a single collimated modulated energy source, rather than using multiple energy sources.

[0050] The energy directing system may be optimized by a corresponding energy surface that projects energy focused within a defined volume. This volume may be an area where a holographic object is generated using converging light rays, a tactile surface is created using ultrasonic energy, and the like. An optimized configuration may be one in which the angular range of the energy propagation path from the energy surface is adjusted based on the position on the energy surface. For example, if the viewing volume is located near the centerline of a light field display, then the optimal projection angle range near the edge of the light field display may be tilted toward the center of the light field display. The present disclosure provides various embodiments for configuring the mounting angles of energy directing modules to achieve a desired arrangement of angles of energy projection from the energy directing surface.

[0051] Figure 1A An orthogonal view of an energy guiding surface 120 is shown, which includes a configurable reflective metasurface 122 including an active region, the active region including a plurality of nanostructures 121, some of which can be individually controlled by a controller 123, the configurable reflective metasurface 122 being configured to reflect light along two orthogonal axes θ, The metasurface 122 is an energy guiding surface. The nanostructures 121 on the metasurface 122 are configured to reflect the incident energy beam 125 to an energy propagation path 126, but the system 120 can be configured to be located between the axes θ and Many propagation paths are generated within the angular range, including the energy propagation paths 127 and 128 shown. Figure 1A The energy guiding system 120 in FIG. 1 is shown as deflecting incident energy 125 to an energy propagation path in one plane about one direction (θ), but it can also be directed in a direction orthogonal to θ. deflects energy along the propagation paths in the direction of Figure 1A Ultimately, the number of resolvable energy propagation path directions on the two axes depends on the detailed construction of the energy-guiding metasurface. In an embodiment, the reconfigurable metasurface 122 can be used to implement θ or The substantially continuous change in pointing occurs over time, limited only by the pointing resolution of system 120. In an embodiment, the energy pointing can be reconfigured in less than 10 milliseconds. In another embodiment, the energy pointing can be configured in 0.0001 to 1000 microseconds.

[0052] A reconfigurable metasurface may include a plurality of dynamically adjustable elements arranged on the surface. In an embodiment, these elements have a plurality of adjustable reflection phases for providing a dynamically adjustable reflected or transmitted energy beam in response to incident energy. In an embodiment, the adjustable elements are arranged with an inter-element spacing that is less than the wavelength of the incident energy. In an embodiment, the dynamically adjustable element contains an electrically adjustable material, which may be a polymer or a liquid crystal material. In an embodiment, each of the plurality of elements further includes a pair of electrodes configured to apply an adjustable voltage across the electrically adjustable material. In an embodiment, the plurality of elements are arranged in a two-dimensional array indexed by rows and columns, each element is individually addressable, and there may be active control of each element. In an embodiment, the element is a dielectric resonator.

[0053] In embodiments, deflection of electromagnetic and acoustic energy can be achieved with metamaterials. These metamaterials can include two-dimensional patterned surfaces, also known as metasurfaces, whose engineered subwavelength units or structures can be used as materials to redirect energy wavefronts. This deflection of incident energy can be accomplished by arranging a gradient phase shift along the distribution of the metamaterial. One approach to metasurface design is to achieve local phase modulation, which dictates the properties of the outgoing wave according to the generalized Snell's law (GSL). This can be used to design structures such as lenses and beam splitters. In acoustics, phase shifts within metasurfaces can be used to manipulate wavefronts and absorb sound.

[0054] Such approaches have limitations in terms of scattering efficiency, which can be overcome by using metamaterials, including bi-anisotropic materials. In a bi-isotropic electromagnetic medium, the electric and magnetic fields are coupled via an intrinsic constant of the medium. If the coupling constant depends on the direction within the medium, then the medium is called bi-anisotropic.

[0055] Bi-anisotropic electromagnetic responses can be implemented through bi-anisotropic metasurfaces, where the scattered electromagnetic field is different depending on the illumination direction. For electromagnetic metasurfaces, the solution can be based on cascaded impedance layers. These structures can efficiently deflect light, focus light, and achieve other optical functions. Metamaterials can achieve local phase modulation according to the generalized Snell's law, or deflect light beams with higher efficiency by being constructed from structures made of bi-isotropic materials or bi-anisotropic materials. If each metasurface area can be addressed and configured separately, then the energy guiding angle can be programmed across a certain angle range at each of these energy guiding sites.

[0056] Figure 1B An orthogonal view of an energy guiding surface 140 is shown, comprising a configurable transmissive metasurface 142 containing a plurality of individually controlled nanostructures 141 and a controller 143 configured to operate the metasurface 142 to direct light in two axes θ, The nanostructures 141 on the metasurface 142 are configured to transmit the incident energy 145 and deflect it to the energy propagation path 146, but the system 140 can be configured to generate any other propagation path in the angular range θ 150, including energy propagation paths 147 and 148. The energy guiding system 140 can also be configured to generate energy propagation paths around an angle orthogonal to θ. The direction deflects the incident energy 145 to the energy propagation path, but these propagation paths are Figure 1B In an embodiment, the reconfigurable metasurface 142 can be used to implement the θ or Continuous change of direction. In an embodiment, the direction of the incident energy 145 can be reconfigured in less than 10 milliseconds. In another embodiment, the direction of the incident energy can be configured in 0.0001 to 1000 microseconds. In an embodiment, the reconfigurable metasurface includes a reconfigurable two-dimensional metasurface.

[0057] Figure 1A and 1B The reconfigurable metasurface shown in may include a plurality of dynamically adjustable elements arranged on the surface. In an embodiment, these elements have a plurality of adjustable reflection or transmission phases for providing dynamically adjustable reflection or transmission energy in response to incident energy. In an embodiment, the adjustable elements are arranged with an inter-element spacing less than the wavelength of the incident energy. In an embodiment, the dynamically adjustable element contains an electrically adjustable material, which may be a polymer or a liquid crystal material. In an embodiment, each of the plurality of elements further includes a pair of electrodes configured to apply an adjustable voltage across the electrically adjustable material. In an embodiment, a plurality of elements are arranged in a two-dimensional array indexed by rows and columns. In an embodiment, more than one element may be addressed individually by a metasurface controller 123 or 143, which may be used to provide active control of these elements. In an embodiment, the element is a dielectric resonator. In another embodiment, the metasurface includes a nanohole lattice filled with nematic liquid crystals and an electric field to control the phase distribution of the metasurface and provide beam steering. In one embodiment, the metasurface is made of ultra-thin and layered high-index dielectric patches. In one embodiment, the metasurface is made of individually designed, constructed, and individually addressable post and disk building blocks. In an embodiment, the reconfigurable metasurface comprises a reconfigurable two-dimensional metasurface. In another embodiment, the metasurface has more than one metasurface material layer, which can be individually configured. In another embodiment, the metasurface comprises a bi-isotropic or bi-anisotropic material.

[0058] Figure 1CAn orthogonal view of one embodiment of an energy directing surface 160 implemented with a tilted energy reflector 101 tilted about two axes, shown in a zero tilt state. In one embodiment, the energy directing system 160 includes a MEMS device. Figure 1C In the illustrated embodiment, a tilted energy reflector energy directing surface 101 (e.g., an electromagnetic energy mirror) tilts about a pair of inner flexures 104 connected to a gimbal frame 103 that itself tilts on two outer flexures 102 connected to a fixed frame 105. The pair of inner flexures and the pair of outer flexures each form an independent orthogonal axis for the energy reflector to tilt. In one embodiment, the two pairs of flexures can be torsion hinges, and the tilted energy reflector 101, the flexure pairs 102 and 104 are etched out of a layer of single crystal silicon, which also forms at least a portion of the fixed frame 105. The energy reflector can have various reflective coatings deposited on it, including aluminum, gold, engineered acoustic energy reflective materials, or any other material capable of reflecting energy of the appropriate type and wavelength.

[0059] Figure 1D An orthogonal view of energy directing surface 160 is shown, wherein reflector 101 is tilted at an angle θ106 on one axis and tilted at an angle θ106 on another orthogonal axis. The gimbal configuration ensures that the center of the tilted energy reflector 101 remains fixed when the reflector is tilted. Both the reflector 101 and the fixed frame 105 are mounted on a surface 110, which in some embodiments may be a substrate containing integrated electronics including a driver and a feedback sensor. In one embodiment, this substrate may be made of silicon with microfabricated components. In another embodiment, the mounting surface 110 may take the form of a printed circuit board (PCB) with electrodes and feedback electronics, such as a small LED source or a photodetector, and the frame of the micromirror 105 may be mounted to this PCB using gaskets.

[0060] Energy directing tilt reflector 101 can be actuated using a variety of methods. Electrostatic actuation can be achieved using a MEMS parallel plate capacitor structure or a MEMS vertical comb drive actuator with multiple closely spaced parallel plates (these are commonly found in Figure 1C1D). Tilted energy reflectors 101 having a diameter of one millimeter or more are particularly suitable for electromagnetic actuation because the magnetic torque is affected by the volume of the permanent magnetic material and the coil area of ​​the electromagnet. Electromagnetic actuation can be achieved using one or more coils etched into the tilted energy reflector 101 or permanent magnets attached to the energy reflector 101, and magnetic field induction coils arranged on the surface 110 below the energy reflector 101 to produce a push-pull structure on opposite sides of the tilted energy reflector 101. Micro-tilted energy reflectors can be actuated by other means, including the use of piezoelectric or magnetostrictive materials.

[0061] Figure 1C and 1D One possible configuration of an energy directing tilted energy reflector 101 is shown, and it should be appreciated that many other configurations are possible. For example, in other embodiments, the tilted energy reflector may be implemented as a MEMS device mounted on a post attached to a hinge that can be positionally controlled by electrostatic or electromagnetic means. Other configurations of the tilted energy reflector are also possible, including rotating holographic gratings, rotating polygon mirrors, or a combination of two single-axis tilt solutions, such as, but not limited to, rotating polygon mirrors of one axis (θ) and an orthogonal axis (θ). 1D scanning mirror.

[0062] For some energy guiding systems, such as light field displays, the energy guiding tilt energy reflectors are similar to scanning mirrors, they can be a few millimeters in diameter and have extremely high resonant Q values. This means that the tilt response of the reflector to a step current or voltage will be a tilt step with large oscillations, which may be relatively undamped and take many milliseconds to die out. Therefore, in order to achieve fast scanning, the MEMS mirror can be actively controlled using a control circuit that reads the mirror tilt angle at real-time speed and adjusts the drive current or voltage accordingly. Typically, the mirror tilt feedback electronics are located on the mounting surface 110 below the mirror surface 101, and the controller 106 reads these tilt feedback elements and calculates the correct electromagnetic drive signal to keep the tilt energy reflector fixed and not affected by vibration, or to keep the tilt motion of the tilt energy reflector 101 smooth. In one embodiment, this is done using a PID control loop. In the present disclosure, it is assumed that keeping the energy reflector at a fixed tilt angle that is not affected by vibration or changing the tilt of the energy reflector can be implemented by running an active control loop that continuously monitors the tilt of the energy reflector and adjusts the drive current or voltage in real time. This control loop may run within the tilt controller 106 .

[0063] Figure 1A , 1B, the energy guiding surfaces shown in FIGS. 1C and 1D illustrate compact devices that can be paired with an energy source to form a compact energy guiding module. The energy sources can be collimated so that they form an energy beam and can be modulated so that they can be time-controlled to deliver different amounts of energy at small spacing time intervals. Multiple such energy guiding modules can be used to form an energy guiding surface. In an embodiment, the controllers 123, 143, or 106 are configured to provide synchronization signals to the modulated energy sources and the energy guiding surfaces 122, 142, or 101 to operate the energy sources and the energy guiding surfaces to selectively guide the modulated energy along different energy propagation paths.

[0064] Figure 2A is an orthogonal side view of an energy guiding module 200 including an energy source 203 and a configurable energy guiding surface 201A, the energy source 203 guiding an energy beam 206 to an energy guiding device 202A, the configurable energy guiding surface 201A deflecting the beam on two axes 207, but for illustrative purposes, deflection on only one axis is shown. The energy source 203 can generate collimated, modulated, or both collimated and modulated energy. The energy guiding surface 201A can be a configurable metasurface, a tilted energy reflector, or any other device or combination of devices that can tilt the incident beam 206 on two axes. The deflected beam can be any one of a large number of energy propagation paths 207 on two orthogonal axes θ, and the two-dimensional angular deflection range 207A depends on the configuration of the energy guiding device 201A and the tilt deflection resolution of the energy guiding device 202A. The possible deflected beam energy propagation paths 207 surround an energy propagation axis 208, and this energy propagation axis can be the axis of symmetry of the angular range with respect to the energy propagation paths 207. Both the energy guiding device 202A and the energy source 203 are mounted on a mechanical base 204A, and the mechanical base 204A can contain a processor, electronic drive circuits, electronic feedback circuits, energy source modulation components, electrical leads 205A, and any other components for implementing various aspects of the operation of the energy guiding device and the energy source.

[0065] In embodiments, additional energy modifying components may be added to the energy directing module 200 to achieve different functions. For example, for visible electromagnetic energy, if the energy source 203 is an edge emitting laser, the energy beam profile may be elongated in one dimension but not in other dimensions. A prism may be used to expand the beam in one dimension to generate a more symmetrical beam shape. Additionally, many sources such as edge emitting lasers or vertical cavity surface emitting lasers (VCSELs) may generate divergent beams, which may be corrected by adding one or more lenses. For ultrasound projection, similar components may be installed with different acoustic impedance values. Energy sources such as edge emitting lasers or VCSELs may be directly modulated or have permanent modulators that may quickly turn the energy source on to a specified energy or substantially turn the energy source off. In another embodiment, the energy modulation source may be a shutter as part of the energy source 203, positioned between the energy source 203 and the energy directing surface 201A, or positioned in the exit path 207 from the energy directing surface 201A. This shutter is Figure 2A Not shown in the figure, it may comprise a mechanical or electro-optical shutter, such as an LC panel.

[0066] Figure 2B 2 is an orthogonal side view of an energy directing module 210 comprising an energy source 203 directing energy 206 through energy beam modifying components 211 and 213 and to a beam deflecting device 201B, and a configurable energy directing surface 202B configurable in two axes θ, 214. Energy source 203 may generate collimated, modulated, or both collimated and modulated energy. The cross-sectional area of ​​incoming energy 206 from source 203 is expanded by beam expander 211 to become energy beam 212, which is refracted on two surfaces of prism 213, causing one dimension of beam 212 to become larger and transformed into energy beam 214. Energy beam 214 is directed by energy guide 202B in two orthogonal directions θ, 204B, the energy guiding system 203 is deflected along any of a plurality of energy propagation paths 215, the two-dimensional angular deflection range 215A being dependent upon a biaxial tilt configured on an energy guiding surface 201B of energy guiding device 202B. The possible deflected energy propagation paths 215 are about an energy propagation axis 216, which describes the direction of energy propagation and may be an axis of symmetry for the angular range of energy propagation paths 215 away from energy guiding module 210. It should be noted that in this configuration, energy propagation axis 216 is parallel to a base normal 209 of a mounting base 204B, which may coincide with a mounting surface of the energy guiding system. The mechanical packaging for energy guiding device 202B and energy source 203 are both mounted on mechanical base 204B, which may contain a processor, electronic drive circuitry, electronic feedback circuitry, energy source modulation components, electrical leads 205B, and any other components used to implement various aspects of the operation of energy guiding device 202B and energy source 203. Figure 2B The configurations shown in are example implementations and are not intended to limit the infinite configurations of energy-forming components that can be used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, or otherwise process energy to make it more suitable for deflection by energy guiding device 202B and obtain a desired energy distribution, including remaining collimated, slightly focused, or slightly defocused for as long as possible. Such components can also be added to propagation path group 215 so that they are traversed by the outward energy after (rather than before) the outward energy is deflected by energy guiding device 202B.

[0067] In some energy directing configurations, at some locations on a corresponding energy surface, it may be advantageous to project energy in a direction that is not substantially normal to the energy surface. Figure 2C FIG. 2 is an orthogonal side view of a module 220 including an energy source 203 directing energy 206 through energy modifying components 211 and 213 and to energy directing device 202C and a configurable energy directing surface 201C configurable in two axes θ, 204C, which can generate any of a plurality of energy propagation paths 217 arranged about an energy propagation axis 218 that is not orthogonal to module base 204C. Energy propagation axis 218, which is an axis of symmetry about a two-dimensional angular range 217A of energy propagation paths 217 exiting energy guiding module 220, is tilted at a non-zero deflection angle 219 relative to a base normal 209 of mechanical package 204C, which can be a surface on which energy guiding system 220 can be mounted. In this embodiment, the mechanical packages of energy guiding device 202C and energy source 203 are both mounted on mechanical base 204C, which can contain a processor, electronic drive circuitry, electronic feedback circuitry, modulation electronics for energy source 203, electrical leads 205C, and any other components used to implement various aspects of the operation of energy guiding device 202C and energy source 203. Figure 2C The configuration shown is an example implementation and is not intended to limit the infinite configuration of energy forming components that can be used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, or otherwise process the energy distribution to make it more suitable for projection into the propagation path. Such components can also be added after the energy has been deflected into the propagation path 217.

[0068] Although Figure 2A , 2B 201A, 201B, and 201C respectively, but configurable transmissive energy guiding surfaces may also be used in implementations of many embodiments of the present disclosure. Examples are transmissive energy guiding metasurfaces, which include transparent materials such as transparent dielectrics, silicon dioxide, glass, transparent conductive oxides such as indium tin oxide (ITO), and liquid crystal materials. Figure 2D 2 is an orthogonal side view of energy directing module 230 including energy source 203 directing energy 206 through optional energy beam modifying components 211 and 213 and to optional reflector 263 which redirects beam 214 upwardly as beam 264 to configurable transmissive energy directing surface 201D of energy directing device 202D which is configurable in two orthogonal axes θ, The incident beam 264 is deflected upward, which can generate one of a large number of output energy propagation paths 265 arranged in two coordinates in an angular range 265A and centered on an energy propagation axis 266. The number of possible energy propagation paths may depend on the number of axes θ, θ, and θ that can be configured on the transmissive energy guiding surface 201D. Mechanical packages 262D of transmissive energy guiding device 202D and Energy Source 203 are mounted on a mechanical base 204D, which may contain a processor, electronic drive circuitry, electronic feedback circuitry, modulation electronics for Energy Source 203, electrical leads 205D, and any other components used to implement various aspects of the operation of energy guiding device 202D and Energy Source 203. Figure 2D The configurations shown in are example embodiments and are not intended to limit the nearly infinite configurations of energy forming components that can be used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, or otherwise process energy to make it more suitable for collimation or focusing. Such components can also be added to the propagation path 265 after the energy directing device 202D has deflected the energy beam.

[0069] Figure 2E FIG. 2 is an orthogonal side view of an energy directing module 240 including an energy source 203 directing energy 206 through an energy modifying component 211 (e.g., a beam expander) to produce energy 271 having a larger diameter that is incident on a configurable transmissive energy directing surface 201E of an energy directing device 202E that is configurable along two orthogonal axes θ, The incident beam 271 is deflected upward, which can generate any of a large number of energy propagation paths 273 within an angular range 273A substantially centered on the energy propagation axis 272. This device is similar to Figure 2D 204E and connector 205E. Mechanical package 262E of energy directing device 202E is mounted to mechanical package 204E. Figure 2E The configurations shown in are example embodiments and are not intended to limit the nearly infinite configurations of energy forming components that can be used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, or otherwise process energy to make it more suitable for collimation or focusing. Such components can also be added to propagation path 273 after energy directing device 202F has deflected the energy. Figure 2E In another embodiment, energy source 203 may be continuous, and the modulation source may be a shutter as part of energy source 203, disposed between energy source 203 and energy directing surface 202E, or disposed in exit path 273 from energy directing surface 201E. This shutter Figure 2E Not shown in the figure, it may comprise a mechanical or electro-optical shutter, such as an LC panel.

[0070] Figure 2F is an orthogonal side view of energy directing module 250, which is similar to Figure 2E 205E, except that it contains a non-zero deflection angle of energy propagation axis 282 that is tilted relative to normal 209 of the module's mechanical base 205E. Reconfigurable transmissive energy guiding surface 201F within energy guiding device 202F has been configured to be transmissive along two orthogonal axes θ, 282. The incident energy beam 271 is deflected upward, which can generate any of a large number of energy propagation paths 283 about the axis 282. This is an example of a transmissive energy guiding surface 201F being used to generate a deflection angle. In one embodiment, this transmissive energy guiding surface 201F can be a metasurface with reconfigurable nanostructures. Mechanical package 204E encloses energy source 203 and provides an attachment point for a mechanical mount 262F of energy guiding device 202F and provides an electrical connection for connector 205E.

[0071] Figure 2G 2 is an orthogonal side view of energy guiding module 260 comprising energy guiding layer 202G including three reconfigurable transmissive energy guiding sites defined in a common substrate, each energy guiding site being associated with a separate 4D spatial coordinate, and each energy guiding site redirecting energy into a plurality of possible directions θ, The three reconfigurable transmissive energy guiding sites 201G, 201H and 201I are defined in a common substrate 276, held by a mechanical support 277, and controlled by one or more controllers that operate the configuration of each energy guiding site. The energy sources 203A, 203B and 203C independently guide energy 206A, 206B and 206C at the beam expander 211, respectively, thereby forming larger diameter energy beams 271A, 271B and 271C, respectively, which are deflected by the reconfigurable transmissive energy guiding sites 201G, 201H and 201I, respectively, thereby generating one of a large number of propagation path groups 279A, 279B and 279C, respectively, which are centered on energy propagation axes 278A, 278B and 278C and have coordinates θ, The energy sources 203A, 203B and 203C are distributed within an angular range 251A, 251B and 251C, which are located at spatial coordinates (x=0, y=y0) 261A, (x=1, y=y0) 261B and (x=2, y=y0) 261C, respectively, where y0 is a constant. All components are placed in a mechanical housing 204F with an electrical connector 205F, which provides electrical access to the controller (not shown) of each energy source 203A, 203B and 203C and the one or more controllers of the energy directing site (not shown) in the common substrate 276.

[0072] In an embodiment, energy sources 203A, 203B, and 203C are aligned with a common energy guiding site substrate 276 such that each energy source provides energy to substantially only one of the reconfigurable transmission sites 201G, 201H, and 2011. To reduce or eliminate stray energy from the energy sources from reaching adjacent energy guiding sites, energy 271A, 271B, and 271C may be substantially isolated from respective adjacent energy sources by energy suppression structures 274, which in one embodiment may include mechanical baffle structures that block the energy.

[0073] Reconfigurable transmissive energy guiding sites 201G, 201H and 201I of energy guiding module 260 are located at coordinates 261A, 261B and 261C, each of which has a single spatial coordinate (x, y) = (0, y0), (1, y0) and (2, y0), and each coordinate is projected over a two-dimensional angular range. The two position coordinates (x, y) and the two angular coordinates Corresponding to a large number of 4D coordinates and Finally, θ, The number of achievable positions for each projected energy beam on an axis depends on the detailed configuration of energy directing sites 201G, 201H and 201I, which determines the achievable field of view and number of resolvable output angles on each axis. Figure 2G The configurations shown in are example implementations and are not intended to limit the infinite configurations of energy forming components that may be added to the energy propagation path before or after deflection by energy guiding sites 201G, 201H and 201I and used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, control polarization, or otherwise process the energy to make it more suitable for a particular energy guiding application.

[0074] Figure 2G An energy directing module comprising three independent energy sources and associated energy propagation paths that deliver independently controlled energy beams to three independently reconfigurable energy directing sites within a common substrate is shown. A modular system can be constructed using modular energy sources around a substrate with independently reconfigurable energy directing sites. Figure 2H204G, wherein the energy 282 may be expanded by an energy modifying component or a set of components 211 (e.g., a beam expander) to produce output energy 282. The energy 282 may travel through a protective transmissive window 283 of a mechanical wrapper 204G, wherein the mechanical wrapper includes an electrical connector 205G that provides control of the energy source, which may include DC bias and modulation controls, and the mechanical wrapper may also include a pair of mounting flanges 291 or some similar mechanical structure that enables the module to be secured to a surface. The configuration shown in 270 is an example embodiment and is not intended to limit the infinite configuration of energy forming components that can be used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, or otherwise process energy to make it more suitable for projection.

[0075] Fig.2I An orthogonal view of an energy guiding system having an energy guiding layer 202I comprising a plurality of independently controlled energy guiding sites 201J, 201K and 201L contained in a single substrate 295, each of which deflects energy from an energy source module 270. Note that although Fig.2I Specific energy source modules 270 are shown, but the configurations in which energy source modules can be used in place of 270 are unlimited. In at least one embodiment, an energy source module that produces a substantially collimated energy beam can be used. In another embodiment, an energy source module that produces substantially collimated but contains some convergence (focusing) or divergence (defocusing) energy can be used. Each energy source module 270 is shown attached to a common backplane layer 296, which can be used as any of the following: a mechanical support structure for mounting the energy source module 270, a mechanical support structure for the energy guiding substrate 295, an electrical backplane that provides control and connectivity for each energy source 270, and an electrical backplane that provides control and connectivity for each energy guiding site 201J, 201K, and 201L. This backplane layer 296 contains an aperture 297 aligned with each energy guiding site 201J, 201K, and 201L, each aperture providing an unobstructed path for the beam of the energy source module 270 to reach the corresponding energy guiding site. Energy guiding system 280 is shown with three coordinates 281A, 281B and 281C, each of which is associated with a single spatial coordinate (x, y) = (0, y0), (1, y0) and (2, y0), respectively, where y0 is a constant in this case, and where at each of these spatial coordinates, one of a group of energy propagation paths 287A, 287B and 287C is projected outward from substrate surface 295, respectively, the group being centered about energy propagation axes 286A, 286B and 286C, respectively, where these possible propagation paths fill a two-dimensional angular range 288A, 288B and 288C. These coordinates together correspond to a number of 4D coordinates and although Fig.2I An energy directing system is shown having only three spatial coordinates associated with energy source 270 and energy directing surface sites 201J, 201K and 201L, but may have any number of spatial coordinates corresponding to independently controlled energy deflection sites, wherein one or more energy directing surface sites may be confined within a substrate, and the entire system may contain one or more such substrates. Fig.2I The configuration shown in is an example implementation and is not intended to limit the infinite configurations of energy forming components that may be added to the energy propagation path before or after deflection through energy guiding sites 201J, 201K and 201L and used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, control polarization, or otherwise process the energy to make it more suitable for a particular energy guiding application.

[0076] A highly collimated energy source can be used for long distance energy propagation without energy density dissipation. In an embodiment, an energy guiding system can be configured using an energy source that is nearly perfectly collimated but has slightly focused or defocused energy. In this case, the energy guiding device can be configured to perform corrections to produce a more collimated energy beam. Figure 3A is an orthogonal side view of a modular energy source 300 including a single point-like energy source 301 and a single focusing element 303 that produces an energy beam 304 having a significant divergence associated therewith. Figure 2H , which may contain an energy source with a more collimated beam 206 and more corrective elements, such as a beam expander 211. The energy rays 302 from the point energy source 301 are focused, producing a slight divergence 304. The point energy source 301 and the focusing element 303 are enclosed in a mechanical package 311, which may have a mounting flange 312, a window 313 transparent to the energy beam, and a connector 314 that provides bias and modulation signals to the point energy source 301. In one embodiment, for visible electromagnetic energy, the point source 301 can be a single illumination source, such as an LED, emitting a single wavelength, a narrow band of wavelengths, or a wide spectrum of wavelengths, and the focusing element 303 can be a single lens or a multi-element lens. A beam focused from a finite size source will have a lower limit calculable divergence, which can be improved with a smaller source size and a wider lens aperture. However, a refractive lens system can guarantee a certain minimum divergence.

[0077] Figure 3BAn orthogonal view of an energy guiding system having an energy guiding surface arrangement 398 comprising a plurality of independently controlled reconfigurable energy guiding surface sites 301A, 301B and 301C contained in a single substrate 395, each energy guiding site being configured to deflect energy from Figure 3A , and corrects the energy divergence of the energy module 300 to produce a significantly more collimated output energy. Figure 3B A particular energy source module 300 is shown in use, but the configurations in which energy source modules may be used in place of 300 are endless. In at least one embodiment, an energy source module that produces substantially collimated energy may be used. In another embodiment, an energy source module that produces substantially collimated energy may be used. Figure 3A An energy source module 300 is shown as being substantially collimated but divergent energy 304. In another embodiment, the energy source module is substantially non-collimated. Each energy source module 300 is shown as being attached to a common backplane layer 396, which may be used as any of the following: a mechanical support structure for mounting the energy source module 300, a mechanical support structure for the energy guiding surface substrate 395, an electrical backplane providing control and connectivity for each energy source 300, and an electrical backplane providing control and connectivity for each energy guiding surface site 301A, 301B, and 301C. This backplane layer 396 contains an aperture 397 aligned with each energy guiding site 301A, 301B, and 301C, each aperture providing an unobstructed energy propagation path for the beam of the energy source module 300 to reach the energy guiding substrate. Energy guiding system 350 is shown with three coordinates 381A, 381B and 381C, each of which is associated with a single spatial coordinate (x, y) = (0, y0), (1, y0) and (2, y0), respectively, wherein at each of these spatial coordinates, energy of a group 387A, 387B and 387C of possible energy propagation paths is projected outward from the surface of substrate 395, respectively, the group being centered about energy propagation axes 386A, 386B and 386C, respectively, wherein these possible propagation paths respectively fill a two-dimensional angular range 388A, 388B and 388C. These coordinates together correspond to many 4D coordinates and It should be noted that the beams approaching energy guiding regions 301A, 301B, and 301C are divergent, as shown in FIG. Figure 3Aas shown at 304 in. However, the energy that separately exits the energy guiding regions 301A, 301B, and 301C and is guided into the energy propagation path groups 387A, 387B, and 387C is shown as exiting the energy guiding sites as collimated energy. This means that in addition to deflecting the beam into one of many possible propagation paths on two angular axes, the energy guiding sites 301A, 301B, and 301B are also configured to perform Figure 3A a slight focusing of the input energy 304 shown in. Although Figure 3B shows an energy guiding system having only three spatial coordinates associated with the energy source 300 and the energy guiding sites 301A, 301B, and 301C, it can have any number of spatial coordinates, each spatial coordinate corresponding to an independently controlled energy guiding site, where one or more energy guiding sites can be defined within a substrate, and the entire system can contain one or more such substrates. The configuration shown in 350 is an example embodiment and is not intended to limit the infinite configurations of energy forming components that can be added to the energy propagation path either before or after deflection by the energy guiding sites 301A, 301B, and 301C and that are used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, control polarization, or otherwise process the energy to make it more suitable for a particular energy guiding application.

[0078] One or more holographic objects can be projected from an array of energy guiding surfaces, regardless of whether each energy guiding surface is part of an individual module having its own energy source, or the energy guiding surfaces are defined at sites sharing a common substrate, or the energy guiding surfaces are transmissive or reflective. Figure 3C is an orthogonal view of the electromagnetic energy guiding system 3001 including an array of energy guiding modules 240 at a first time instance t 1 . The energy guiding module 240 is shown in Figure 2E , Figure 3D which is Figure 3C the energy guiding system 3001 at a second time instance t 2 . The first time instance t 1 and the second time instance t 2 can both be within the same refresh period of the holographic content provided by the energy guiding system 3001, where the refresh period can be the reciprocal of the frame rate of a holographic video. The energy guiding system 3001 projects energy along the energy propagation paths 237A - G for each energy guiding module 240A - G, and the energy propagation paths converge at a point on the holographic object 3011 projected behind the surface 3002 of the energy guiding system relative to the observer 150 or on the holographic object 3012 in front of the surface 3002 of the energy guiding system relative to the observer 150. The energy is in Figure 3C and 3D3002, but their beam width cross-sectional area is the main part of the area of ​​each energy guiding module 240 in the plane of the energy guiding system surface 3002. The energy guiding modules include energy modules 240A-G with spatial coordinates (x, y) = (0-6, y), each energy module is respectively along the angular coordinates The two spatial coordinates and the two angular coordinates together form the 4D coordinates of each energy propagation path. Energy propagation path 237A-G in Figure 3C converge at the first position 3021 of the holographic object 3011 or the first position 3031 of the holographic object 3012, Figure 3D The holographic object 3011 and the holographic object 3012 converge at the second position 3022 or the second position 3032 of the holographic object 3012. Figure 3C In the first time instance t 1 , along the energy propagation path 237B At, along the energy propagation path 237D at And along the energy propagation path 237G The energy at appears to emanate from point 3021 on the holographic object 3011 within the screen, while along the energy propagation path 237A At, along the energy propagation path 237C At, along the energy propagation path 237E and along the energy propagation path 237F The energy at t is concentrated at point 3031 on the off-screen holographic object 3012. 2 , along the energy propagation path 237K at At 237M along the energy propagation path At, along the energy propagation path 237O and along the energy propagation path 237Q The energy at appears to emanate from point 3022 on the holographic object 3011 within the screen, and along the energy propagation path 237L At, along the energy propagation path 237N At, along the energy propagation path 237P The energy at the energy directing module 240 converges to a point 3032 on the off-screen holographic object 3012. The energy directing surface site 201E of each energy directing module 240 can be configured to direct energy along a number of energy propagation paths having different angular coordinates to facilitate the projection of holographic objects 3011 and 3012. In an embodiment, these holographic objects are repeatedly formed at each time interval called a refresh period, which in an embodiment of holographic content is the inverse of the frame rate. Within each energy directing module 240, the number of addressable angles achievable per refresh period for forming perceptible holographic objects with acceptable brightness may depend on the speed at which each energy directing module changes the angle of the energy propagation path and the brightness of the energy source. In an embodiment, the energy source may remain on while the energy directing module changes the angle of the energy propagation path. In another embodiment, the energy source may be turned on, briefly held on, and then turned off while the energy directing surface dwells for a short period of time at each angle in a series of two-dimensional angles. Ideally, each energy directing module can cover many energy directing angles per refresh period to form holographic objects 3011 and 3012. Figure 3C , energy along energy propagation paths 237A, 237C, 237E, and 237F is shown as converging at the same point 3031 of holographic object 3012 at the same time, but such simultaneous convergence of energy is not required to form holographic object 3012 relative to observer 150. Energy guiding system 3001 may be configured to direct energy at a range of angles. Scanning each energy-guiding site to refresh all or part of the holographic object scene during a refresh cycle can follow the most efficient raster scanning order of the energy-guiding device. This means that corresponding to the four-dimensional coordinate The energy propagation path can be Figure 3C and 3D 3001, i.e., the energy along energy propagation paths 237A, 237C, 237E, and 237F can all be directed at different times. If the frame refresh rate, energy source brightness, the number of angles achieved by the energy directing device in each refresh cycle, and the density of energy propagation modules are high enough to be observed by observer 150 in ambient light, then observer 150 should be able to observe the holographic object through persistence of vision.

[0079] While highly collimated energy sources allow energy beams to propagate long distances without energy density dissipation, energy guiding systems can be constructed using substantially divergent energy sources and energy guiding surfaces configured to perform energy collimation and energy deflection to produce collimated energy over the entire output angle range in two axes. Figure 4Ais an orthogonal side view of energy directing module 400 including a single energy source 401 without energy focusing elements (e.g., Figure 3A The reconfigurable transmissive energy guiding device 403A corrects this divergence and produces a collimated and deflected output beam. The energy source 401 can be a single point energy source, such as a monochromatic energy source, or can be a site with multiple energy sources such as red, green and blue LEDs with a small spacing on a substrate or discrete device. The reconfigurable transmissive energy guiding surface 404A within the device 403A supported by the mechanical package 405 performs energy deflection as well as energy focusing to produce a collimated and deflected output beam within the angular range θ, Collimated output energy is produced along energy propagation paths including possible energy propagation paths 411, 412, and 413 and about energy propagation axis 412. Energy directing device 403A having energy directing surface (or site) 404A, energy directing mechanical mounting 405, and energy source 401 are enclosed in a mechanical package 408 having a connector 409 for routing energy source bias and modulation signals and signals to or from a controller of energy directing device 403A, which connector may or may not be within mechanical package 408. Figure 4A The configurations shown in are example implementations and are not intended to limit the infinite configurations of energy-forming components that may be added to the energy propagation path before or after deflection by energy-guiding surface 404A and used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, control polarization, or otherwise process the energy to make it more suitable for a particular energy-guiding application.

[0080] Depending on the application, the energy directing elements may be configured to produce slightly focused or divergent energy. Figure 4B A device that includes a single energy source 401 but does not include an energy focusing element that produces a plurality of substantially divergent energy rays 402 (e.g., Figure 3A 4B and 4C. An orthogonal side view of an energy directing module 420 having an energy directing element that corrects for this divergence and produces substantially collimated but slightly focused output energy. Reconfigurable transmissive energy directing surfaces 404B within energy directing device 403B mounted with mechanical mounts 405 perform energy deflection as well as energy focusing to provide a range of angles θ, Collimated but slightly focused output energy is produced within an angular range that includes possible energy propagation paths 431, 432, and 433 present in a group 430 of possible propagation paths surrounding an energy propagation axis 432, which may be parallel to an average energy vector of these possible propagation paths. Figure 4BThe configurations shown in are example implementations and are not intended to limit the infinite configurations of energy-forming components that may be added to the energy propagation path before or after deflection by energy-guiding surface 404B and used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, control polarization, or otherwise process the energy to make it more suitable for a particular energy-guiding application.

[0081] The energy directing elements may be configured to generate energy having a deflection angle, as previously discussed. Figure 4C is an orthogonal side view of energy directing module 440, which includes a single energy source 401 and does not include energy focusing elements (e.g., Figure 3A The energy directing module 440 has an energy directing device 403C which directs energy in an angular range of θ, The reconfigurable energy guiding device 403C is a device that transforms an incident divergent energy ray 402 into an outgoing collimated energy beam within an angular range that includes possible energy propagation paths 451, 452, and 453 that exist in a group 450 about an energy propagation axis 452. This energy propagation axis 452 is an axis of symmetry for the angular range of propagation paths that is tilted at a non-zero angle 426 relative to a normal 425 to a surface of the reconfigurable energy guiding device 403C having the transmissive energy guiding surface 404C. Figure 4C The configuration shown in is an example implementation and is not intended to limit the infinite configurations of energy forming components that may be added to the energy propagation path before or after deflection by the energy directing surface 404C and used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, control polarization, or otherwise process the energy to make it more suitable for a particular energy directing application.

[0082] Figure 2A , 2B , 2C, 2D, 2E, 2F, 2G, 4A, 4B and 4C all show energy directing modules with several possible output energy propagation paths. However, in order to quickly generate a series of energy propagation paths, the energy directing devices in these figures can be used to scan the deflected energy very quickly in two dimensions while the energy source is modulated so as to produce different energies in different directions from the energy directing module. A controller can be used to synchronize the modulation of the energy source and the operation of the energy directing surface to deliberately generate a certain temporal pattern of energy propagation paths.

[0083] Figure 5A is a schematic diagram of the operation of energy directing module 500 , including modulating energy source 508 to direct energy 537 to energy directing device 502 having reconfigurable energy directing transmissive surface 504 . Figure 5AThe timing diagram in FIG. 5 shows possible synchronization between modulation of energy source 508 and operation of energy guiding surface 504 to project energy along a series of seven propagation paths 530 with different energies E1-E7 across a series of output energy propagation path angles θ 538 that vary over time. Energy guiding transmissive surface 504 may be an active region within substrate 503. Energy guiding surface 504 may be directed at an axis orthogonal to θ. The incident energy beam 537 is deflected, but in this simple example, we are only concerned with one deflection axis θ. The modulated energy 537 can be collimated, slightly defocused, slightly focused, or divergent. In the event that the energy 537 is not collimated or not perfectly collimated, the energy directing surface can perform corrections to output deflected and substantially collimated output energy within the range of a minimum θ525 and a maximum θ526. The controller 506 can be used to generate a modulation signal for the energy source 508 to produce a distribution 537 of modulated energy E(t) versus time, and to generate instructions sent to the energy deflection device 502 to produce a distribution 538 of energy propagation path angle θ(t) versus time. In an embodiment, instructions between the controller 506 and the energy directing device 502 can be addressed to the energy directing surface controller 505 to form a surface distribution that achieves the energy propagation path angle θ538. In Figure 5A The right side of 537 shows a graph of the modulated energy E(t) 537 and the energy propagation path angle θ(t) 538, with some common timing events 536. At t1, the energy source that produces the incident beam 537 is modulated from energy E1 to zero energy, and the energy directing surface device 502 begins to change the angle θ by reconfiguring the transmissive energy directing surface 504. At t2, the angle θ 538 temporarily stops changing, and the energy source 508 is modulated from zero energy to E2, which continues from t2 to t3. In this way, when the energy source 508 is modulated off, the angle θ 538 repeatedly steps, and when the energy source is modulated to the on state, the angle θ 538 remains stable. The timing shown in 537 and 538 is illustrative and is not intended to limit other possibilities, including rapidly modulating the energy source so that it can remain on almost all the time, smoothly changing the angle θ 538, changing the angle θ 538 when the energy source is on, changing the angle θ 538 when the energy source is on and changing the energy level at the same time, or changing both axes θ and . This energy source modulation pattern 537 and angle θ distribution 538 causes energy to be directed along a series of energy propagation paths 530 having different energies E1-E7. At the earliest time in the cycle, E1 is projected to the left near the minimum angle θ525. Then, energies E2-E7 are projected one at a time in sequence, with each successive propagation path having a slightly larger clockwise angle θ538 (or equivalently, normalized light field coordinate u value), ending with E7 projected to the right near the maximum angle θ526. Depending on the relative speed at which the energy propagation paths change and the modulation frequency, energy along a large number of energy propagation paths can be projected in a fixed time period, depending on the number of resolvable angles produced by the energy directing surface device 502. And, although Figure 5A The configuration in FIG. 5 shows only the energy propagation path angle θ, and the energy guiding surface device 502 can be configured to deflect the incident energy 537 along a second axis orthogonal to the first axis, which means that a set of possible energy propagation paths 530 can form a cone with its vertex at the reconfigurable energy guiding transmission surface 504. Figure 5A The configurations shown in are example implementations and are not intended to limit the infinite configurations of energy forming components that may be added to the energy propagation path either before or after deflection by the energy directing surface 504 and used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, control polarization, or otherwise process the energy to make it more suitable for a particular energy directing application.

[0084] Figure 5B is a perspective view of one embodiment of energy directing module 510, which may be used with Figure 5A , showing several possible energy propagation paths 530B generated from deflecting energy from an energy source in two orthogonal directions from a reconfigurable transmissive energy guide 502. The energy source module 508B can be modulated, collimated, or both modulated and collimated. The enlarged view 555 shows two instances of energy modules 508B, including an energy module 270 with a collimated energy source and a beam expander, and an energy module 300 with a divergent point energy source focused by a single element. However, many other configurations of energy modules are possible. For example, in the optical domain, optical elements such as prisms, lenses, diffractive elements such as gratings, mirrors, folded optical devices, or other optical components can be added to the beam path 537B or the opposite side of the beam deflecting surface 504 in the energy ray path 530B. The energy guiding device 502 can be used with Figure 1BEnergy guiding surface 504 may be mounted within substrate 503 of energy guiding device 502. Energy guiding surface 504 may be configured to deflect incident energy 537B in θ to scan the deflected energy in θ axis 521 within a range of minimum θ 522 to maximum θ 523. Energy guiding surface 504 may be configured to deflect incident energy 537B in θ to scan the deflected energy in θ axis 521 within a range of minimum θ 522 to maximum θ 523. To the maximum Scan within range The energy directing surface device 502 can deflect energy on two axes. The simultaneous edge of the upward deflected incident energy 537B has a corresponding value deflects energy from any energy propagation path. Figure 5B In the configuration shown in , the midpoint of the energy-directing tilt range on each axis corresponds to This results in an energy propagation axis 512 that is parallel to a normal 513 to the surface of energy guiding device 502. Other configurations are possible in which energy propagation axis 512 may be parallel to normal 513 at a non-zero angle. 4D angular coordinates are defined, but the normalized light field coordinates u and v can also be used to represent angles, respectively.

[0085] Figure 5C is a schematic diagram illustrating the operation of energy directing module 540 , including modulating energy source 508 to direct energy 537 to energy directing device 542 having reconfigurable energy directing reflective surface 544 . Figure 5C The timing diagram in FIG. 5 shows possible synchronization between modulation of energy source 508 and operation of energy guiding surface 544 to guide energy along a series of seven propagation paths 530 with different energies E1-E7 across a series of output angles θ 538 that vary over time. Energy guiding reflective surface 544 may be an active region in substrate 543. Energy guiding surface 544 may be at an axis orthogonal to θ. The incident energy beam 537 is deflected, but in this simple example we are only concerned with one deflection axis θ. The modulated energy 537 can be collimated, slightly defocused, slightly focused, or divergent. In the event that the beam is not collimated or not perfectly collimated, the energy directing surface 544 can perform corrections to output deflected and substantially collimated output energy along a propagation path having an angular direction within the range of a minimum θ525 and a maximum θ526. The controller 546 can be used to provide a modulation signal for the energy source 508 to generate a distribution 537 of modulated energy E(t) versus time, and to provide a signal including instructions to be sent to the energy directing device 542 to generate a distribution 538 of the energy propagation path angle θ(t) versus time. Instructions between the controller 546 and the energy directing device 542 can be addressed to the energy directing surface controller 545 to form the surface distribution required to achieve the energy propagation path angle θ538. In Figure 5C The right side of 537 shows a graph of modulated energy E(t) 537 and energy propagation path angle θ(t) 538, with some common timing events 536. At t1, the energy source generating the incident energy 537 is modulated from energy E1 to zero energy, and the energy guiding device 542 begins to change the angle θ by reconfiguring the transmissive energy guiding surface 544. At t2, the angle θ 538 temporarily stops changing, and the energy source 508 is modulated from zero energy to E2, which continues from t2 to t3. In this way, when the energy source 508 is modulated off, the angle θ 538 repeatedly steps, and when the energy source is modulated to the on state, the angle θ 538 remains stable. The timing shown in 537 and 538 is illustrative and is not intended to limit other possibilities, including rapidly modulating the energy source so that it can remain on almost all the time, smoothly changing the energy propagation path angle, changing the energy propagation path angle when the energy source is on, changing the energy propagation path angle when the energy source is on and changing the energy level at the same time, or changing both axes θ and The energy propagation path angle on the energy source. This energy source modulation pattern 537 and energy propagation path angle distribution 538 can generate a series of energy propagation paths 530 with different energies E1-E7. At the earliest time in the cycle, E1 is projected to the left near the minimum angle θ525. Then, energies E2-E7 are projected one at a time in sequence, with each consecutive propagation path having a slightly larger clockwise angle θ538 (or equivalently, the normalized light field coordinate u value), ending with E7 projected to the right near the maximum energy guiding surface angle corresponding to the maximum projection angle θ526. Depending on the relative speed and modulation frequency of changing the energy propagation path angles, a large number of energy propagation paths can be projected in a fixed time period, depending on the number of resolvable angles generated by 542. And, although Figure 5CThe configuration in FIG. 5 shows only one propagation path angle change, but the energy guiding device 542 can be configured to deflect energy 537 along a second axis orthogonal to the first axis, which means that a set of possible energy propagation paths 530 can form a cone with its vertex at the reconfigurable energy guiding transmission surface 544. Figure 5C The configurations shown in are example embodiments and are not intended to limit the infinite configurations of energy-forming components that may be added to the energy propagation path, either before or after deflection by energy-directing surface 544, and used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, control polarization, or otherwise process the energy to make it more suitable for a particular energy-directing application. Figure 5C In another embodiment, energy source 508 may be continuous, and the modulation source may be a shutter as part of energy source 508, disposed between energy source 508 and energy directing surface 544, or disposed in the outgoing energy path 530 from energy directing surface 544. This shutter Figure 5C Not shown in the figure, it may comprise a mechanical or electro-optical shutter, such as an LC panel.

[0086] Figure 5D is a perspective view of one embodiment of an energy directing system 550, which module may be used with Figure 5C , showing several possible energy propagation paths 530D generated from deflecting energy from an energy source in two orthogonal directions by a reconfigurable reflective energy guide 542. The energy source module 508 can be modulated, collimated, or both. Figure 5D In the embodiment shown in FIG. 5 , energy 509 from source 508 may be expanded by an optional energy beam expander 510 to become an expanded incident energy beam 537D. However, many other configurations of energy modules are possible, including Figure 2H The energy module 270 shown in FIG. Figure 3A . In addition, for example, in the optical domain, optical elements such as prisms, lenses, diffractive elements such as gratings, mirrors, folded optical devices, polarization controllers, or other optical components can be added to the input energy path 537D in the energy propagation path 530D or to the optical path after deflection from the beam deflection surface 544. The energy directing device 542 can be connected to Figure 1A 522 to a maximum θ523. Energy directing surface 544 may be configured to deflect incident energy 537D in θ to scan a projection beam on θ axis 521 within a range of minimum θ 522 to a maximum θ 523. Energy directing surface 544 may be configured to deflect incident energy 537D in θ to scan a projection beam on θ axis 521 within a range of minimum θ 522 to a maximum θ 523. To the maximum Scan along the range The energy guiding device 542 can simultaneously deflect energy along the propagation path on the two axes. deflects the incident energy 537D upward to deflect the energy to a value corresponding to In any energy propagation path. Figure 5D In the configuration shown in , the midpoint of the energy-directing tilt range on each axis corresponds to This results in an energy propagation axis 512 that is parallel to a normal 513 to the base of substrate 543 of energy guiding device 542. It should be noted that by adjusting the angle 515 formed by the plane of energy guiding surface 544 and the base of energy guiding substrate 543 and the angle 514 formed by incident energy 537D and the normal 513 to the base of energy guiding device 542, Figure 5D The energy propagation axis 512 in becomes vertical. Other configurations are possible, in which the energy propagation axis 512 can be tilted relative to the normal 513. It should be noted that we specify the energy propagation path angle θ and However, in the embodiment of the light field display, we can also use the normalized light field coordinates u and v to represent the angles respectively.

[0087] Figure 5E is a schematic diagram of another operation of energy directing module 580 , including modulating energy source 508 to direct energy 537 to tilted energy reflector 584 tilted about axis 519 . Figure 5E The timing diagram in FIG. 5 shows possible synchronization between modulation of energy source 508 and operation of energy reflector to deflect energy along a series of seven propagation paths 530 with different energies E1-E7 across a series of output angles θ that vary over time. Modulated energy 537 can be collimated. In one embodiment, tilted reflector 584 is a MEMS micro-reflector. Energy directing reflector device 582 includes tilted energy reflector 584 that can be mounted within a substrate or mechanical frame 583 and tilt controller 585. Tilt reflector 504 can be tilted along an axis orthogonal to θ. The incident energy 537 is deflected upward, but in this simple example we only show one angular deflection axis θ. The modulated energy 537 can be collimated, slightly defocused, or slightly focused, and deflected into output energy along the energy propagation path within a range of a minimum θ 525 and a maximum θ 526. The controller 586 can be used to provide a modulation signal for the energy source 508 to produce a distribution 537 of modulated energy E(t) compared to time, and to provide a signal including instructions for the energy directing reflector device 582 with a tilted energy reflector 584 to produce a distribution 539 of reflector tilt α(t) compared to time. As a result of the reflector tilt, the output energy can be reflected into any of many possible energy propagation paths 530 because there is a direct relationship between the tilted reflector angle α and the deflected energy propagation path angle θ. The instructions between the controller and the energy directing reflector device 582 with a tilted energy reflector 584 can be parsed by the tilt controller 585 to produce the appropriate tilt angle α required to achieve the energy propagation path angle θ. In Figure 5E The right side of FIG. 5 shows a graph of modulated energy E(t) 537 and mirror tilt angle α(t) 539 with some common timing events 536. At t1, the energy source 508 is modulated from energy E1 to zero energy, and the tilt angle α of the energy reflector 584 begins to change by angle θ. At t2, the reflector tilt angle α 539 temporarily stops changing, and the energy source 508 is modulated from zero energy to E2, which continues from t2 to t3. In this way, when the energy source 508 is modulated off, the angle α 539 repeatedly steps, and when the energy source is modulated on, the micro-reflector angle α 539 remains stable. The timing shown in 537 and 539 is illustrative and is not intended to limit other possibilities, including rapidly modulating the energy source so that it can remain on almost all the time, smoothly changing the reflector tilt angle, tilting the reflector when the energy source is on, tilting the reflector and changing the energy level when the energy source is on, or tilting the reflector along two orthogonal axes. The energy source modulation pattern 537 and the reflector tilt angle distribution 539 cause energy to be directed along a series of energy propagation paths 530 having different energies 537. At the earliest time in the cycle, E1 is projected to the left near a minimum angle θ525. Then, energies E2-E7 are projected one at a time in sequence, with each successive propagation path having a slightly larger clockwise angle θ538 (or equivalently, a normalized coordinate u value), ending with E7 projected to the right near a maximum reflector tilt angle corresponding to a maximum angle θ526. Depending on the relative speed of the reflector tilt angle changes and the modulation frequency, energy can be directed along a large number of energy propagation paths, depending on the number of resolvable tilt angles produced by the tilted reflector 584. And, although Figure 5EThe configuration in 580 shows only one deflection tilt axis, but the energy directing reflector 582 can be configured to deflect the incident energy 537 along a second axis orthogonal to the first axis, which means that a set of possible energy propagation paths 530 can form a cone with its apex at the surface of the tilted reflector surface 584. The configuration shown in 580 is an example implementation and is not intended to limit the infinite configurations of energy forming components that can be added to the energy propagation path before or after deflection by the energy directing tilted reflector 584 and used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, control polarization, or otherwise process the energy to make it more suitable for a particular energy directing application.

[0088] Fig. 5F is a perspective view of one embodiment of an energy directing module 590 that can be used with Figure 5E , which illustrates several possible energy propagation paths generated from an energy directing device including a tilted energy reflector that deflects energy from an energy source in two orthogonal directions. Energy source module 508 may be modulated, collimated, or both. Fig. 5F In the embodiment shown in FIG. 5 , energy 509 from source 508 may be expanded by an optional energy beam expander 510 to become expanded incident energy 537F. However, many other configurations of energy modules are possible, including Figure 2H The energy module 270 shown in FIG. Figure 3A . In addition, for example, in the optical domain, optical elements such as prisms, lenses, diffractive elements such as gratings, mirrors, folded optical devices, or other optical components can be added to the input energy path 537F in the energy propagation path 530F or the energy propagation path after deflection from the surface 584. The tilted energy reflector 584 of the energy directing reflector device 582 can be connected to the energy directing reflector device 582. Figure 1C and 1D 522 to a maximum value of θ523. The tilted reflector 584 is tilted on the θ axis 591 to scan the deflected energy along the propagation path on the θ axis 521. on the slope to minimize To the maximum Scan along the range The deflection energy of the propagation path on axis 531. The tilted reflector can be tilted in two axes at the same time. The energy 537F is tilted upward to deflect the energy 537F to have a corresponding value within the angular range that can define the field of view (FOV) of the energy directing module 590. In any energy propagation path. Fig. 5F In the configuration shown in , the position of zero mirror tilt corresponds to Thus, an energy propagation axis 512 is generated that is parallel to the normal 513 of the base of the energy directing reflector device 582. By adjusting the angle 585 formed by the surface of the tilted reflector substrate 583 and the base of the energy directing reflector device 582 and the angle 514 formed by the energy 537F incident on the energy tilted reflector and the normal 513 of the base of the energy directing reflector device 582, the energy 537F incident on the energy tilted reflector can be adjusted. Fig. 5F The energy propagation axis 512 in becomes vertical. Other configurations are possible, in which the energy propagation axis 512 can be tilted relative to the normal 513. Here, it should be noted that we specify the tilt angle θ and However, we can also use normalized light field coordinates u and v to represent angles. Fig. 5F In another embodiment, energy source 508 may be continuous, and the modulation source may be a shutter as part of energy source 508, disposed between energy source 508 and reflective energy directing surface 584, or disposed in the outgoing energy path 530F from energy directing surface 584. This shutter Fig. 5F Not shown in the figure, it may comprise a mechanical or electro-optical shutter, such as an LC panel.

[0089] Figure 6 6 is a perspective view of one embodiment of an energy directing system 600 including an array of eight energy directing modules 601, each module including an energy directing device that redirects energy from an energy source into an energy propagation path that can converge with other propagation paths from other energy directing modules to form one or more energy surfaces, including energy surface 630. Energy directing modules 601 can be energy directing modules with reflective surfaces, including Figure 2A 200, Figure 2B 210 shown in Figure 2C 220, Figure 5C 540, Figure 5D 550, Figure 5E 580, Fig. 5F 590 shown in , or some other energy directing module that generates energy with configurable energy levels and adjustable propagation path directions within an angular range along two orthogonal angular coordinates. Figure 6In the example shown, projected energy surface 630 is formed by the convergence of six propagation paths from the eight energy directing modules. Energy directing modules 601 are positioned on the x-axis and y-axis and form integer (x,y) spatial coordinates 610-617, where x ranges from 0-3 and y ranges from 0-1. Each energy directing module includes an energy source 608 that provides energy to energy directing surface 651, which can deflect incident energy in two axes. The energy directing device may include a reconfigurable energy directing surface, similar to Figure 1A The surface 122 shown in Figure 2A Surface 201A shown in Figure 2B Surface 201B shown in Figure 2C Surface 201C or Figure 5C and 5D The reconfigurable energy directing device surface may actually include tilted reflectors, such as Figure 1C and 1D The reflector 101 shown in Figure 5E and 5F Each energy directing module can direct energy to a plurality of angular coordinates. In the example shown, the six energy propagation paths 620-623 and 626-627 all have unique coordinate values. These six propagation paths may occur at closely spaced time intervals (e.g., refresh cycles), but not necessarily simultaneously, as will be discussed further below and elsewhere in this disclosure. The energy module 610 at (x, y) = (0, 0) projects a 4D coordinate The energy ray 620 of (x, y) = (0, 1) projects the module 611 with 4D coordinates The energy ray 621 of (x, y) = (1, 0) projects the module 612 with 4D coordinates The ray 622 of (x, y) = (1, 1) projects the module 613 with 4D coordinates The ray 623 of (x, y) = (3, 0) is projected by module 616 with 4D coordinates , and the module 617 at (x, y) = (3, 1) projects a ray 626 having 4D coordinates The ray 627, where the angles of these 4D coordinates are The exact values ​​of the portions are chosen so that these six rays converge on energy surface 630. This energy surface 630 can be a tactile surface formed using projection of ultrasonic energy, the surface of a holographic object using projection of visible light, or any other energy surface. In this example, energy directing module 614 at (x,y)=(2,0) and energy directing module 615 at (x,y)=(2,1) do not contribute to energy surface 630. The configuration shown in 600 is an example implementation and is not intended to limit the infinite configurations of energy forming components that can be added to the beam path before or after deflection by energy directing surface 651 and used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, or otherwise process energy to make it more suitable for use in a particular energy directing application.

[0090] Figure 6 The energy guiding system shown can be realized by rastering the energy between θ and The coordinate scanning deflects the energy and modulates the energy source simultaneously to produce a series of propagation paths for each individual energy directing module. θ and The range of coordinates sets the field of view (FOV) of the energy directing module, which affects the FOV of the parent energy directing system. In general, the energy can be modulated for a number of discrete values ​​in each axis limited by the number of resolvable beam directions in each axis provided by energy directing module 601, thereby generating multiple discrete propagation paths to be achieved for the FOV and setting the angular resolution of the projected energy. The refresh rate of the energy directing module, and thus the refresh rate of the energy directing system, is determined by one complete grating cycle of the module's FOV. Using e.g. Figure 6 The array of energy directing modules shown can produce a system that forms multiple energy propagation paths that step in each raster cycle, forming energy convergence points along one or more energy propagation paths that overlap at a given location that can be a small spacing in time (e.g., a refresh cycle), but are not always projected simultaneously. The six propagation paths 620-623 and 626-627 shown in Figure 600 can be projected at closely spaced time intervals, which can be a raster cycle, but not necessarily at the same time, because each energy directing surface 651 of each beam directing module 601 can form a cross-sectional energy convergence point. Raster scanning of many propagation paths on an axis. However, for some systems, the convergence of energy at the point where one or more energy propagation paths converge at each cycle of a high frequency refresh rate may be sufficient to produce the desired effect (e.g., a persistent holographic object that moves smoothly and is not perceived to flicker). In one embodiment, for a light field display, the beams may converge on the energy surface at slightly different times, but due to persistence of vision, a refresh rate of 30, 60, or 120 Hz may be sufficient for the observer to perceive the holographic object even though it is moving. In another embodiment, for projection on a tactile surface, the ultrasonic energy beams may converge at a certain location at slightly different times, but if there is a sufficient refresh rate, the tactile sensation will be averaged over time to a sensation that is indistinguishable from all the energy beams converging at the same time. In other words, for many energy directing systems, locations where the energy beams converge within a short period of time but not at the same time may produce the same perceived effect as the energy converging at the same time. Figure 6 The illustrated energy directing system 600 and other embodiments of the present disclosure may take advantage of this fact to deliver desired results.

[0091] Figure 7 7 is a perspective view of one embodiment of an energy guiding system 700 including an array of eight energy guiding modules 701, each module including a reconfigurable transmissive energy guiding device that redirects an energy beam from a modulated energy source into an energy propagation path that can converge with other propagation paths from other energy guiding modules to form one or more energy surfaces, including energy surface 730. Energy guiding modules 701 can be energy guiding modules having transmissive surfaces, including Figure 2D 230, Figure 2E 240, Figure 2F 250, Figure 4A The 400 shown in Figure 4B 420, Figure 4C 440, Figure 5A 500, Figure 5B 510 shown in , or some other energy directing module that produces an energy beam with configurable energy level and adjustable propagation direction in an angular range along two orthogonal directions. Figure 7 In the example shown, energy surface 730 is formed by the convergence of six propagation paths from the eight energy directing modules. Energy directing modules 701 are arranged on the x-axis and y-axis and form integer (x,y) coordinates 710-717, where x ranges from 0-3 and y ranges from 0-1. It should be noted that each energy directing module is associated with a spatial coordinate (x,y). Each energy directing module includes a modulated energy source 708 that directs energy to a transmissive energy directing surface 751, which deflects the incident energy into a direction from two angles The energy directing device may include a reconfigurable energy directing surface, similar to Figure 1B The surface 140 shown in Figure 5A and 5B 504, or any other reconfigurable transmissive energy directing surface. Each energy directing module can direct energy to a plurality of angular coordinates. In the example shown, the six energy propagation paths 720-723 and 726-727 all have unique coordinate values. These six propagation paths may occur in closely spaced time intervals, but not necessarily simultaneously, as in Figure 6 The energy module 710 at (x,y)=(0,0) projects a 4D coordinate The energy ray 720 of (x, y) = (0, 1) projects the module 711 with 4D coordinates The energy ray 721 of (x, y) = (1, 0) projects the module 712 with 4D coordinates The ray 722 of (x, y) = (1, 1) is projected by the module 713 with 4D coordinates The ray 723 of module 716 at (x, y) = (3, 0) projects a ray having 4D coordinates ray 726, and module 717 at (x, y) = (3, 1) projects a ray with 4D coordinates The ray 727, where the angles of these 4D coordinates are The exact values ​​of the portions are chosen so that these six energy propagation paths converge on energy surface 730. This energy surface 730 can be a tactile surface formed using projection of ultrasonic energy, the surface of a holographic object using projection of visible light, or any other energy surface. In this example, energy directing module 714 at (x,y)=(2,0) and energy directing module 715 at (x,y)=(2,1) do not contribute to energy surface 730. The configuration shown in 700 is an example implementation and is not intended to limit the infinite configurations of energy forming components that can be added to the energy paths before or after deflection by energy directing surface 751 and used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, or otherwise process the energy to make it more suitable for use in a particular energy directing application.

[0092] Fig. 8Ais a perspective view of one embodiment of an energy guiding system 800 having an energy guiding layer 802 comprising a plurality of independently controlled energy guiding sites 802 contained in a single substrate 801, each energy guiding site deflecting energy from an energy source module 808 into two orthogonal directions θ, superior. Fig. 8A yes Fig.2I The energy guiding system 280 shown in Figure 3B One embodiment of an energy directing system 350 is shown in FIG. Fig. 8A Specific energy source modules 808 are shown, but the configurations in which energy source modules may be used in place of 808 are unlimited. In at least one embodiment, an energy source module that produces substantially collimated energy may be used. In another embodiment, an energy source module that produces substantially collimated energy but contains some convergence (focusing) or divergence (defocusing) may be used. In another embodiment, the energy source may be substantially converging. Each energy source module 808 is shown attached to a common backplane layer 803, which may serve as any of the following: a mechanical support structure for mounting the energy source modules 808, a mechanical support structure for the energy guiding substrate 801, an electrical backplane that provides control and connectivity for each energy source 808, and an electrical backplane that provides control and connectivity for each energy guiding surface site 851 that includes sites 810-817. This backplane layer 803 may contain apertures aligned with each energy guiding site 810-817, each aperture providing an unobstructed path for the beam of the energy source module 808 to reach the corresponding energy guiding substrate. These apertures are in Fig. 8A Not shown, but they may be similar to those in Fig.2I The hole 297 shown in the back plate 296 in.

[0093] exist Fig. 8A In the example shown, energy surface 830 is formed by the convergence of six propagation paths from eight transmissive energy directing surface sites 851, which are arranged on the x-axis and y-axis and form integer (x,y) spatial coordinates 810-817, where x ranges from 0-3 and y ranges from 0-1. It should be noted that each energy directing site is associated with a spatial coordinate (x,y). Each transmissive energy directing surface site may include a reconfigurable energy directing surface, similar to Figure 1B The surface 140 shown in Figure 5A and 5B 504, or any other reconfigurable transmissive energy directing surface. Each energy directing module can direct the energy beam to a plurality of angular coordinates. In the example shown, the six energy propagation paths 820-823 and 826-827 all have unique coordinates The six propagation paths may occur in small time intervals, but not necessarily simultaneously, as shown in Figure 6 The energy module 810 at (x,y)=(0,0) projects a 4D coordinate The energy ray 820 of (x, y) = (0, 1) projects the module 811 with 4D coordinates The energy ray 821 of (x, y) = (1, 0) projects the module 812 with 4D coordinates The ray 822 of (x, y) = (1, 1) projects the module 813 with 4D coordinates The ray 823 of (x, y) = (3, 0) is projected by the module 816 with 4D coordinates , and the module 817 at (x, y) = (3, 1) projects a ray 826 having 4D coordinates The ray 827, where the angles of these 4D coordinates are The exact values ​​of the portions are chosen so that these six energy propagation paths converge on energy surface 830. This energy surface 830 can be a tactile surface formed using projection of ultrasonic energy, the surface of a holographic object using projection of visible light, or any other energy surface. In this example, energy directing surface site 814 at (x,y)=(2,0) and energy directing surface site 815 at (x,y)=(2,1) do not contribute to energy surface 830. The configuration shown in 800 is an example implementation and is not intended to limit the infinite configurations of energy forming components that may be added to the energy paths before or after deflection by energy directing surface site 851 and used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, or otherwise process the energy to make it more suitable for use in a particular energy directing application. Fig. 8A In another embodiment, the energy source module 808 can generate continuous energy, and the modulation source can be a shutter disposed between the energy source module 808 and the reflective energy directing surface site 851 as part of the energy source module 808, or multiple shutters in the outgoing energy paths 820-823 and 826-827 from the site 851. These shutters are Fig. 8A Not shown in the drawings, they may comprise mechanical or electro-optical shutters, such as LC panels.

[0094] Figure 8B is a perspective view of another embodiment of an energy guiding system 840 having an energy guiding layer 802 comprising a plurality of independently controlled energy guiding sites 851 contained in a single substrate 801, each energy guiding site 851 deflecting a portion of incident collimated energy 849 into two orthogonal directions θ, superior. Fig. 8A The energy source module in layer 808 is Figure 8B 84 has been replaced by incident collimated energy 849, which comes from one or more energy sources not shown. Fig. 8A The number is Figure 8B for similar elements in. The collimated energy 849 may be generated by multiple lasers or other energy sources, from one or more point light sources coupled to one or more collimating lenses, from one or more light sources coupled to an array of mechanical collimating structures, or from some other collimated energy source. Each energy source module 808 is shown as being attached to a common backplane layer 803B, which may serve as a mechanical support structure for the energy guiding substrate 801, or may provide an electrical backplane for control and connectivity for each energy guiding surface site 851 comprising sites 810-817, or both. This backplane layer 803B may contain apertures aligned with each energy guiding site 810-817, each aperture providing an unobstructed path for a corresponding portion of the incoming energy beam 849 to reach a corresponding energy guiding substrate. These apertures are in Fig. 8A Not shown, but they may be similar to those in Fig.2I The hole 297 shown in the back plate 296 in.

[0095] In an alternative energy directing configuration, a single large area collimated energy source may be directed to an array of energy directing devices which individually reflect portions of the energy into desired propagation paths. Figure 8C 849 into deflected energy propagation paths 931 that converge to form energy surface 930. Figure 8C , energy directing devices 901 are all shown with tilted energy reflectors as energy directing surfaces 952 (e.g., similar to Figure 1C and 1D The reflector 101 and Figure 5E and 5F ), but they may also include reconfigurable energy directing surfaces (e.g., similar to Figure 1A The surface 120 shown in Figure 2A Surface 201A shown in Figure 2B Surface 201B shown in Figure 2C Surface 201C or Figure 5C and 5D 544) or some other surface that deflects the incident energy beam in two axes. Each energy directing module can direct the energy beam to a plurality of angular coordinates. The eight energy guiding devices 901 at spatial coordinates 910-917 are arranged in a 2D array along the x-axis and the y-axis, where x ranges from 0-3 and y ranges from 0-1. It should be noted that each energy guiding device 901 is associated with a spatial coordinate (x, y). The non-sloped surface 905 of the reflective surface 952 surrounding each energy guiding device 901 can absorb energy to prevent undesired reflections. It should be noted that in Figure 8C In the example of FIG. 8 , all six tilted energy reflectors 951 are rotated so that incident energy from the incoming collimated energy 849 is reflected toward the energy surface 930. Two mirrors 951A are tilted so that they do not reflect significant energy toward the energy surface. As previously described, such dual-axis deflection of portions of the incident collimated energy beam 849 can be achieved using a reconfigurable energy directing surface such as a metasurface, but this surface is Figure 8C The configuration shown in 900 is an example implementation and is not intended to limit the infinite configurations of energy-forming components that may be added to the energy path after deflection by energy-directing surface 952 and used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, or otherwise process the energy to make it more suitable for a particular energy-directing application.

[0096] With a static configuration of the beam deflection of each energy directing device 901, a static 4D energy field can be projected. However, if each reflector has a is tilted upward and has a time-varying angle relative to the distribution of time (e.g., Figure 5E , then a dynamic 4D energy field can be projected. The deflection angle of the energy deflecting surface 952 of each energy directing device 901 can be changed at regular intervals to deliberately form a sequence of energy propagation paths 931. The dwell time of each deflection angle can be adjusted to control the amount of energy projected during the time interval. In one embodiment, the incident energy beam 849 is modulated at a specific frequency, and the energy directing devices each remain in a fixed direction to tilt a portion of the incident energy 849 until the desired energy is delivered, and then tilt the reflected beam away. This means that each energy directing device will remain in the appropriate position for a different amount of time for each modulation cycle. Figure 8B In another embodiment, the incoming collimated energy 849 can be continuous energy, and the modulation source can be a shutter as part of the backing layer 803B, or multiple shutters in the outgoing energy paths 820-823 and 826-827 from the energy directing surface site 851. These shutters are Figure 8B Not shown in the drawings, they may comprise mechanical or electro-optical shutters, such as LC panels.

[0097] It is also possible to construct beam guidance systems with a common energy source plane. Fig. 9 852, wherein the energy guiding layer 852 includes a plurality of independently controlled energy guiding sites 882, each site 882 including an energy deflecting surface and defined in a single substrate 853, each site deflecting incident energy from one or more energy sources 858 located on a common backing plate 854 to project into two orthogonal angular directions θ, The common backplane layer 854 is aligned with the energy deflection site substrate 853 and can serve as any of the following: a mechanical support structure for mounting energy sources 858, a mechanical support structure for the energy guiding substrate 853, an electrical backplane that provides control, connectivity and mounting for each energy source 858, and an electrical backplane that provides control and connectivity for each energy guiding site 882. The multiple energy sources and the common backplane layer can be defined on a semiconductor substrate or printed circuit board. The energy guiding system 900 may contain energy suppression structures 857 to prevent energy 859 from one energy source 858 from reaching an adjacent energy guiding surface 882 and may provide structural support for the backplane to the remaining components. Fig. 9 In the example of , the three transmissive energy directing surface sites 882 are arranged on the x-axis, forming (x, y) spatial coordinates 860-862, where x ranges from 0 to 2. At each spatial coordinate (x, y), energy 859 can be transmitted at the two angles axis within a certain angular range, and these spatial and angular coordinates together form a 4D energy field. Fig. 9 The configurations shown in are example embodiments and are not intended to limit the infinite configurations of energy forming components that may be added to each energy path and used to amplify, focus, reflect, refract, diffract, redirect, diverge, reduce, modulate, control polarization, or otherwise process energy to make it more suitable for a particular energy directing application, either before or after deflection by energy directing surface 882. For example, in one embodiment, one or more energy focusing elements (e.g., electromagnetic energy lenses) are placed in the energy propagation path of energy 859 from each energy source 858, similar to Figure 3A 303 in order to collimate the energy from the one or more energy sources 858. In another embodiment, the energy sources 858 each include several energy sources, such as ultrasound transducers for projecting ultrasound energy, or groups of red, green, and blue pixels for projecting visible light for use in a light field display. Configurations with more energy sources per energy directing site location may also be used. In another embodiment, there may be multiple energy directing substrates in the energy directing system, each substrate containing more than one energy directing surface site.

[0098] As discussed above, the energy directed from a single energy surface location may include many individual energy propagation paths (or energy rays) grouped at solid angles around a single energy propagation axis, or a central energy propagation path. This energy projection axis is a line of symmetry because it is located approximately at the midpoint of the energy propagation paths leaving the single energy surface location in both the horizontal and vertical dimensions. It is generally substantially parallel to the average energy vector of the energy rays leaving the single energy surface location.

[0099] In many cases, the central energy propagation path or energy propagation axis is orthogonal to the surface of the energy directing module. For example, Fig. 5F The central energy projection axis 512 of the energy guiding module 590 is parallel to the normal 513 of the base of the energy guiding device 582. Assuming that a plurality of such energy guiding modules are mounted on the first surface, the group of energy propagation paths from each position on the energy surface is distributed at a solid angle around an axis orthogonal to the first surface, regardless of the position on the first surface. In other words, at each position on the first surface, the energy propagation axis is parallel to the normal of the first surface. In the present disclosure, the deflection angle may refer to the angle formed by the energy propagation axis and the normal of the first surface, which may be a display surface in an embodiment. In general, the deflection angle gives the direction of energy flow from the energy surface. It describes the average deflection of multiple energy propagation paths at a specific position on the energy surface relative to the normal of the surface.

[0100] For some embodiments of the energy guiding device, it may be advantageous to have the energy propagation direction or energy propagation axis no longer be parallel to the display surface normal at certain locations on the energy surface. In other words, for some locations on the energy guiding surface, there is a non-zero deflection angle. In some embodiments, the deflection angle may vary with the position on the energy projection surface of the energy guiding device. Doing so may focus the projected energy rays to a more localized area. If the group of energy propagation paths corresponding to positions near the edge of the energy guiding surface are tilted toward the center of the energy guiding surface, then it may also allow the convergence position of multiple energy rays to be closer to the energy guiding surface.

[0101] To achieve various deflection angles on an energy directing surface, the deflection angles can be built into separate energy directing modules, which are then mounted onto the display surface. Figure 2B The energy directing module 210 in FIG. 204B shows a zero deflection angle, wherein the energy propagation axis 216 is parallel to the normal 209 of the mounting base of the module 204B, and Figure 2C Energy directing module 220 in FIG. 2 shows a non-zero deflection angle, wherein energy propagation axis 218 is at an angle 219 relative to normal 209 of module base 204C. Figure 5DThe alignment angle 515 of the energy directing surface 543 and the approach angle 514 of the incident energy 537D relative to the normal 513 of the mounting base can determine the symmetry axis 512 of the group of energy propagation paths from the energy directing module. In another embodiment, if a transmissive energy directing surface is used, the transmissive energy directing surface can produce a deflection angle similar to Figure 4C The angle in is 426.

[0102] Fig.10 An orthogonal view of a light field display system 1000 with variable deflection angles is shown, comprising a plurality of energy directing modules 1080 mounted to a surface of a light field ("LF") display 1001, according to one or more embodiments. The LF display system 1000 is projecting holographic content for a viewer positioned substantially below the height of the display midpoint, so the light projection axes of many of the projection rays are also tilted downward. Close-up 1033A shows Figure 2C1035A shows an energy directing module of type 220 mounted near the top of the display at location 1033, creating a deflection angle that directs light projection axis 1003 downward toward the audience. Light rays group 1013 projected from the top of the display surface at location 1033 are defined by this light projection axis 1003, form angle 1043 with normal 1010 to the display surface, and angle downward toward audience seats 1008. Close-up 1035A shows an energy directing module of type 210 mounted near the bottom of the display at location 1035, with the deflection angle of energy propagation axis 1005 being zero. Light rays projected from the bottom of the display surface at location 1035 are defined by this energy propagation axis 1005, which is in a direction different from axis 1003 at the top of the display, in this case in the direction of normal 1045 to display surface 1045. The angular spread 1023 of the projected rays 1013 about the axis 1003 projected from the top of the display represents the vertical field of view 1023, while the angular spread of the projected ray group 1015 about the axis 1005 projected from the bottom of the display represents the vertical field of view 1025, where the angular spreads 1023 and 1025 may be equal. Light rays projected at locations between the top 1033 and the bottom 1035 of the display surface may have a deflection angle that varies between an angle 1043 at the top of the display surface 1001 and an angle of zero at the bottom of the display surface 1001 (normal 1045 to the display surface). This variation may be a gradient, such that a ray projected from an intermediate height of the display 1034 and characterized by the light projection axis 1004 is projected with a deflection angle 1044 that is a value between the deflection angle 1043 at the top of the display 1033 and the bottom deflection angle of zero at the bottom of the display 1035 (normal 1045). A possible advantage of this gradient chief ray configuration is that the view volume 1007 for the holographic object projected from the LF display 1001 can be optimized for the intended seating arrangement, thereby achieving improved performance and composite field of view for this group of observers given the available angular ranges 1023 and 1025 of the projected rays. The configuration shown in 1000 is an example of one embodiment and is not intended to limit the infinite configuration of energy directing modules that can be used on flat, curved, or faceted surfaces. Modular and transmissive energy directing modules, such as 1080, may be used in place of module 1080. Figure 5B 510 in, or modular and reflective energy guiding modules, e.g. Figure 5D 550 and Fig. 5F In another embodiment, module 1080 is alternatively implemented as one or more energy guiding systems including a plurality of energy guiding sites located within a common substrate to which an energy source module is attached, such as an energy source module having a structure similar to energy source module 808. Fig. 8A The energy guiding site 851 of 800.

[0103] The instructions issued to the energy directing system including the energy directing or beam deflecting devices may be adjusted according to the physical characteristics of those energy directing or beam deflecting devices. For example, for tilted energy reflector 160, e.g. Figure 1C and 1D For the MEMS mirror shown in , small incremental changes in tilt angle can be faster than larger changes in tilt angle. The same applies to configurable reflective or transmissive energy-guiding metasurfaces, as shown in Figure 1A and 1B Therefore, it may be advantageous for the controller to issue tilt commands to the energy directing devices in an order that matches the natural scanning order of the physical device.

[0104] Fig.11 A flow chart is included that illustrates a method of determining instructions for operating an energy source and an energy directing surface of an energy directing system of the present disclosure. Figure 3C As shown in For each energy directing site at the scan position (x, y), the controller may determine and provide instructions to the energy directing system 3001 to refresh the holographic object scene during the refresh period, and such scanning may follow the most efficient raster scanning order of the energy directing device. The controller may also provide instructions to modulate one or more energy sources synchronously with the configuration of the energy directing device. For example, in one embodiment, when the corresponding energy directing surface is reconfigured to change the angle, or when the energy directing surface is at a given angular position for the expected brightness, the energy directing surface may be modulated synchronously with the configuration of the energy directing device. When the appropriate amount of energy is delivered, each collimated light source can be switched to a state where it outputs zero energy. If the frame refresh rate, collimated source brightness, the number of angles achieved by the energy directing device in each refresh cycle, and the density of energy propagation modules are high enough, then through persistence of vision, observer 150 will be able to observe the holographic object.

[0105] Fig.11 An embodiment according to the above is shown. Fig.11 The first step 1101 in is receiving a data set at a controller, including energy property data for a plurality of 4D coordinates in a four-dimensional ("4D") coordinate system. The plurality of 4D coordinates may each include two spatial coordinates defining a spatial position of a plurality of energy directing surfaces in the 4D coordinate system. As discussed above in various embodiments, the plurality of energy directing surfaces are configured to each receive energy from one or more energy sources and direct energy therefrom along a plurality of energy propagation paths. The plurality of 4D coordinates may also each include two angular coordinates defining an angular direction of an energy propagation path from each energy directing surface.

[0106] In an embodiment, the energy attribute data in the data set may include at least one energy attribute selected from the group consisting of: color, intensity, frequency, or amplitude. In an embodiment, the data set received by the controller may include light field data of a holographic content frame to be displayed. For example, in an embodiment, the light field data may contain at least a description of a plurality of four-dimensional light field coordinates. A color data value for one or more color intensities.

[0107] Next, in step 1102, the processor may process the data set received by the controller into data subsets, each data subset including energy attribute data of two angular coordinates of the energy propagation path having the same spatial coordinates in the 4D coordinate system, thereby classifying the data according to the (x, y) position. For example, in an embodiment, this may be a plurality of angular coordinates at each corresponding (x, y) position. Each of creates a color data value list. In an embodiment, the processor that processes the data set can be a controller or a separate processor.

[0108] Based on the first data subset, first instructions for operating the first energy directing surface may be determined. In an embodiment, the instructions may include a sequence of directing energy along different energy propagation paths of the first energy directing surface, and the first data subset includes energy property data of angular coordinates of the energy propagation paths of the first energy directing surface. Once the first instructions are determined, the first energy directing surface may be operated accordingly to direct energy in a time-continuous manner.

[0109] An example of determining a first instruction and operating the first energy directing surface accordingly is as follows: Fig.11 Steps 1103-1109 in FIG. 1104 are provided. Steps 1103-1109 may be performed in parallel at each (x, y) position in the energy guiding device, but for the purpose of illustration, only two positions (x, y) are shown. 0 and (x,y) 1 The sequence of these steps is shown. In the next step 1103, each (x, y) position receives a list of color data and corresponding angular coordinates. In step 1104, the controller may The color data list is sorted into an order that is most similar to the order of angles that the energy guiding device can switch in the fastest time. This can be substantially the same as the raster scan angle order of the energy guiding device. Next, at step 1105, the controller retrieves the first data, then 1106 advances the energy guide device to the appropriate angle It may be necessary to wait until the energy directing device stabilizes. Then at 1107, the controller sets the collimated light source to the corresponding color data intensity value. For the energy directing module, step 1106 may involve: turning on the light source in the corresponding energy directing module to the correct color and intensity, or turning it on at a fixed light intensity value for a period of time; turning on the light source associated with the corresponding energy directing site to the correct color value and intensity, or turning it on at a fixed intensity value for a period of time; opening a mechanical or electro-optical shutter such as an LC panel for a fixed period of time, and keeping the energy directing device at an appropriate angle to continuously direct the appropriate amount of light energy incident on one side of the energy directing surface to the path The time required, such as Figure 8B The next step 1108 is to turn off the light source, which may involve adjusting the current or voltage of the light source, deflecting the energy directing device away from the display area, or closing a mechanical or electro-optical shutter such as an LC panel. In the next step 1109, the controller retrieves the next coordinate in the sequence Once each energy directing device at each (x, y) position has cycled through By viewing the entire sequence of data values, the controller can advance to the next frame of holographic content to be displayed.

[0110] Although various embodiments according to the principles disclosed herein have been described above, it should be understood that they are presented by way of example only and are not limiting. Therefore, the breadth and scope of one or more of the present inventions should not be limited by any of the exemplary embodiments described above, but should only be defined in accordance with the claims issued by this disclosure and their equivalents. In addition, the above advantages and features are provided in the described embodiments, and the application of such issued claims should not be limited to the process and structure that realize any or all of the above advantages.

[0111] It should be understood that the main features of the present disclosure may be employed in various embodiments without departing from the scope of the present disclosure. Those skilled in the art will recognize or be able to determine many equivalents to the specific methods described herein using no more than routine experiments. Such equivalents are considered to be within the scope of the present disclosure and are covered by the claims.

[0112] In addition, the section titles herein are provided for consistency with the recommendations under 37CFR 1.77, or to provide organizational cues in other ways. These titles should not limit or characterize the one or more inventions set forth in any claims that may be issued from this disclosure. Specifically and as an example, although the title mentions "technical field", such claims should not be limited by the language describing the so-called technical field under this title. Further, the description of the technology in the "background technology" section should not be understood as an admission that the technology is the prior art of any one or more of the present inventions in this disclosure. "Summary of the invention" should also not be considered as a feature of one or more of the present inventions set forth in the issued claims. In addition, any reference to "invention" in the singular form in this disclosure should not be used to argue that there is only a single novel point in this disclosure. Multiple inventions can be set forth according to the limitations of multiple claims issued from this disclosure, and such claims accordingly define one or more of the present inventions and their equivalents protected thereby. In all cases, the scope of such claims should be considered on their own merits in view of this disclosure, and should not be constrained by the titles set forth herein.

[0113] The word "a" is used to refer to "one" when used in conjunction with the term "comprising" in the claims and / or the specification, and it also complies with the meaning of "one or more", "at least one" and "one or more than one". Unless it is clearly indicated that only alternatives are referred to or the alternatives are mutually exclusive, the term "or" is used in the claims to refer to "and / or", but the present disclosure supports definitions and "and / or" that only refer to alternatives. Throughout this application, the term "about" is used to indicate that a value includes the inherent variation of the error of the device or method used to determine the value, or the variation that exists between research subjects. In general but consistent with the above discussion, the numerical values ​​modified by approximate words such as "about" herein can vary at least ±1, 2, 3, 4, 5, 6, 7, 10, 12 or 15% around the stated value.

[0114] As used in this specification and claims, the words "comprise" (and any form of comprising, such as "comprises" and "comprises"), "having" (and any form of having, such as "have" and "has"), "including" (and any form of including, such as "includes" and "include"), or "contain" (and any form of containing, such as "contains" and "contain") are inclusive or open-ended, and do not exclude additional unrecited elements or method steps.

[0115] Comparison, measurement, and timing terms such as "at," "equivalent to," "during," "completely," etc., should be understood to mean "substantially at," "substantially equivalent to," "substantially during," "substantially completely," etc., where "substantially" means that such comparisons, measurements, and timing can be used to achieve the desired results implicitly or explicitly stated. Words such as "near," "close to," and "adjacent" related to the relative position of elements should mean close enough to have a substantial effect on the interaction of the corresponding system elements. Other approximate terms similarly refer to certain conditions, which when so modified are understood not to be necessarily absolute or perfect, but will be considered close enough to allow a person skilled in the art to guarantee that the specified conditions exist. The degree to which the description can be varied will depend on how large a variation can be made and still allow a person of ordinary skill in the art to recognize the modified feature as still having the desired characteristics and capabilities of the unmodified feature.

[0116] As used herein, the term "or combinations thereof" refers to all permutations and combinations of the listed items preceding the term. For example, A, B, C, or combinations thereof are intended to include at least one of A, B, C, AB, AC, BC, or ABC, and if order is important in a particular case, BA, CA, CB, CBA, BCA, ACB, BAC, or CAB. Continuing with this example, combinations containing repetitions of one or more items or clauses are expressly included, such as BB, AAA, AB, BBC, AAABCCCC, CBBAAA, CABABB, etc. Those skilled in the art will appreciate that, unless otherwise apparent from the context, there is generally no limit to the number of items or clauses in any combination.

[0117] All compositions and / or methods disclosed and claimed herein can be made and performed without undue experimentation in accordance with the present disclosure. Although the compositions and methods of the present disclosure have been described in terms of preferred embodiments, it is apparent to those skilled in the art that changes may be made to the compositions and / or methods and in the steps or sequence of steps of the methods described herein without departing from the concept, spirit and scope of the present disclosure. All such similar substitutions and modifications apparent to those skilled in the art are deemed to be within the spirit, scope and concept of the present disclosure as defined by the appended claims.

Claims

1. An energy guiding system, include: Multiple energy sources; a plurality of energy directing surfaces configured to each receive energy from at least one of the plurality of energy sources and direct energy therefrom along a plurality of energy propagation paths; a controller in communication with the plurality of energy sources and the plurality of energy directing surfaces, the controller operable to provide synchronization signals to the energy sources and the energy directing surfaces to selectively direct energy along different energy propagation paths; wherein the plurality of energy guiding surfaces are arranged such that the energy propagation path from each energy guiding surface is respectively defined as a four-dimensional coordinate, the four-dimensional coordinate comprising two spatial coordinates corresponding to the position of the respective energy guiding surface and two angular coordinates defining the angular direction of the respective propagation path; wherein the at least one energy source is configured to provide modulation energy; wherein the synchronization signal of the controller is configured to operate the energy source and the energy directing surface to selectively direct the modulated energy along different energy propagation paths; The controller is used to provide a modulation signal for the energy source to produce a distribution of modulated energy versus time, and to provide a signal including instructions to the energy directing surface to produce a distribution of energy propagation path angles versus time.

2. The energy guiding system of claim 1, wherein at least one of the energy guiding surfaces comprises one or more metamaterial layers.

3. The energy guiding system of claim 2, wherein the one or more metamaterial layers are configured to transmit energy therethrough and onto the plurality of energy propagation paths of the at least one of the energy guiding surfaces.

4. The energy guiding system of claim 2, wherein the one or more metamaterial layers are configured to reflect energy therefrom and onto the plurality of energy propagation paths of the at least one of the energy guiding surfaces.

5. The energy guiding system of claim 1, wherein at least one of the energy guiding surfaces comprises at least one reflective surface capable of rotation about an orthogonal axis.

6. The energy guiding system of claim 5, wherein the at least one reflective surface comprises a microelectromechanical system (MEMS).

7. The energy guiding system of claim 1, wherein the at least one energy source is configured to provide collimated energy.

8. The energy guiding system of claim 1, further comprising at least one energy beam modifying element positioned between at least one of the energy guiding surfaces and the corresponding at least one energy source, the at least one energy beam modifying element comprising a beam expander or a prism.

9. The energy directing system of claim 1, further comprising at least one reflector positioned to direct energy from the corresponding at least one energy source to at least one of the energy directing surfaces.

10. The energy guiding system of claim 1, wherein the at least one energy source comprises a point energy source, and the energy guiding system further comprises at least one energy focusing element positioned to collimate energy from the at least one energy source.

11. The energy directing system of claim 1 , wherein the at least one energy source comprises a point energy source, and the energy directing surface is configured to collimate energy received from the corresponding at least one energy source.

12. An energy guiding system according to claim 1, wherein the energy propagation path of each energy guiding surface is an energy propagation axis around an axis of symmetry that defines the angular range of the propagation path of the corresponding energy guiding surface; and wherein the energy propagation axis of at least one of the multiple energy guiding surfaces forms a non-zero deflection angle relative to the normal of the at least one of the multiple energy guiding surfaces.

13. An energy guiding system according to claim 1, wherein the plurality of energy guiding surfaces are formed by reconfigurable transmission sites defined in a substrate, and the plurality of energy sources are mounted on a first side of the substrate, and further wherein the reconfigurable transmission sites are capable of transmitting energy from the corresponding at least one energy source to the second side of the substrate along a corresponding energy propagation path of the energy guiding surface.

14. The energy guiding system of claim 13, wherein the plurality of energy sources are housed in a module mounted to the first side of the substrate, thereby aligning the plurality of energy sources with the reconfigurable transmission sites.

15. The energy guiding system of claim 13, wherein the plurality of energy sources are mounted on a common backplane layer aligned with the substrate.

16. The energy guiding system of claim 15, wherein the plurality of energy sources and the common backplane layer are defined on a semiconductor substrate.

17. The energy guiding system of claim 15, wherein the plurality of energy sources and the common backplane layer are defined on a printed circuit board.

18. The energy guiding system of claim 15, wherein the plurality of energy sources are aligned with the substrate such that each energy source provides energy to substantially only one of the reconfigurable transmission sites.

19. The energy guiding system of claim 18, further comprising an energy suppression structure configured to substantially limit energy propagation from one of the energy sources to more than one of the reconfigurable transmission sites.

20. The energy directing system of claim 1, wherein the plurality of energy directing surfaces and the plurality of energy sources are housed in a modular energy directing module.

21. The energy guiding system of claim 20, wherein each energy guiding module include: a substrate defining a reconfigurable transmission site defined therein, the reconfigurable transmission site forming one of the plurality of energy directing surfaces; and The corresponding at least one energy source provides energy to the reconfigurable transmission site.

22. An energy guiding system according to claim 21, wherein the energy guiding modules are arranged to form an array of reconfigurable transmission sites so that energy can be guided from each reconfigurable transmission site along the energy propagation path, each energy propagation path having corresponding four-dimensional coordinates.

23. The energy guiding system of claim 20, wherein each energy guiding module include: a substrate defining reconfigurable transmission sites defined therein, the reconfigurable transmission sites forming a subset of the plurality of energy directing surfaces; and a respective subset of the plurality of energy sources providing energy to the reconfigurable transmission sites; as well as An energy suppression structure is configured to substantially restrict energy propagation from each energy source to more than one reconfigurable transmission site.

24. The energy directing system of claim 20, further comprising a shutter positioned in an energy path between at least one of the energy directing surfaces and a corresponding at least one energy source.

25. An energy guiding system according to claim 24, wherein at least one of the energy guiding surfaces is capable of guiding energy along a first energy propagation path during a first time period and guiding energy along a second energy propagation path during a second time period, and wherein the controller is electronically connected to the shutter and is capable of synchronizing actuation of the shutter during a certain time period between the first and second time periods.

26. An energy guiding system, include: an energy source configured to provide collimated energy; an array of energy directing surfaces, each energy directing surface configured to receive the collimated energy and deflect the received energy therefrom along a plurality of energy propagation paths; as well as a controller in communication with the energy source and the energy directing surface, the controller operable to provide synchronization signals to the energy source and the energy directing surface to selectively direct energy along different energy propagation paths; wherein the plurality of energy guiding surfaces are arranged in an array so that the energy propagation path from each energy guiding surface is respectively defined as a four-dimensional coordinate, the four-dimensional coordinate comprising two spatial coordinates corresponding to the position of the respective energy guiding surface and two angular coordinates defining the angular direction of the respective propagation path; wherein the at least one energy source is configured to provide modulation energy; wherein the synchronization signal of the controller is configured to operate the energy source and the energy directing surface to selectively direct the modulated energy along different energy propagation paths; The controller is used to provide a modulation signal for the energy source to produce a distribution of modulated energy versus time, and to provide a signal including instructions to the energy directing surface to produce a distribution of energy propagation path angles versus time.

27. An energy guiding system as claimed in claim 26, wherein the signal from the controller causes at least one of the energy guiding surfaces to reflect the received energy along a set of energy propagation paths in a certain sequence.

28. The energy guiding system of claim 26, wherein at least one of the energy guiding surfaces comprises one or more metamaterial layers.

29. The energy guiding system of claim 26, wherein the one or more metamaterial layers are configured to reflect energy therefrom and onto the plurality of energy propagation paths of the at least one of the energy guiding surfaces.

30. The energy guiding system of claim 29, wherein the one or more metamaterial layers are transmissive and configured to deflect energy passing through the one or more layers therefrom and onto the plurality of energy propagation paths of the at least one of the energy guiding surfaces.

31. The energy guiding system of claim 26, wherein at least one of the energy guiding surfaces comprises a reflective surface adapted to rotate about an orthogonal axis.

32. The energy guiding system of claim 26, wherein the energy source comprises a point energy source, at least one energy focusing element being positioned to collimate energy from the point energy source.

33. An energy guiding system according to claim 26, wherein the energy propagation path of each energy guiding surface is an energy propagation axis around an axis of symmetry that defines the angular range of the propagation path of the corresponding energy guiding surface; and wherein the energy propagation axis of at least one of the multiple energy guiding surfaces forms a non-zero deflection angle relative to the normal of the at least one of the multiple energy guiding surfaces.

34. The energy guiding system of claim 26, wherein the plurality of energy guiding surfaces are formed from reconfigurable reflective sites defined in a substrate.

35. The energy directing system of claim 26, wherein the plurality of energy directing surfaces are housed in modular energy directing modules.

36. An energy guiding system as recited in claim 35, wherein each energy guiding module comprises a substrate defining reconfigurable reflective sites defined therein, the reconfigurable reflective sites forming one of the plurality of energy guiding surfaces.

37. An energy guiding system according to claim 36, wherein the energy guiding modules are arranged to form an array of reconfigurable reflection sites so that energy can be guided from each reconfigurable reflection site along the energy propagation path, each energy propagation path having corresponding four-dimensional coordinates.

38. The energy directing system of claim 26, further comprising a shutter positioned in an energy path between at least one of the energy directing surfaces and the energy source.

39. An energy guiding system according to claim 38, wherein at least one of the energy guiding surfaces is capable of guiding energy along a first energy propagation path during a first time period and guiding energy along a second energy propagation path during a second time period, and wherein the controller is electronically connected to the shutter and is capable of synchronizing actuation of the shutter during a certain time period between the first and second time periods.

40. The energy guiding system of claim 26, wherein the energy source is configured to provide modulated collimated energy in a time sequence.

41. An energy guiding system according to claim 40, wherein the energy source is modulated to switch between a first and a second state during different time periods, and wherein in the first state of the first energy source, substantially zero collimated energy is provided to the energy guiding surface array, and in the second state of the energy source, non-zero collimated energy is provided to the energy guiding surface array.

42. An energy guiding system according to claim 41, wherein the operation of at least one energy guiding surface is synchronized with the modulation of the energy source, so that when the energy source is in the first state, the at least one energy guiding surface is reconfigured from guiding energy along a first energy propagation path to guiding energy along a second energy propagation path, and the first and second energy propagation paths have different angular coordinates.

43. A method for guiding energy according to a four-dimensional function using an energy guiding system as claimed in any one of claims 1 to 42, the method include: A data set is received, comprising energy property data for a plurality of 4D coordinates in a four-dimensional ("4D") coordinate system, the plurality of 4D coordinates each comprising: two spatial coordinates defining spatial locations of a plurality of energy directing surfaces in the 4D coordinate system, the plurality of energy directing surfaces being configured to each receive energy from one or more energy sources and direct the energy therefrom along a plurality of energy propagation paths; and two angular coordinates defining the angular direction of the energy propagation path from each energy directing surface; processing the data set into data subsets, each data subset comprising the energy attribute data of the angular coordinates of the energy propagation path having the same two spatial coordinates in the 4D coordinate system; determining first instructions for operating a first energy directing surface based on a first data subset, the instructions comprising a sequence of directing energy along different energy propagation paths of the first energy directing surface, the first data subset comprising the energy property data for the two angular coordinates of the energy propagation paths of the first energy directing surface; and The first energy directing surface is operated to direct energy in a time-continuous manner in accordance with the determined first instructions.

44. The method of claim 43, wherein the energy attribute data comprises at least one energy attribute selected from the group consisting of: color, intensity, frequency, and amplitude.

45. The method of claim 43, wherein the sequence of directing energy along different energy propagation paths of the first energy directing surface is determined taking into account an efficiency of reconfiguring the first energy directing surface.

46. ​​The method of claim 43, further comprising determining, based on the first subset of data, instructions for operating the one or more energy sources to direct modulated energy to the first energy directing surface, the instructions being synchronized with the instructions for operating the first energy directing surface.

47. The method according to claim 43 further includes determining second instructions for operating a second energy guiding surface based on a second data subset, the second instructions including a sequence of guiding energy along different energy propagation paths of the second energy guiding surface, and the second data subset including the energy property data of the angular coordinates of the energy propagation paths of the second energy guiding surface.

48. The method of claim 47, further comprising operating the second energy directing surface to direct energy in a time-continuous manner in accordance with the determined second instructions while operating the first energy directing surface.

49. The method of claim 43, wherein the sequence of directing energy along different energy propagation paths of the first energy directing surface is to be completed within a period of time.

Images