Analyzing method of optical grating, electronic device and computer readable storage medium

Abstract

Embodiments of the present application provide a grating analysis method, an electronic device and a computer readable storage medium. The method comprises: determining candidate gratings; determining grating combinations based on the candidate gratings, wherein each grating combination in the grating combinations comprises at least one candidate grating in the candidate gratings, and the at least one candidate grating in each grating combination is different from each other; determining a first diffraction response map of a first multiplexing grating corresponding to a first grating combination in the grating combinations; determining a first light emission intensity map of the first multiplexing grating corresponding to the first grating combination by modifying the first diffraction response map based on at least one parameter of a light engine; and determining a first reconstructed image corresponding to the light engine by processing a template image based on the first light emission intensity map.

Description

Technical Field

[0001] This invention generally relates to a method for analyzing gratings, an electronic device, and a computer-readable storage medium. Background Technology

[0002] See Figure 1 This diagram illustrates a volume holographic grating (VHG). The VHG features periodic fringe with refractive index modulation. Because... Figure 1 Since gratings in VHGs can diffract light, the main goal of existing VHG design and analysis is to develop an algorithm based on Kogelnik's coupled wave theory to calculate the diffraction behavior of a single grating (e.g., diffraction efficiency, diffraction angle, etc.).

[0003] Currently, existing technologies allow multiple VHGs to be implemented simultaneously on a single material to form a single holographic optical element (HOE) to achieve more diverse and complex diffraction behaviors, and this technology is known as multiplexing grating.

[0004] See Figure 2A and Figure 2B ,in Figure 2A A schematic diagram of VHG fabrication is shown, and Figure 2B A schematic diagram illustrating the fabrication of a multiplexer grating is shown. Figure 2A In this study, two different VHGs (VHG G1 and VHG G2) with two different recording conditions can be fabricated on two different materials using a green laser, so that VHG G1 and G2 can be used to diffract light with different diffraction behaviors.

[0005] exist Figure 2B In this embodiment, a material with two different recording laser conditions can be fabricated using a green laser to generate a multiplexer G3 (which can be understood as a combination of VHG G1 and VHG G2). In this embodiment, the surface period of VHG G1 is the projected spacing between two adjacent bright fringes in the plane of VHG G1, and the surface period of VHG G2 is the projected spacing between two adjacent bright fringes in the plane of VHG G2, wherein... Figure 2B In this embodiment, the surface period of VHG G1 and the surface period of VHG G2 may be the same. In other embodiments, the surface period of VHG G1 and the surface period of VHG G2 may be different, but the present invention is not limited thereto.

[0006] See Figure 3 This illustrates the application scenarios of gratings. Figure 3 In this context, it is assumed that the scene described uses a light propagation mechanism designed within augmented reality (AR) glasses. Specifically, a light engine can be used to emit light to an input HOE (which can be implemented using a VHG and / or a multiplexer), and the light diffracted by the input HOE can propagate via a waveguide (WG) to an output HOE (which can also be implemented using a VHG and / or a multiplexer). The output HOE can then diffract the light received from the WG outwards so that the user can see the corresponding AR content.

[0007] To achieve better performance when using multiplexed gratings, it is necessary to analyze their diffraction behavior. However, since the Kogelnik model can only be used to analyze a single grating, it is insufficient to describe the behavior of multiplexed gratings.

[0008] A common solution is to use an algorithm to convert the simulation of the multiplexed grating into individual gratings, and then obtain the calculation results for each individual grating sequentially and superimpose these results. Although this algorithm can obtain simulation results that conform to the experiment, it is mainly used for optical analysis, and its application is limited.

[0009] When simulating optical designs, it is necessary to find the optimal solution by scanning different combinations of variables. To find the optimal solution for multiplexed gratings using the above sequential approach, it is necessary to consider all possible gratings (hereinafter referred to as candidate gratings) and their corresponding multiplexing order (i.e., the number of VHGs fabricated on the same material) to design a corresponding number of nested loops for simulating different pairings / arrangements of candidate gratings.

[0010] If the number of candidate gratings is n and the number of multiplexing levels is m, then it is necessary to calculate n of the gratings. m The computational complexity increases exponentially with increasing m and n. Furthermore, it may waste computational resources because it may fail to filter out duplicate multiplexed arrangements of candidate gratings. Additionally, in the process of finding the optimal solution, inappropriate comparisons may be made between arrangements of candidate gratings corresponding to different multiplexed orders. Moreover, the multiplexed order needs to be predetermined and cannot be designed as a variable when searching for the optimal solution. Therefore, the above sequential approach has limited scalability and is unsuitable for optical design due to its specific applications and high computational complexity. Summary of the Invention

[0011] Therefore, the present invention relates to a method for analyzing gratings, an electronic device, and a computer-readable storage medium, which can be used to solve the above-mentioned technical problems.

[0012] Embodiments of the present invention provide a grating analysis method applicable to electronic devices, comprising: determining a plurality of candidate gratings; determining a plurality of grating combinations based on the candidate gratings, wherein each grating combination includes at least one candidate grating from the candidate gratings, and the at least one candidate grating in each grating combination is different from each other; determining a first diffraction response map of a first multiplexed grating corresponding to a first grating combination in the grating combination; determining a first emission intensity map of the first multiplexed grating corresponding to the first grating combination by modifying the first diffraction response map based on at least one parameter of an optical engine; and determining a first reconstructed image corresponding to the optical engine by processing a template image based on the first emission intensity map.

[0013] Embodiments of the present invention provide an electronic device including a storage circuit and a processor. The storage circuit stores program code. The processor is coupled to the non-transitory storage circuit and accesses the program code to perform: determining a plurality of candidate gratings; determining a plurality of grating combinations based on the candidate gratings, wherein each grating combination includes at least one candidate grating from the candidate gratings, and the at least one candidate grating in each grating combination is different from each other; determining a first diffraction response map of a first multiplexed grating corresponding to a first grating combination in the grating combinations; determining a first luminous intensity map of the first multiplexed grating corresponding to the first grating combination by modifying the first diffraction response map based on at least one parameter of an optical engine; and determining a first reconstructed image corresponding to the optical engine by processing a template image based on the first luminous intensity map.

[0014] Embodiments of the present invention provide a non-transitory computer-readable storage medium recording an executable computer program loaded by a host computer to perform the following steps: determining a plurality of candidate gratings; determining a plurality of grating combinations based on the candidate gratings, wherein each grating combination includes at least one candidate grating from the candidate gratings, and the at least one candidate grating in each grating combination is different from each other; determining a first diffraction response map of a first multiplexed grating corresponding to a first grating combination in the grating combinations; determining a first emission intensity map of the first multiplexed grating corresponding to the first grating combination by modifying the first diffraction response map based on at least one parameter of an optical engine; and determining a first reconstructed image corresponding to the optical engine by processing a template image based on the first emission intensity map. Attached Figure Description

[0015] This invention contains at least one color photograph. The Patent and Trademark Office will provide a copy of the published publication containing the color photograph upon request and payment of the necessary fees.

[0016] This document includes accompanying drawings to provide a further understanding of the invention, and the drawings are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

[0017] Figure 1 A schematic diagram of a volumetric holographic grating (VHG) is shown.

[0018] Figure 2A A schematic diagram of VHG fabrication is shown, and Figure 2B A schematic diagram of the fabrication of a multiplex grating is shown.

[0019] Figure 3 This illustrates the application scenarios of gratings.

[0020] Figure 4 A functional diagram of an electronic device according to an embodiment of the present invention is shown.

[0021] Figure 5 A flowchart illustrating a grating analysis method according to an embodiment of the present invention is shown.

[0022] Figure 6A A schematic diagram of a grating assembly according to an embodiment of the present invention is shown.

[0023] Figure 6B Showing with Figure 6A A schematic diagram of the diffraction response pattern corresponding to the grating combination.

[0024] Figure 7A A schematic diagram illustrating the determination of a first luminous intensity mask according to an embodiment of the present invention is shown.

[0025] Figure 7B Showing according to Figure 7A A schematic diagram of combining the first luminescence intensity mask with the first diffraction response pattern.

[0026] Figure 8A and Figure 8B This illustrates an application scenario for determining a first reconstructed image according to an embodiment of the present invention.

[0027] Figure 9A and Figure 9B A schematic diagram showing reconstructed images corresponding to different multiplex gratings according to an embodiment of the present invention is provided.

[0028] Figure 10 A schematic diagram of fabricating a grating according to an embodiment of the present invention is shown. Detailed Implementation

[0029] Reference will now be made in detail to preferred embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numerals are used in the drawings and description to refer to the same or similar parts.

[0030] See Figure 4 This diagram illustrates the functional characteristics of an electronic device according to an embodiment of the present invention. In various embodiments, the electronic device 400 may be implemented as any smart device and / or computer device, but the invention is not limited thereto.

[0031] exist Figure 4 In this embodiment, electronic device 400 includes storage circuitry 402 and processor 404. Storage circuitry 402 is one or a combination of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, hard disk, or any other similar device, and storage circuitry 402 records multiple modules and / or program code executable by processor 404.

[0032] Processor 404 may be coupled to storage circuit 402, and processor 404 may be, for example, a general-purpose processor, a special-purpose processor, a conventional processor, a digital signal processor (DSP), multiple microprocessors, one or more microprocessors associated with a DSP core, a controller, a microcontroller, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) circuit, any other type of integrated circuit (IC), a state machine, etc.

[0033] In an embodiment of the present invention, the processor 404 may access modules and / or program code stored in the storage circuit 402 to implement the grating analysis method provided in the present invention, which will be discussed further below.

[0034] See Figure 5 This illustrates a flowchart of a grating analysis method according to an embodiment of the present invention. The method of this embodiment can be derived from... Figure 4 The electronic device 400 in the middle is used to perform this, and it will be combined with the following. Figure 4 The components shown are used to describe Figure 5 Details of each step in the process.

[0035] In step S510, processor 404 determines a plurality of candidate gratings. In one embodiment, processor 404 may consider any grating preferred by the designer (e.g., VHG) as a candidate grating. In other embodiments, processor 404 may implement specific mechanisms to determine the candidate gratings under consideration, the details of which will be discussed later. Figure 10 Let me introduce it.

[0036] In step S520, the processor 404 determines a plurality of grating combinations based on the candidate gratings, wherein each of the grating combinations includes at least one candidate grating from the candidate gratings, and the at least one candidate grating in each grating combination is different from each other. In one embodiment, the grating combinations are different from each other.

[0037] In one embodiment, where the number of candidate gratings under consideration is n and the number of multiplexing levels is m (n, m are positive integers), the processor 404 may accordingly determine n sets of grating combinations. In one embodiment, the j-th (j is in the range of 1 to m) set of grating combinations may include There are m grating combinations in the j-th group, and each grating combination in the j-th group includes m candidate gratings, wherein the j candidate gratings in the same grating combination are different from each other. To better illustrate the concept of the present invention, Figure 6A It will be used as an instance.

[0038] See Figure 6A This illustrates a schematic diagram of a grating assembly according to an embodiment of the present invention. Figure 6A In this context, it is assumed that the candidate gratings under consideration include candidate gratings A1 to A4 and the multiplexing level is 4 (i.e., n and m are both 4). Since each grating combination needs to include at least one of the candidate gratings A1 to A4 and the candidate gratings in each grating combination need to be different from each other, the processor 404 can determine 4 sets of grating combinations.

[0039] exist Figure 6A In the middle, the first group (i.e., j=1) includes 4 (i.e., There are 6 grating combinations, wherein each grating combination in the first group includes one of the candidate gratings A1 to A4. The second group (i.e., j=2) includes 6 (i.e., There are 4 grating combinations, where each grating combination in the second group includes two of the candidate gratings A1 to A4. The third group (i.e., j = 3) includes 4 (i.e., ... There are 3 grating combinations, where each grating combination in the third group includes three candidate gratings A1 to A4. The fourth group (i.e., j=4) includes 1 (i.e., There are 4 grating combinations, where each grating combination in the 4th group includes four candidate gratings A1 to A4.

[0040] Therefore, in Figure 6A In the assumptions used, processor 404 only needs to perform 15 further analyses (i.e., The combination of 404 gratings reduces computational complexity and saves 404 computing resources for the processor.

[0041] More specifically, if we use the traditional sequential approach to analyze... Figure 6AIn the scenario described above (i.e., n and m are 4), candidate gratings A1 to A4 will be used to determine n sets of grating arrangements. In this case, the j-th set of grating arrangements will include n... j A series of gratings are arranged.

[0042] For example, the first (i.e., j=1) group of gratings may include four (i.e., 4) 1 The first group has 16 grating arrangements, and each grating arrangement includes one of the candidate gratings A1 to A4; the second group (i.e., j=2) may include sixteen (i.e., 4... 2 There are 64 grating arrangements, and each grating arrangement includes two candidate gratings; the third (i.e., j=3) group of grating arrangements may include 64 (i.e., 4... 3 There are 256 grating arrangements, and each grating arrangement includes three candidate gratings; the 4th (i.e., j=4) group of grating arrangements may include 256 (i.e., 4... 4 There are 340 grating arrangements, and each grating arrangement includes four candidate gratings. That is, the total number of grating arrangements will be 340 (i.e., ).

[0043] Under the assumption of using the traditional sequential method, each candidate grating in the same grating arrangement can be one of candidate gratings A1 to A4. That is, candidate gratings in the same grating arrangement can be repeated, and the same candidate gratings arranged in different orders will be considered to belong to different grating arrangements. In this case, the grating arrangement in the second group of grating arrangements can be "A1+A1", "A2+A2", "A3+A3", "A4+A4", "A1+A2", "A2+A1", "A2+A3", "A3+A2", "A2+A4", "A4+A2", "A1+A4", "A4+A1", "A1+A3", "A3+A1", "A3+A4", "A4+A3". The grating arrangements in other groups of grating arrangements can then be derived, but will not be discussed further here.

[0044] However, repeating gratings provide the same diffraction behavior, even if they are arranged in different orders. That is, when using the traditional sequential method, some grating arrangements in the grating arrangement (e.g., the grating arrangements "A1+A1", "A2+A2", "A3+A3", "A4+A4", "A2+A1", "A3+A2", "A4+A2", "A4+A1", "A3+A1", "A4+A3") will be analyzed unnecessarily, which increases computational complexity and wastes computational resources.

[0045] In contrast, processor 404 can predetermine the grating combinations that require further analysis, thus reducing computational complexity and the computational resources used.

[0046] In an embodiment of the invention, processor 404 may further analyze each of the grating combinations determined in step S520. For better understanding, one of the grating combinations (referred to as the first grating combination) will be used as an example to illustrate the following concepts of the invention, and those skilled in the art should be able to understand how the method of the invention operates relative to other grating combinations. In one embodiment, the first grating combination includes one or more first gratings from a pool of candidate gratings, and the first gratings are different from each other.

[0047] In step S530, the processor 404 determines a first diffraction response map of a first multiplexed grating corresponding to the first grating combination. In one embodiment, the processor 404 determines the first diffraction response map of the first grating combination by analyzing the first grating combination using a Kogelnik theoretical model, but the invention is not limited thereto. In one embodiment, the first multiplexed grating can be understood as a multiplexed grating fabricated by combining candidate gratings in the first grating combination on the same material. In this case, the first diffraction response map of the first multiplexed grating can be understood as a diffraction response map simulated using a Kogelnik theoretical model of the first multiplexed grating, but the invention is not limited thereto. To better illustrate the concept of the invention, Figure 6B It will be used as an instance.

[0048] See Figure 6B It shows that Figure 6A A schematic diagram of the diffraction response pattern corresponding to the grating combination. Figure 6B In the middle, processor 404 is determined. Figure 6A The diffraction response patterns of each of the grating combinations are shown. For example, for the second set of grating combinations, diffraction response patterns 611 to 616 may correspond to grating combinations “A1+A2”, “A1+A3”, “A1+A4”, “A2+A3”, “A2+A4”, and “A3+A4”, respectively, but the invention is not limited thereto.

[0049] exist Figure 6B In each diffraction response pattern, the curve marked with the number k can be the diffraction response corresponding to the candidate grating Ak. For example, in each diffraction response pattern (e.g., diffraction response pattern 611), the curve 621 marked with the number 1 can be the diffraction response corresponding to the candidate grating A1, the curve 622 marked with the number 2 can be the diffraction response corresponding to the candidate grating A2, the curve 623 marked with the number 3 can be the diffraction response corresponding to the candidate grating A3, and the curve 624 marked with the number 4 can be the diffraction response corresponding to the candidate grating A4, but the invention is not limited thereto.

[0050] In step S540, the processor 404 determines the first emission intensity map of the first multiplexed grating corresponding to the first grating by modifying the first diffraction response map based on at least one parameter of the optical engine.

[0051] In one embodiment, it may be assumed that the light engine, together with the first multiplexing grating, is used in, for example, the same display device (e.g., an AR device, such as AR glasses), but the invention is not limited thereto. In one embodiment, the AR device may include, for example, input / output HOE (which may be implemented using the first multiplexing grating), WG, and other elements, such as Figure 3 The invention is illustrated exemplarily, but is not limited thereto.

[0052] In different embodiments, the parameters of the light engine may include a first spectrum associated with a first color channel. In this case, the processor 404 may determine a luminous flux map by performing a unit conversion on the first spectrum; determine a first luminous intensity mask associated with the first color channel by performing an angular expansion on the luminous flux map; and determine a first luminous intensity map of a first multiplexed grating corresponding to the first grating by combining the first luminous intensity mask with a first diffraction response map. For better understanding, the following will be used... Figure 7A This will be illustrated with an example.

[0053] See Figure 7A This illustrates a schematic diagram of determining a first luminous intensity mask according to an embodiment of the present invention. Figure 7A In the process, the processor 404 can obtain the light engine's spectrum 711 to 713, where spectrum 711 to 713 can correspond to the red, green and blue color channels respectively (the attached figure is presented in grayscale).

[0054] In one embodiment, processor 404 determines luminous flux maps 721 to 723 corresponding to each spectrum 711 to 713 by performing a unit conversion on each spectrum 711 to 713. Since spectra 711 to 713 are represented by normalized intensity, the unit conversion can be used to characterize spectra 711 to 713 (i.e., luminous flux maps 721 to 723) in lumens, but the invention is not limited thereto. Details of the unit conversion can be found in any relevant existing documentation and will not be discussed further here.

[0055] In one embodiment, processor 404 determines luminous intensity masks 731 to 733 associated with color channels by performing angular expansion on each of luminous flux maps 721 to 723, where luminous flux maps 721 to 723 correspond to red, green, and blue, respectively. Details of the angular expansion in this embodiment can be found in any relevant existing documentation and will not be discussed further here.

[0056] In one embodiment, the processor 404 may regard one of the luminous intensity masks 731 to 733 as the first luminous intensity mask under consideration and determine the first luminous intensity map of the first multiplexer corresponding to the first grating by combining the first luminous intensity mask with the first diffraction response map.

[0057] See Figure 7B It shows according to Figure 7A A schematic diagram of combining the first luminescence intensity mask with the first diffraction response pattern. Figure 7B In this context, it is assumed that the first diffraction response pattern under consideration is diffraction response pattern 740 and the first luminescence intensity mask under consideration is luminescence intensity mask 732 corresponding to green. In this case, processor 404 can combine diffraction response pattern 740 and luminescence intensity mask 732 to generate luminescence intensity pattern 750 as the first luminescence intensity pattern of the first multiplexed grating corresponding to the first grating combination.

[0058] In one embodiment, the processor 404 may multiply the first luminescence intensity mask (i.e., luminescence intensity mask 732) with the first diffraction response map (i.e., diffraction response map 740) in a point-by-point manner to generate the luminescence intensity map 750, but the invention is not limited thereto.

[0059] from Figure 7B As can be seen, since the luminescence intensity mask 732 has a wavelength range R1 (which is approximately in the range of 480 nanometers (nm) to 580 nm), the region in the diffraction response map 740 corresponding to the wavelength range R1 of the luminescence intensity mask 732 is extracted to form the luminescence intensity map 750, wherein the intensity distribution of the extracted portion of the diffraction response map 740 is determined accordingly based on the intensity distribution of the luminescence intensity mask 732. For example, the trend of luminescence intensity variation in the wavelength range R1 of the luminescence intensity mask 732 approximately corresponds to the trend of luminescence intensity variation in the wavelength range R1 of the luminescence intensity map 750, but the present invention is not limited thereto.

[0060] In step S550, the processor 404 determines the first reconstructed image corresponding to the light engine by processing the template image based on the first luminous intensity map.

[0061] In one embodiment, during the process of determining the first reconstructed image, the processor 404 may determine a first color space map based on a first luminous intensity map; determine a first luminous intensity-field-of-view map based on the first luminous intensity map; and determine the first reconstructed image by processing a template image using the first color space map and the first luminous intensity-field-of-view map.

[0062] To facilitate better understanding, we will use Figure 8A and Figure 8B This will be illustrated with an example. See also Figure 8A and Figure 8B This illustrates an application scenario for determining a first reconstructed image according to an embodiment of the present invention.

[0063] exist Figure 8A and Figure 8B In this context, it is assumed that the diffraction response map 810 is the first diffraction response map under consideration, and the processor 404 may combine the diffraction response map 810 with the first emission intensity mask under consideration (e.g., emission intensity mask 732) to generate an emission intensity map 820 as the first emission intensity map under consideration.

[0064] Next, the processor 404 can determine a first color space map based on the luminous intensity map 820 (i.e., the first luminous intensity map). Figure 8A and Figure 8B In this context, the first color space diagram may correspond to the CIExy color space and includes CIEx diagram 831, CIExy diagram 832, and CIExy diagram 833. Details of determining CIEx diagram 831, CIExy diagram 832, and CIExy diagram 833 based on luminance diagram 820 can be found in existing documents related to the CIExy standard, but the present invention is not limited thereto.

[0065] Additionally, the processor 404 can determine a luminance intensity-field-of-view map 840 as a first luminance intensity-field-of-view map based on the luminance intensity map 820 (i.e., the first luminance intensity map), wherein the field of view (e.g., -25 degrees to 25 degrees) of the luminance intensity-field-of-view map 840 can correspond to the field of view provided by the AR device. Details of determining the luminance intensity-field-of-view map 840 based on the luminance intensity map 820 can be found in existing documents, but the invention is not limited thereto.

[0066] Subsequently, the processor 404 can determine the first reconstructed image 860 by processing the template image 850 using CIEx graph 831, CIEy graph 832 and CIExy graph 833 and luminous intensity-field-view graph 840.

[0067] exist Figure 8A and Figure 8BIn this context, the template image 850 can be, for example, a black image divided into several grids by white lines (corresponding to the field of view provided by the AR device), and each grid can be designed with a corresponding label (e.g., white lettering A1 to A10, B1 to B10, ..., J1 to J10). It should be noted that the lettering A1 to A10 (and B1 to B10, ..., J1 to J10) in the template image 850 are actual letters presented on the template image 850, which is different from the concept of candidate gratings A1 to A4.

[0068] In this embodiment, the template image 850 can be divided into 10×10 grids. Since the field of view provided by the AR device is exemplary within the range of -25 degrees to 25 degrees (i.e., a total of 50 degrees), it is known that each grid corresponds to a field of view of 5 degrees (i.e., 50 / 10). For example, the grids labeled A4 to A7 correspond to a field of view of -10 degrees to 10 degrees, and so do the grids labeled B4 to B7, C4 to C7, ..., and J4 to J7.

[0069] from Figure 8A and Figure 8B As can be seen, the first reconstructed image 860 also includes several grids corresponding to the grids in the template image 850. In this embodiment, the color and luminous intensity of any image area in the first reconstructed image 860 can be determined by processing the template image 850 using a first color space map and a first luminous intensity-view map.

[0070] To facilitate better understanding, a pair of corresponding image regions in the template image 850 and the first reconstructed image 860 (e.g., image regions in the template image 850 and the first reconstructed image 860 corresponding to the same viewpoint) will be used as examples for illustration, and those skilled in the art should be able to understand how the method of the present invention operates relative to other pairs of corresponding image regions.

[0071] In this embodiment, each of the first reconstructed image 860 and the template image 850 includes a first image region corresponding to a first viewing angle. In this case, during the processing of the template image 850 using a first color space map and a first luminous intensity-viewing field map, the processor 404 can determine a first color corresponding to the first viewing angle based on the first color space map; determine a first luminous intensity corresponding to the first viewing angle based on the first luminous intensity-viewing field map; and determine a specific color and a specific luminous intensity of the first image region in the first reconstructed image 860 by setting the color and luminous intensity of the first image region in the template image 850 to the first color and the first luminous intensity, respectively.

[0072] exist Figure 8A and Figure 8BIn this context, assuming the first viewing angle under consideration is 0 degrees, the processor 404 can regard line 850a (which corresponds to a 0-degree field of view) as the first image region in the template image 850 and line 860a (which also corresponds to a 0-degree field of view) as the first image region in the first reconstructed image 860.

[0073] In this scenario, processor 404 can obtain the CIEx value corresponding to the first viewing angle in CIEx graph 831 and the CIEy value corresponding to the first viewing angle in CIEy graph 832. In an embodiment where the first viewing angle is 0 degrees, processor 404 can obtain the value corresponding to 0 degrees as the CIEx value (e.g., 0.18) in CIEx graph 831. Similarly, processor 404 can obtain the value corresponding to 0 degrees as the CIEy value (e.g., 0.74) in CIEy graph 832. Next, processor 404 can obtain a reference color 833a corresponding to the CIEx value (e.g., 0.18) and the CIEy value (e.g., 0.74) as the first color (which may be a greenish color, presented as a grayscale image in the figures).

[0074] Additionally, the processor 404 can determine the luminous intensity 840a (e.g., 0.9 candela (cd)) corresponding to 0 degrees in the luminous intensity-field diagram 840 as the first luminous intensity.

[0075] Next, the processor 404 determines the specific color and specific luminous intensity of line 860a (i.e., the first image area under consideration) in the first reconstructed image 860 by setting the color and luminous intensity of line 850a in the template image 850 to a first color and a first luminous intensity, respectively. That is, the specific color of line 860a will be the first color (e.g., a light green), and the specific luminous intensity of line 860a will be 0.9 cd.

[0076] Based on the above teachings, the color and luminous intensity of other image areas (e.g., image areas corresponding to labels, separators, etc.) in the first reconstructed image 860 can be determined.

[0077] In this case, in response to the luminous intensity distribution in the luminous intensity-field map 840, the luminous intensity distribution in the first reconstructed image 860 can be determined accordingly.

[0078] For example, according to the luminance intensity-field-of-view map 840, the luminance intensity within the range of -10 degrees to 10 degrees (which corresponds to the range between the dashed lines) is relatively higher than the luminance intensity outside this range. Therefore, the luminance intensity in the image area of ​​the first reconstructed image 860 within the range of -10 degrees to 10 degrees will be relatively higher (e.g., brighter) than the luminance intensity outside this range.

[0079] In addition, based on the information provided by CIEx Figure 831, CIEy Figure 832 and CIExy Figure 833, the color of the image area of ​​the first reconstructed image 860 in the range of -10 degrees to 10 degrees will be slightly green, but the present invention is not limited thereto.

[0080] Since the first luminous intensity mask (e.g., luminous intensity mask 732) is determined based on the characteristics of the light engine under consideration, when the first multiplexer corresponding to the diffraction response pattern 810 is used with the light engine, the first reconstructed image 860 can be understood as a simulated visual effect provided by a display device (e.g., AR glasses). Therefore, the user can visually check whether the simulated visual effect corresponding to the first multiplexer meets the user's requirements.

[0081] In other embodiments, processor 404 may further determine a second diffraction response map of a second multiplexed grating corresponding to a second grating combination in a grating combination; determine a second emission intensity map corresponding to a second multiplexed grating in a second grating combination by modifying the second diffraction response map based on at least one parameter of the optical engine; and determine a second reconstructed image corresponding to the optical engine by processing a template image based on the second emission intensity map.

[0082] In short, processor 404 can perform the same steps on other raster combinations and obtain the corresponding reconstructed image, and details can be found in the teachings above.

[0083] See Figure 9A and Figure 9B ,in Figure 9A and Figure 9B A schematic diagram showing reconstructed images corresponding to different multiplex gratings according to an embodiment of the present invention is provided.

[0084] exist Figure 9A In the process, based on the luminous intensity map 911 determined according to the considered multiplex grating (referred to as MG1) and the light engine, the processor 404 can determine the corresponding luminous intensity-field map 912 and the corresponding reconstructed image 913.

[0085] exist Figure 9B In the process, based on the luminous intensity map 921 determined according to another considered multiplex grating (referred to as MG2) and the light engine, the processor 404 can determine the corresponding luminous intensity-field map 922 and the corresponding reconstructed image 923.

[0086] Therefore, users can intuitively check whether the simulated visual effects corresponding to these multiplexed gratings meet their requirements.

[0087] In addition, the processor 404 can also provide an estimated field of view of the first multiplexed grating formed on the display device corresponding to the light engine, and provide the light engine utilization rate of the first multiplexed grating used with the light engine. In this way, the user can further determine whether the first multiplexed grating meets the user's requirements based on these data.

[0088] exist Figure 9A In this context, the estimated field of view of the MG1 is approximately 31.0 degrees, and the utilization rate of the MG1's light engine when used with it is approximately 17.5%. Figure 9B In the meantime, the estimated field of view of the MG2 is approximately 33.4 degrees, and the utilization rate of the MG2's light engine when used with the light engine is approximately 37.53%.

[0089] Therefore, users can know that the estimated field of view of MG2 is wider than that of MG1, and the light engine utilization rate of MG2 is higher than that of MG1, but the present invention is not limited thereto.

[0090] As mentioned above, embodiments of the present invention provide a solution for determining candidate gratings, and details thereof will be described below.

[0091] See Figure 10 This illustrates a schematic diagram of fabricating a grating according to an embodiment of the present invention. Figure 10 In this process, when the grating fabrication equipment fabricates a grating 1001 with a given surface period, when a reference beam BM1 with a reference beam angle (referred to as BA1) is used to fabricate the grating 1001, the grating fabrication equipment will obtain the signal beam angle (referred to as BA2) of the signal beam BM2. That is, if the grating fabrication equipment is required to use the reference beam BM1 with the reference beam angle BA1 to generate a grating 1001 with a given surface period, then the grating fabrication equipment needs to use both the signal beam BM2 with the signal beam angle BA2 and the reference beam BM1 with the reference beam angle BA1.

[0092] From another perspective, for grating fabrication equipment, once the reference beam angle BA1 and surface period of the reference beam BM1 are given, the signal beam angle BA2 of the corresponding signal beam BM2 can be determined mathematically accordingly.

[0093] However, even if some reference beam BM1 and signal beam BM2 can be used to fabricate gratings based on mathematical analysis, the grating fabrication equipment may not be able to actually perform the corresponding fabrication to produce the corresponding grating. In this case, the grating may not be usable as a candidate grating. For further discussion, see [link to relevant documentation].

[0094] Table 1.

[0095]

[0096] Table 1

[0097] In the scenario in Table 1, the reference beam angle BA1 is determined to have 14 different values, and the signal beam angle BA2 is correspondingly determined to have 14 different values. In this case, the processor 404 can correspondingly determine 14 beam angle combinations, wherein each beam angle combination includes a reference beam angle and a signal beam angle, and the grating recorded by the reference beam and signal beam corresponding to the reference beam angle and signal beam angle in each beam angle combination has a predetermined surface period (e.g., 427.27 nm), wherein the concept of the predetermined surface period can be referred to... Figure 2B Explanation.

[0098] Next, the processor 404 obtains at least one reference beam angle combination from the beam angle combination and determines at least one reference grating among the reference gratings corresponding to the at least one reference beam angle combination as a candidate grating.

[0099] In one embodiment, the reference beam angle and signal beam angle in each of the reference beam angle combinations are both higher than -90 degrees and lower than 90 degrees. That is, if either the reference beam angle or the signal beam angle in one of the beam angle combinations is not lower than 90 degrees or not higher than -90 degrees, then this beam angle combination will not be determined as a reference beam angle combination, and the corresponding grating will not be determined as a candidate grating. This is because the grating fabrication equipment cannot implement any beam angle not lower than 90 degrees or not higher than -90 degrees.

[0100] In Table 1, since the signal beam angle BA2 in each of beam angle combinations 13 and 14 is not higher than -90 degrees, beam angle combinations 13 and 14 will not be identified as reference beam angle combinations. In this case, the gratings corresponding to beam angle combinations 13 and 14 will not be identified as candidate gratings.

[0101] In one embodiment, processor 404 may further exclude some beam angle combinations from the (remaining) beam angle combinations based on the following mechanism.

[0102] Specifically, in one embodiment, the processor 404 may sort the beam angle combinations 1 to 14 in ascending order based on the reference beam angle BA1 in each beam angle combination 1 to 14, as shown in Table 1.

[0103] In the first scenario, in response to determining that a specific parameter corresponding to the i-th beam angle combination is less than the specific parameters of the (i-1)-th beam angle combination and the (i+1)-th beam angle combination, the processor 404 may determine that the i-th beam angle combination belongs to the at least one reference beam angle combination, where i is an index. In some embodiments, the specific parameter may be a volume period and / or tilt angle, but the invention is not limited thereto.

[0104] In Table 1, since the volume period of beam angle combination 3 (i.e., i = 3) is smaller than the volume period of beam angle combination 2 and beam angle combination 4, the processor 404 can determine that beam angle combination 3 belongs to the reference beam angle combination. In this case, the grating corresponding to beam angle combination 3 will be determined as one of the candidate gratings.

[0105] In the second scenario, in response to determining that a specific parameter corresponding to the i-th beam angle combination is not less than a specific parameter of the (i-1)-th beam angle combination and is less than a specific parameter of the (i+1)-th beam angle combination, the processor 404 may determine that the i-th beam angle combination belongs to the at least one reference beam angle combination.

[0106] In Table 1, since the volume period of beam angle combination 4 (i.e., i = 4) is not less than the volume period of beam angle combination 3 and less than the volume period of beam angle combination 5, the processor 404 can determine that beam angle combination 4 belongs to the reference beam angle combination.

[0107] Based on a similar principle, processor 404 can determine that each of beam angle combinations 5 to 12 belongs to the reference beam angle combination. In this case, the grating corresponding to each of beam angle combinations 4 to 12 will be determined as one of the candidate gratings.

[0108] In the third case, in response to determining that the specific parameter corresponding to the i-th beam angle combination is less than the specific parameter of the (i-1)-th beam angle combination and not less than the specific parameter of the (i+1)-th beam angle combination, the processor 404 determines that the i-th beam angle combination does not belong to the at least one reference beam angle combination.

[0109] In Table 1, since the volume period of beam angle combination 2 (i.e., i = 2) is less than the volume period of beam angle combination 1 and not less than the volume period of beam angle combination 3, the processor 404 can determine that beam angle combination 2 does not belong to the reference beam angle combination.

[0110] Since the processor 404 determines that beam angle combination 2 does not belong to the reference beam angle combination, the processor 404 will also determine that beam angle combination 1, whose specific parameters are worse than those of beam angle combination 2, does not belong to the reference beam angle combination.

[0111] Therefore, gratings corresponding to beam angle combinations 3 to 12 are used as candidate gratings for further analysis (e.g., for performing steps S520 to S550), but the invention is not limited thereto.

[0112] The present invention also provides a computer-readable storage medium for performing a grating analysis method. The computer-readable storage medium comprises a plurality of program instructions (e.g., setup program instructions and deployment program instructions) contained therein. These program instructions can be loaded into an electronic device 400 and executed by the electronic device 400 to perform the aforementioned grating analysis method and the functions of the electronic device 400.

[0113] In summary, embodiments of the present invention can reduce the complexity of grating analysis by considering grating combinations. Furthermore, embodiments of the present invention can determine the luminescence intensity map of each multiplexed grating corresponding to each grating combination by considering the diffraction response map of each multiplexed grating and the parameters of the optical engine (e.g., spectrum). In addition, embodiments of the present invention can also process template images based on luminescence intensity maps to generate reconstructed images, allowing users to intuitively check whether the simulated visual effects meet their requirements.

[0114] It will be apparent to those skilled in the art that various modifications and variations can be made to the structure of the invention without departing from the scope or spirit of the invention. In summary, this invention is intended to cover modifications and variations of the invention that fall within the scope of the following claims and their equivalents.

[0115] [Explanation of Symbols]

[0116] 400: Electronic Devices

[0117] 402: Storage Circuit

[0118] 404: Processor error

[0119] 611, 612, 613, 614, 615, 616, 740, 810: Diffraction response diagrams

[0120] 621, 622, 623, 624: Curves

[0121] 711, 712, 713: Spectra

[0122] 721, 722, 723: Luminous flux diagrams

[0123] 731, 732, 733: Luminescence intensity masks

[0124] 750, 820, 911, 921: Luminous intensity diagrams

[0125] 831: CIEx chart

[0126] 832: CIEy diagram

[0127] 833: CIExy diagram

[0128] 833a: Reference color

[0129] 840, 912, 922: Luminous intensity-field diagram

[0130] 840a: Luminous intensity

[0131] 850: Template image

[0132] 850a, 860a: Line

[0133] 860: First Reconstructed Image

[0134] 913, 923: Reconstructed Images

[0135] 1001: Grating

[0136] A1, A2, A3, A4: Candidate gratings

[0137] BM1: Reference Beam

[0138] BM2: Signal Beam

[0139] G1, G2: VHG

[0140] G3: Multiplexer

[0141] S510, S520, S530, S540, S550: Steps

Claims

1. A method for analyzing gratings, applicable to electronic devices, characterized in that, include: Identify multiple candidate gratings; Based on the candidate gratings, a plurality of grating combinations are determined, wherein each grating combination includes at least one candidate grating from the candidate gratings, and the at least one candidate grating in each grating combination is different from each other; Determine the first diffraction response pattern of the first multiplexed grating corresponding to the first grating combination in the grating combination; Determining a first luminous intensity map of the first multiplexed grating corresponding to the first grating combination by modifying the first diffraction response map based on at least one parameter of the optical engine includes: determining a luminous flux map by performing a unit conversion on a first spectrum; determining a first luminous intensity mask associated with a first color channel by performing an angular expansion on the luminous flux map; and determining the first luminous intensity map of the first multiplexed grating corresponding to the first grating combination by combining the first luminous intensity mask with the first diffraction response map, wherein the at least one parameter of the optical engine includes the first spectrum associated with the first color channel; and The first reconstructed image corresponding to the light engine is determined by processing the template image based on the first luminescence intensity map, including: determining a first color space map based on the first luminescence intensity map; determining a first luminescence intensity-viewing field map based on the first luminescence intensity map; and determining the first reconstructed image by processing the template image using the first color space map and the first luminescence intensity-viewing field map.

2. The method of claim 1, wherein the step of combining the first luminescence intensity mask with the first diffraction response map comprises: The first luminescence intensity mask is multiplied with the first diffraction response map in a point-by-point manner.

3. The method according to claim 1, wherein each of the first reconstructed image and the template image includes a first image region corresponding to a first viewpoint, and the step of processing the template image using the first color space map and the first luminous intensity-viewpoint map includes: The first color corresponding to the first viewpoint is determined based on the first color space map; The first luminous intensity corresponding to the first viewing angle is determined based on the first luminous intensity-field diagram. The specific color and specific luminous intensity of the first image area in the first reconstructed image are determined by setting the color and luminous intensity of the first image area in the template image to the first color and the first luminous intensity, respectively.

4. The method according to claim 3, wherein the first color space diagram corresponds to the CIExy color space and includes a CIEx diagram, a CIEy diagram, and a CIExy diagram, and the step of determining the first color corresponding to the first viewing angle based on the first color space diagram includes: Obtain the CIEx value corresponding to the first viewpoint from the CIEx graph; Obtain the CIEy value corresponding to the first viewpoint from the CIEy diagram; as well as The reference color corresponding to the CIEx value and the CIEy value is obtained from the CIExy graph and used as the first color.

5. The method according to claim 1, further comprising: Provides an estimated field of view for the first multiplexer formed on a display device corresponding to the light engine; as well as Provides the optical engine utilization rate of the first multiplexer used with the optical engine.

6. The method of claim 1, wherein the step of determining the candidate grating comprises: A plurality of beam angle combinations are determined, wherein each beam angle combination includes a reference beam angle and a signal beam angle, and the grating recorded by the reference beam and the signal beam corresponding to the reference beam angle and the signal beam angle in each beam angle combination has a predetermined surface period. At least one reference beam angle combination is obtained from the beam angle combination; At least one reference grating corresponding to the at least one reference beam angle combination is determined as the candidate grating.

7. The method according to claim 6, wherein the reference beam angle and the signal beam angle in each of the reference beam angle combinations are greater than -90 degrees and less than 90 degrees.

8. The method of claim 6, wherein the step of obtaining the at least one reference beam angle combination from the beam angle combination comprises: The beam angle combinations are sorted in ascending order based on the reference beam angle in each beam angle combination. In response to determining that a specific parameter corresponding to the i-th beam angle combination is less than a specific parameter of the (i-1)-th beam angle combination and a specific parameter of the (i+1)-th beam angle combination, it is determined that the i-th beam angle combination belongs to the at least one reference beam angle combination, where i is an index; In response to determining that the specific parameter corresponding to the i-th beam angle combination is not less than the specific parameter of the (i-1)-th beam angle combination and is less than the specific parameter of the (i+1)-th beam angle combination, the i-th beam angle combination is determined to belong to the at least one reference beam angle combination.

9. The method according to claim 8, further comprising: In response to determining that the specific parameter corresponding to the i-th beam angle combination is less than the specific parameter of the (i-1)-th beam angle combination and not less than the specific parameter of the (i+1)-th beam angle combination, it is determined that the i-th beam angle combination does not belong to the at least one reference beam angle combination.

10. The method of claim 1, wherein the first grating combination comprises a plurality of first gratings among the candidate gratings, and the first gratings are different from each other.

11. The method of claim 1, wherein the grating combinations are different from each other.

12. The method according to claim 1, further comprising: Determine the second diffraction response pattern of the second multiplex grating corresponding to the second grating combination in the grating combination; The second luminous intensity map of the second multiplexer corresponding to the second grating is determined by modifying the second diffraction response map based on at least one parameter of the optical engine; as well as The second reconstructed image corresponding to the light engine is determined by processing the template image based on the second luminescence intensity map.

13. The method of claim 1, wherein the step of determining the first diffraction response map of the first multiplexer corresponding to the first grating combination comprises: The first diffraction response pattern of the first grating assembly was determined by analyzing the first grating assembly using the Kogelnik theoretical model.

14. An electronic device, characterized in that, include: Storage circuitry stores program code; The processor, coupled to the storage circuitry, accesses and executes the program code: Identify multiple candidate gratings; Based on the candidate gratings, a plurality of grating combinations are determined, wherein each grating combination includes at least one candidate grating from the candidate gratings, and the at least one candidate grating in each grating combination is different from each other; Determine the first diffraction response pattern of the first multiplexed grating corresponding to the first grating combination in the grating combination; Determining a first luminous intensity map of the first multiplexed grating corresponding to the first grating combination by modifying the first diffraction response map based on at least one parameter of the optical engine includes: determining a luminous flux map by performing a unit conversion on a first spectrum; determining a first luminous intensity mask associated with a first color channel by performing an angular expansion on the luminous flux map; and determining the first luminous intensity map of the first multiplexed grating corresponding to the first grating combination by combining the first luminous intensity mask with the first diffraction response map, wherein the at least one parameter of the optical engine includes the first spectrum associated with the first color channel; and The first reconstructed image corresponding to the light engine is determined by processing the template image based on the first luminescence intensity map, including: determining a first color space map based on the first luminescence intensity map; determining a first luminescence intensity-viewing field map based on the first luminescence intensity map; and determining the first reconstructed image by processing the template image using the first color space map and the first luminescence intensity-viewing field map.

15. The electronic device of claim 14, wherein the processor performs: A plurality of recording beam angle combinations are determined, wherein each recording beam angle combination includes a reference recording beam angle and a signal recording beam angle, and the gratings recorded by the reference recording beam and the signal recording beam corresponding to the reference recording beam angle and the signal recording beam angle in each recording beam angle combination have a predetermined surface period; At least one reference beam angle combination is obtained from the recorded beam angle combination; At least one reference grating corresponding to the at least one reference beam angle combination is determined as the candidate grating.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium records an executable computer program, which is loaded by a host computer to perform the following steps: Identify multiple candidate gratings; Based on the candidate gratings, a plurality of grating combinations are determined, wherein each grating combination includes at least one candidate grating from the candidate gratings, and the at least one candidate grating in each grating combination is different from each other; Determine the first diffraction response pattern of the first multiplexed grating corresponding to the first grating combination in the grating combination; Determining a first luminous intensity map of the first multiplexed grating corresponding to the first grating combination by modifying the first diffraction response map based on at least one parameter of the optical engine includes: determining a luminous flux map by performing a unit conversion on a first spectrum; determining a first luminous intensity mask associated with a first color channel by performing an angular expansion on the luminous flux map; and determining the first luminous intensity map of the first multiplexed grating corresponding to the first grating combination by combining the first luminous intensity mask with the first diffraction response map, wherein the at least one parameter of the optical engine includes the first spectrum associated with the first color channel; and The first reconstructed image corresponding to the light engine is determined by processing the template image based on the first luminescence intensity map, including: determining a first color space map based on the first luminescence intensity map; determining a first luminescence intensity-viewing field map based on the first luminescence intensity map; and determining the first reconstructed image by processing the template image using the first color space map and the first luminescence intensity-viewing field map.

Images