Holographic optical imaging system for metaverse augmented reality display

Abstract

The present invention relates to the field of holographic optical imaging technology, and specifically discloses a holographic optical imaging system for metaverse augmented reality display, which includes: a coordinate system conversion module, an imaging display adjustment module, a light source data acquisition module, an imaging color adjustment module and a database; the present invention achieves precise alignment of virtual and real coordinate systems through a specific algorithm, judges the position of the virtual object after the coordinate system is aligned, and automatically generates a position adjustment strategy based on an iterative closest point algorithm when the virtual object is not accurately positioned, continuously optimizes its position, and adjusts the brightness and RGB value of the virtual object according to the collected lighting data, thereby solving the problems of inaccurate coordinate alignment, difficult position judgment and adjustment, and poor lighting color adaptation in the fusion of virtual and reality, improving the display effect of virtual objects in real scenes, enhancing the user's immersive experience, and having important application value in the field of metaverse virtual display.

Description

Technical Field

[0001] The present invention relates to the field of holographic optical imaging technology, and in particular to a holographic optical imaging system for metaverse augmented reality display. Background Art

[0002] With the rise of the metaverse, augmented reality technology is increasingly being used in virtual displays. In virtual displays, virtual objects must be precisely integrated with the real world to achieve an immersive experience. Therefore, to ensure optimal virtual displays and meet user demands for a realistic, immersive experience, an analysis of the integration of virtual and real life is necessary.

[0003] The following problems still exist in the existing technology: 1. The alignment accuracy of the coordinate system is low, and the spatial mapping relationship between the virtual scene and the real scene cannot be accurately established, resulting in large positioning deviations of virtual objects in the real scene. Secondly, there is a lack of effective position judgment and adjustment mechanisms, making it difficult to ensure that virtual objects fall accurately at the specified positions in the real scene, affecting the authenticity of the display.

[0004] 2. The collection and utilization of real-world scene lighting data is insufficient, and the brightness and color of virtual objects cannot be reasonably adjusted according to the light intensity and color, resulting in inconsistency between the virtual objects and the lighting environment of the real scene, and poor visual effects. Summary of the Invention

[0005] In view of this, in order to solve the problems raised in the above background technology, a holographic optical imaging system for metaverse augmented reality display is proposed.

[0006] The objectives of the present invention can be achieved through the following technical solutions: The present invention provides a holographic optical imaging system for metaverse augmented reality display, including: a coordinate system conversion module, which obtains the three-dimensional model of the virtual scene and the three-dimensional point cloud data of the real virtual exhibition hall, and establishes a spatial mapping relationship between the two through a coordinate transformation algorithm, so that the coordinate system of the virtual object to be displayed is aligned with the coordinate system of the real virtual exhibition hall.

[0007] The imaging display adjustment module determines whether the virtual object to be displayed accurately falls on the specified position of the real virtual exhibition hall after the coordinate system is aligned, and adjusts the position of the virtual object to be displayed based on the judgment result.

[0008] The light source data acquisition module collects the light intensity and RGB values of each light source currently exposed to the virtual object in the real virtual exhibition hall, as well as the distance between each light source and the photosensor, when the virtual object to be displayed accurately falls at the specified position in the real virtual exhibition hall.

[0009] The imaging color adjustment module adjusts the current brightness and RGB value of the virtual object to be displayed based on the light source data.

[0010] Compared with the prior art, the embodiments of the present invention have at least the following advantages or beneficial effects: (1) The present invention extracts the coordinates of corresponding points from the virtual scene and the real virtual exhibition hall by utilizing a coordinate transformation algorithm, obtains a rotation matrix and a translation vector through centroid translation, covariance matrix processing and singular value decomposition, thereby achieving high-precision alignment of the coordinate system of the virtual object to be displayed and the real virtual exhibition hall, and improving the accuracy of virtual object positioning.

[0011] (2) The present invention calculates the imaging offset by comparing the actual coordinates of the virtual point with the standard coordinates based on the alignment results of the coordinate system. Based on the iterative closest point algorithm, it automatically generates a position adjustment strategy when the virtual object is not accurately positioned, continuously optimizes its position, and ensures the authenticity of the display.

[0012] (3) The present invention collects light intensity, RGB values and light source distance, and calculates the light source weight based on these data to obtain the comprehensive light intensity and comprehensive RGB values, and then adjusts the brightness and color of the virtual object. By adapting to the lighting environment of the real scene, the fusion effect of the virtual object and the real scene is enhanced, providing a more realistic visual experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0014] Figure 1 This is a schematic diagram of the system module structure connection of the present invention.

[0015] Figure 2 This is a flow chart of the accuracy determination of the virtual object position to be displayed in the present invention.

[0016] Figure 3 This is a flow chart of the strategy for adjusting the position of a virtual object to be displayed according to the present invention. DETAILED DESCRIPTION

[0017] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0018] See also Figure 1As shown, the present invention provides a holographic optical imaging system for metaverse augmented reality display, including: a coordinate system conversion module, an imaging display adjustment module, a light source data acquisition module and an imaging color adjustment module.

[0019] It should be noted that the present invention also includes a database for storing the standard coordinate values of each virtual point specified for the virtual object imaging to be displayed, the comprehensive lighting intensity range of the real virtual exhibition hall and the virtual object imaging brightness adjustment range.

[0020] The coordinate system conversion module is connected to the imaging display adjustment module, the imaging display adjustment module is connected to the light source data acquisition module, the light source data acquisition module is connected to the imaging color adjustment module, and both the imaging display adjustment module and the imaging color adjustment module are connected to the database.

[0021] The imaging coordinate system conversion module obtains the three-dimensional model of the virtual scene and the three-dimensional point cloud data of the real virtual exhibition hall, and establishes a spatial mapping relationship between the two through a coordinate transformation algorithm, so that the coordinate system of the virtual object to be displayed is aligned with the coordinate system of the real virtual exhibition hall.

[0022] It should be noted that the three-dimensional model of the virtual scene is obtained by connecting to the Metaverse platform with the help of a network interface, and the three-dimensional point cloud data of the real virtual exhibition hall is obtained by emitting a laser beam through the optical radar and receiving the reflected signal.

[0023] In a specific embodiment of the present invention, the specific implementation process of establishing the spatial mapping relationship between the two through the coordinate transformation algorithm is: extracting the three-dimensional coordinate values of each virtual point in the virtual object to be displayed from the three-dimensional model of the virtual scene, and obtaining the three-dimensional coordinate values of each corresponding real point from the three-dimensional point cloud data of the real virtual exhibition hall.

[0024] It should be noted that the three-dimensional coordinate values of each virtual point in the virtual object to be displayed and the three-dimensional coordinate values of each corresponding real point in the real virtual exhibition hall are obtained. These corresponding point pairs are the basis for subsequent calculations, and the corresponding point pairs can be automatically obtained using feature detection and matching algorithms.

[0025] The centroids of the virtual point set and the real point set are obtained respectively, and the point sets are translated to the local coordinate system with their respective centroids as the origin. Based on this, the covariance matrix is constructed and the singular value decomposition of the covariance matrix is performed to obtain the rotation matrix.

[0026] It should be noted that the centroids of the virtual point set and the real point set are obtained as follows: , ,in, and They represent the centroid of the virtual point set and the centroid of the real point set respectively, and Respectively represent The three-dimensional coordinate value of the virtual point in the point pair and the three-dimensional coordinate value of the corresponding real point, , , Indicates the point pair number, , The translation of the point set to the local coordinate system with the centroid as the origin is specifically expressed as follows: , The construction of the covariance matrix is specifically expressed as follows: ,in, Denotes the covariance matrix. The singular value decomposition of the covariance matrix is expressed as: The rotation matrix is expressed as: ,in, Represents a rotation matrix.

[0027] It should be further explained that the singular value decomposition is an important matrix decomposition method in linear algebra, which can transform any m×n real matrix into Decomposed into the product of three matrices, namely .in: is an m×m orthogonal matrix ( , column vectors are called left singular vectors), It is an m×n diagonal matrix, and the elements on the diagonal are non-negative singular values, arranged from large to small. is an n×n orthogonal matrix ( , column vectors are called right singular vectors).

[0028] The translation vector is obtained by fusing the rotation matrix and the centroids of the virtual point set and the real point set.

[0029] It should be noted that the translation vector is specifically expressed as: ,in, Represents the translation vector.

[0030] The coordinates of each virtual point in the virtual object to be displayed are transformed using the rotation matrix and translation vector.

[0031] It should be noted that the transformation of the coordinates of each virtual point in the virtual object to be displayed is specifically performed as follows: .

[0032] The embodiment of the present invention utilizes a coordinate transformation algorithm to extract corresponding point coordinates from the virtual scene and the real virtual exhibition hall, and obtains the rotation matrix and translation vector through center of mass translation, covariance matrix processing and singular value decomposition, thereby achieving high-precision alignment of the coordinate system of the virtual object to be displayed and the real virtual exhibition hall, and improving the accuracy of virtual object positioning.

[0033] The imaging display adjustment module determines whether the virtual object to be displayed accurately falls on the specified position of the real virtual exhibition hall after the coordinate system is aligned, and adjusts the position of the virtual object to be displayed according to the judgment result.

[0034] In a specific embodiment of the present invention, the specific process of determining whether the virtual object to be displayed accurately falls on the specified position of the real virtual exhibition hall is: coupling processing is performed based on the coordinate values of each virtual point in the virtual object to be displayed after alignment of the coordinate system and the standard coordinate values of each virtual point specified for the imaging of the virtual object to be displayed stored in the database to obtain the imaging offset of the virtual object to be displayed.

[0035] In a specific embodiment of the present invention, the specific method of obtaining the imaging deviation of the virtual object to be displayed is: respectively obtaining the coordinate value of each virtual point in the virtual object to be displayed after the coordinate system is aligned and the standard coordinate value of each virtual point specified by the imaging of the virtual object to be displayed. The square of the axis coordinate difference, Sum of squares of axis coordinate differences The square of the axis coordinate difference is accumulated and then the square root of these three square values is taken to get the average to obtain the imaging offset of the virtual object to be displayed.

[0036] See also Figure 2 As shown, the imaging offset of the virtual object to be displayed is compared with the imaging offset of the set reference. If the imaging offset of the virtual object to be displayed is greater than the imaging offset of the set reference, it is determined that the virtual object to be displayed does not accurately fall at the specified position of the real virtual exhibition hall. Otherwise, it is determined that the virtual object to be displayed accurately falls at the specified position of the real virtual exhibition hall.

[0037] In a specific embodiment of the present invention, the specific process of adjusting the position of the virtual object to be displayed according to the judgment result is: when it is determined that the virtual object to be displayed accurately falls at the specified position of the real virtual exhibition hall, there is no need to adjust the position of the virtual object to be displayed.

[0038] When it is determined that the virtual object to be displayed does not accurately fall on the specified position of the real virtual exhibition hall, a position adjustment strategy of the virtual object to be displayed is generated based on the iterative closest point algorithm.

[0039] See also Figure 3 As shown, in a specific embodiment of the present invention, the specific implementation process of the position adjustment strategy for generating the virtual object to be displayed based on the iterative closest point algorithm is as follows: Step 1: For each virtual point in the virtual object to be displayed after the coordinate system is aligned, find the point with the closest Euclidean distance in the standard point set specified for the imaging of the virtual object to be displayed to form temporary point pairs.

[0040] It should be noted that the point with the closest Euclidean distance refers to: for a virtual point of the virtual object to be displayed after the coordinate system is aligned, the distance between it and each point in the standard point set specified for the imaging of the virtual object to be displayed is calculated according to the Euclidean distance formula (that is, the square root of the sum of the squares of the differences between the corresponding coordinate components), and the standard point with the smallest calculated distance value is the point with the closest Euclidean distance to the virtual point.

[0041] Step 2: Use the least squares method to solve the rigid body transformation matrix of each temporary point pair and update the coordinates of each virtual point in the virtual object to be displayed.

[0042] It should be noted that the specific method of using the least squares method to solve the rigid body transformation matrix of each temporary point pair is to minimize the sum of the squares of the distances between the corresponding temporary point pairs. , by taking the derivative and setting it to zero, we can solve and ,in, Indicates the virtual object to be displayed The three-dimensional coordinates of a virtual point, Indicates the virtual object to be displayed Find the three-dimensional coordinate value of the point with the closest Euclidean distance among the standard points specified for the virtual object to be displayed. Indicates the virtual point number, .

[0043] Step 3: Obtain a new global offset of the virtual object to be displayed in the same way as analyzing the imaging offset of the virtual object to be displayed, and compare the new global offset with the imaging offset of the set reference. If the new global offset is less than or equal to the imaging offset of the set reference, stop the iteration; if the new global offset is greater than the imaging offset of the set reference, repeat steps 1 to 2.

[0044] The embodiment of the present invention calculates the imaging offset by comparing the actual coordinates of the virtual point with the standard coordinates based on the alignment results of the coordinate system. Based on the iterative closest point algorithm, it automatically generates a position adjustment strategy when the virtual object is not accurately positioned, continuously optimizes its position, and ensures the authenticity of the display.

[0045] The light source data acquisition module collects the light intensity and RGB value of each light source currently exposed to the virtual object in the real virtual exhibition hall, as well as the distance between each light source and the photosensor, when the virtual object to be displayed accurately falls at the specified position in the real virtual exhibition hall.

[0046] In a specific embodiment of the present invention, the light source types include but are not limited to natural light sources and lighting fixture light sources.

[0047] It should be noted that the light intensity of each light source is collected using a light sensor. The image containing the light source is captured using a camera, and then analyzed using digital image processing technology. The image is converted from the common RGB color space to another space that facilitates color feature analysis. The color information of the light source area in the image is extracted and then converted back to RGB values, thereby obtaining the RGB values of each light source. Distance measurement is achieved by placing a ranging sensor close to a photosensor in a real virtual exhibition hall.

[0048] The imaging color adjustment module adjusts the current brightness and RGB value of the virtual object to be displayed based on the light source data.

[0049] In a specific embodiment of the present invention, the specific implementation process of adjusting the current brightness and RGB value of the virtual object to be displayed based on the light source data is: the proportion of the square reciprocal of the distance between each light source and the photosensor to the sum of the square reciprocals of the distances between all light sources and the photosensor is used as the light source weight of each light source.

[0050] It should be noted that in the above expression, the sum of the square inverses of the distances between all light sources and the photosensor plays a normalization role, ensuring that the sum of the weights of all light sources is equal to 1.

[0051] The illumination intensity of each light source currently received by the virtual object to be displayed in the real virtual exhibition hall is multiplied and accumulated with the corresponding light source weight to obtain the current comprehensive illumination intensity. The brightness adjustment value of the virtual object to be displayed is obtained by coupling the comprehensive illumination intensity range of the real virtual exhibition hall and the virtual object imaging brightness adjustment range stored in the database.

[0052] In a specific embodiment of the present invention, the specific method of obtaining the brightness adjustment value of the virtual object to be displayed is: based on the minimum value of the virtual object imaging brightness adjustment range, and according to the relative proportion of the current comprehensive light intensity in the comprehensive light intensity range of the real virtual exhibition hall, a fusion calculation is performed to obtain the brightness adjustment value of the virtual object to be displayed.

[0053] It should be noted that the calculation formula for the brightness adjustment value of the virtual object to be displayed is: ,in, Indicates the brightness adjustment value, Indicates the virtual object imaging brightness adjustment range, Represents the comprehensive lighting intensity range of the real virtual exhibition hall, Indicates the current comprehensive light intensity.

[0054] It should be further explained that the above formula is interpreted as follows: the molecular part : Indicates the difference between the current integrated light intensity and the minimum integrated light intensity, reflecting the relative position of the current light intensity in the entire light intensity variation range. The denominator : It is the range of variation of the comprehensive light intensity, which is used to normalize the difference of the numerator to obtain a proportional value between 0 and 1. : Calculate the relative proportion of the current comprehensive light intensity within the entire light intensity variation range. The overall formula is: first obtain the relative proportion of the current comprehensive light intensity through the intermediate fraction, then multiply it by the brightness adjustment range to obtain the brightness adjustment amount based on the relative proportion of the comprehensive light intensity, and finally add the minimum value of the brightness adjustment range to obtain the final brightness adjustment value.

[0055] It should also be noted that the comprehensive light intensity of the virtual exhibition hall at its darkest time is recorded as , the comprehensive light intensity at the brightest time in history is recorded as , thus obtaining the comprehensive lighting intensity range of the real virtual exhibition hall.

[0056] The RGB values of each light source currently exposed to the virtual object to be displayed in the real virtual exhibition hall are multiplied and accumulated with the corresponding light source weight to obtain a comprehensive RGB value, and based on this, a deep analysis is performed to obtain the RGB adjustment value of the virtual object to be displayed.

[0057] In a specific embodiment of the present invention, the specific process of obtaining the RGB adjustment value of the virtual object to be displayed is: calculating the average of the R value, G value and B value in the comprehensive RGB value to obtain the average color intensity, obtaining the gain coefficients corresponding to the R value, G value and B value in the current comprehensive RGB value according to the average color intensity, and multiplying the R value, G value and B value in the current comprehensive RGB value by their corresponding gain coefficients to obtain the R adjustment value, G adjustment value and B adjustment value of the virtual object to be displayed.

[0058] In a specific embodiment of the present invention, the specific method of obtaining the gain coefficients corresponding to the R value, G value and B value in the current integrated RGB value according to the average color intensity is as follows: when a color component in the current integrated RGB value is greater than the average color intensity, the gain coefficient of the color channel is the base value minus an amount related to the difference between the color component and the average color intensity, and the gain coefficients of the other two color channels are the base value plus an amount related to the difference between the respective color components and the average color intensity, wherein the color components specifically include the R value, the G value and the B value.

[0059] In a specific embodiment of the present invention, the specific process of obtaining the gain coefficient is analyzed by taking the case where the B value in the current integrated RGB value is greater than the average color intensity as an example: , , , where 1 represents a base coefficient, indicating the original gain state, Indicates the average color intensity. In the RGB color mode, the value range of each color channel is 0 255. "255" is the maximum value that a color channel can reach. "255" is used in the formula to normalize the difference between color components.

[0060] It should be further explained that the design logic of the above gain coefficient is as follows: the purpose is to adjust the color ratio of the holographic imaging according to the color of the ambient light to make the imaging color more natural. When a certain color component of the ambient light is dominant (greater than the average color intensity), it will cause color imbalance, so it is necessary to "shrink" the color component (reduce its gain coefficient) and appropriately "amplify" other color components (increase their gain coefficients) to achieve color balance. The color component difference is normalized by dividing by "255" and the range of color component changes is mapped to 0. 1, so as to reasonably control the adjustment degree of the gain coefficient.

[0061] The embodiment of the present invention collects light intensity, RGB values and light source distance, and calculates the light source weight based on this data to obtain the comprehensive light intensity and comprehensive RGB values, and then adjusts the brightness and color of the virtual objects. By adapting to the lighting environment of the real scene, the fusion effect of the virtual objects and the real scene is enhanced, providing a more realistic visual experience.

[0062] The above contents are merely examples and explanations of the concept of the present invention. Those skilled in the art may make various modifications or additions to the described specific embodiments or replace them in a similar manner. As long as they do not deviate from the concept of the invention or exceed the scope defined by the present invention, they should all fall within the scope of protection of the present invention.

Claims

1. A holographic optical imaging system for metaverse augmented reality display, characterized in that: include: The coordinate system conversion module obtains the 3D model of the virtual scene and the 3D point cloud data of the real virtual exhibition hall, and establishes a spatial mapping relationship between the two through a coordinate transformation algorithm, so that the coordinate system of the virtual object to be displayed is aligned with the coordinate system of the real virtual exhibition hall; The imaging display adjustment module determines whether the virtual object to be displayed is accurately located at the specified position in the real virtual exhibition hall after the coordinate system is aligned, and adjusts the position of the virtual object to be displayed based on the judgment result; The light source data acquisition module collects the light intensity and RGB values of each light source currently exposed to the virtual object in the virtual exhibition hall, as well as the distance between each light source and the photosensor, after the virtual object to be displayed is accurately placed at the specified location in the virtual exhibition hall. An imaging color adjustment module adjusts the current brightness and RGB value of the virtual object to be displayed based on the light source data; The specific implementation process of adjusting the current brightness and RGB value of the virtual object to be displayed based on the light source data is as follows: the proportion of the square reciprocal of the distance between each light source and the photosensor to the sum of the square reciprocals of the distances between all light sources and the photosensor is used as the light source weight of each light source; The current illumination intensity of each light source received by the virtual object to be displayed in the real virtual exhibition hall is multiplied by the corresponding light source weight and then accumulated to obtain the current comprehensive illumination intensity. The brightness adjustment value of the virtual object to be displayed is obtained by coupling the comprehensive illumination intensity range of the real virtual exhibition hall and the virtual object imaging brightness adjustment range stored in the database; The specific method of obtaining the brightness adjustment value of the virtual object to be displayed is: based on the minimum value of the virtual object imaging brightness adjustment range, and according to the relative proportion of the current comprehensive light intensity within the comprehensive light intensity range of the real virtual exhibition hall, the brightness adjustment value of the virtual object to be displayed is obtained by fusion calculation; The RGB values of each light source currently exposed to the virtual object in the real virtual exhibition hall are multiplied and added with the corresponding light source weight to obtain the current comprehensive RGB value, and a deep analysis is performed based on this to obtain the RGB adjustment value of the virtual object to be displayed; The specific process of obtaining the RGB adjustment value of the virtual object to be displayed is: calculating the average of the R value, G value and B value in the comprehensive RGB value to obtain the average color intensity, obtaining the gain coefficients corresponding to the R value, G value and B value in the current comprehensive RGB value according to the average color intensity, and multiplying the R value, G value and B value in the current comprehensive RGB value by their corresponding gain coefficients to obtain the R adjustment value, G adjustment value and B adjustment value of the virtual object to be displayed.

2. The holographic optical imaging system for metaverse augmented reality display according to claim 1, characterized in that: The specific implementation process of establishing the spatial mapping relationship between the two through the coordinate transformation algorithm is as follows: Extracting the three-dimensional coordinate values of each virtual point in the virtual object to be displayed from the three-dimensional model of the virtual scene, and obtaining the three-dimensional coordinate values of each corresponding real point from the three-dimensional point cloud data of the real virtual exhibition hall; Obtain the centroids of the virtual point set and the real point set respectively, translate the point sets to the local coordinate system with their respective centroids as the origin, and construct the covariance matrix based on this. Perform singular value decomposition on the covariance matrix to obtain the rotation matrix; The translation vector is obtained by fusing the rotation matrix and the centroid of the virtual point set and the real point set; The coordinates of each virtual point in the virtual object to be displayed are transformed using the rotation matrix and translation vector.

3. The holographic optical imaging system for metaverse augmented reality display according to claim 2, characterized in that: The specific process of determining whether the virtual object to be displayed is accurately located at the specified position of the real virtual exhibition hall is as follows: Coupling processing is performed based on the coordinate values of each virtual point in the virtual object to be displayed after the coordinate system is aligned and the standard coordinate values of each virtual point in the imaging specification of the virtual object to be displayed stored in the database to obtain the imaging offset of the virtual object to be displayed; The imaging offset of the virtual object to be displayed is compared with the imaging offset of the set reference. If the imaging offset of the virtual object to be displayed is greater than the imaging offset of the set reference, it is determined that the virtual object to be displayed does not accurately fall at the specified position of the real virtual exhibition hall. Otherwise, it is determined that the virtual object to be displayed accurately falls at the specified position of the real virtual exhibition hall.

4. The holographic optical imaging system for metaverse augmented reality display according to claim 3, characterized in that: The specific method of obtaining the imaging deviation of the virtual object to be displayed is: respectively obtaining the coordinate value of each virtual point in the virtual object to be displayed after the coordinate system is aligned and the standard coordinate value of each virtual point specified by the imaging of the virtual object to be displayed. The square of the axis coordinate difference, Sum of squares of axis coordinate differences The square of the axis coordinate difference is accumulated and then the square root of these three square values is taken to get the average to obtain the imaging offset of the virtual object to be displayed.

5. The holographic optical imaging system for metaverse augmented reality display according to claim 3, characterized in that: The specific process of adjusting the position of the virtual object to be displayed according to the judgment result is as follows: When it is determined that the virtual object to be displayed is accurately located at the specified position of the real virtual exhibition hall, there is no need to adjust the position of the virtual object to be displayed; When it is determined that the virtual object to be displayed does not accurately fall on the specified position of the real virtual exhibition hall, a position adjustment strategy of the virtual object to be displayed is generated based on the iterative closest point algorithm.

6. The holographic optical imaging system for metaverse augmented reality display according to claim 5, characterized in that: The specific implementation process of the position adjustment strategy for generating the virtual object to be displayed based on the iterative closest point algorithm is as follows: Step 1: After the coordinate system is aligned, the virtual points of the virtual object to be displayed are found to have the closest Euclidean distance in the set of standard points specified for the imaging of the virtual object to be displayed, thereby forming temporary point pairs; Step 2: Use the least squares method to solve the rigid body transformation matrix of each temporary point pair and update the coordinates of each virtual point in the virtual object to be displayed; Step 3: Obtain a new global offset of the virtual object to be displayed in the same way as analyzing the imaging offset of the virtual object to be displayed, and compare the new global offset with the imaging offset of the set reference. If the new global offset is less than or equal to the imaging offset of the set reference, stop the iteration; if the new global offset is greater than the imaging offset of the set reference, repeat steps 1 to 2.

7. The holographic optical imaging system for metaverse augmented reality display according to claim 1, characterized in that: The specific method of obtaining the gain coefficients corresponding to the R value, G value, and B value in the current integrated RGB value according to the average color intensity is as follows: when a color component in the current integrated RGB value is greater than the average color intensity, the gain coefficient of the color channel is the base value minus an amount related to the difference between the color component and the average color intensity, and the gain coefficients of the other two color channels are the base value plus an amount related to the difference between the respective color components and the average color intensity, wherein the color components specifically include the R value, the G value, and the B value.

Images