Holographic optical imaging system for universe augmented reality display

Through the coordinate transformation algorithm, iterative closest point algorithm and light source data processing technology in the holographic optical imaging system, the problem of virtual object positioning deviation and incoordination of lighting environment is solved, and high-precision virtual object positioning and realistic visual experience are achieved.

CN120065669AActive Publication Date: 2025-05-30SHENZHEN OMNI-IN TECH CO LTD

Patent Information

Application Number
CN202510547325.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-04-28
Publication Date
2025-05-30
Estimated Expiration
2045-04-28

AI Technical Summary

Technical Problem

In the prior art, the alignment accuracy of the coordinate system is low, resulting in large deviations in positioning of virtual objects in real scenes, and lack of effective position judgment and adjustment mechanisms, which affects the authenticity of the display; at the same time, insufficient collection and utilization of lighting data in real scenes leads to inconsistent lighting environments of virtual objects and the real scenes, and poor visual effects.

Method used

It provides a holographic optical imaging system for metacosmic augmented reality display, including a coordinate system conversion module, an imaging display adjustment module, a light source data acquisition module and an imaging color adjustment module. The spatial mapping relationship between virtual scenes and real scenes is established through the coordinate transformation algorithm to achieve high-precision coordinate alignment; use the iterative nearest point algorithm to adjust the position; collect light source data and calculate the light source weight, and adjust the brightness and color of the virtual object to adapt to the lighting environment of the real scene.

Benefits of technology

It improves the positioning accuracy of virtual objects in real scenes and ensures the authenticity of displays; by adapting to the lighting environment of real scenes, the fusion effect between virtual objects and real scenes is enhanced, providing a more realistic visual experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120065669A_ABST
    Figure CN120065669A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of holographic optical imaging, and particularly discloses a holographic optical imaging system for universe augmented reality display, which comprises a coordinate system conversion module, an imaging display adjustment module, a light source data acquisition module, an imaging color adjustment module and a database, according to the method, accurate alignment of the virtual coordinate system and the real coordinate system is achieved through a specific algorithm, the position of the virtual object is judged after the coordinate systems are aligned, a position adjusting strategy is automatically generated based on the iterative nearest point algorithm when the virtual object is not accurately located, and the position of the virtual object is continuously optimized; meanwhile, the brightness and the RGB value of the virtual object are adjusted according to the collected illumination data, so that the problems of inaccurate coordinate alignment, difficulty in position judgment and adjustment and poor illumination color adaptation in virtual and reality fusion are solved, the display effect of the virtual object in a reality scene is improved, the immersive experience of a user is enhanced, and the user experience is improved. And the method has an important application value in the field of virtual display of the universe.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of holographic optical imaging technology, and in particular to a holographic optical imaging system for metaverse augmented reality display. Background Art

[0002] With the rise of the concept of the metaverse, augmented reality technology is increasingly being used in the field of virtual display. In virtual display scenes, virtual objects need to be accurately integrated with real scenes to achieve an immersive display experience. Therefore, in order to ensure that virtual display achieves the best effect and meet users' needs for realistic and immersive experience, it is necessary to analyze the integration of virtual and reality.

[0003] The following problems still exist in the prior art: 1. The alignment accuracy of the coordinate system is low, and the spatial mapping relationship between the virtual scene and the real scene cannot be accurately established, resulting in large positioning deviations of virtual objects in the real scene. Secondly, there is a lack of effective position judgment and adjustment mechanisms, making it difficult to ensure that virtual objects accurately fall into the specified positions of the real scene, affecting the authenticity of the display.

[0004] 2. The collection and utilization of real-world scene lighting data is insufficient, and the brightness and color of virtual objects cannot be reasonably adjusted according to the light intensity and color, resulting in inconsistency between the virtual objects and the lighting environment of the real scene and poor visual effects. Summary of the invention

[0005] In view of this, in order to solve the problems raised in the above background technology, a holographic optical imaging system for metaverse augmented reality display is proposed.

[0006] The purpose of the present invention can be achieved through the following technical solutions: The present invention provides a holographic optical imaging system for metaverse augmented reality display, including: a coordinate system conversion module, which obtains the three-dimensional model of the virtual scene and the three-dimensional point cloud data of the real virtual exhibition hall, and establishes a spatial mapping relationship between the two through a coordinate transformation algorithm, so that the coordinate system of the virtual object to be displayed is aligned with the coordinate system of the real virtual exhibition hall.

[0007] The imaging display adjustment module determines whether the virtual object to be displayed accurately falls on the specified position of the real virtual exhibition hall after the coordinate system is aligned, and adjusts the position of the virtual object to be displayed according to the judgment result.

[0008] The light source data acquisition module collects the light intensity and RGB value of each light source currently received by the virtual object to be displayed in the real virtual exhibition hall, as well as the distance between each light source and the photosensor, when the virtual object to be displayed accurately falls at the specified position of the real virtual exhibition hall.

[0009] The imaging color adjustment module adjusts the current brightness and RGB value of the virtual object to be displayed based on the light source data.

[0010] Compared with the prior art, the embodiments of the present invention have at least the following advantages or beneficial effects: (1) By using the coordinate transformation algorithm, the present invention extracts the corresponding point coordinates from the virtual scene and the real virtual exhibition hall, and obtains the rotation matrix and translation vector through centroid translation, covariance matrix processing, and singular value decomposition, realizing the high-precision alignment of the coordinate systems of the virtual object to be displayed and the real virtual exhibition hall, and improving the accuracy of virtual object positioning.

[0011] (2) According to the coordinate system alignment result, the present invention calculates the imaging offset by comparing the actual coordinates and standard coordinates of the virtual points, and based on the iterative closest point algorithm, automatically generates a position adjustment strategy when the virtual object is not accurately positioned, and continuously optimizes its position to ensure the authenticity of the display.

[0012] (3) By collecting the light intensity, RGB values, and light source distance, and calculating the light source weight according to these data, the present invention obtains the comprehensive light intensity and comprehensive RGB values, and then adjusts the brightness and color of the virtual object. By adapting to the lighting environment of the real scene, the present invention enhances the fusion effect between the virtual object and the real scene, providing a more realistic visual experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0014] Figure 1 It is a schematic connection diagram of the system module structure of the present invention.

[0015] Figure 2 It is a flowchart for judging the position accuracy of the virtual object to be displayed in the present invention.

[0016] Figure 3 It is a flowchart of the position adjustment strategy for the virtual object to be displayed in the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0017] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, rather than all, embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0018] Please refer to Figure 1As shown, the present invention provides a holographic optical imaging system for metaverse augmented reality display, comprising: a coordinate system conversion module, an imaging display adjustment module, a light source data acquisition module, and an imaging color adjustment module.

[0019] It should be noted that the present invention further includes a database for storing the standard coordinate values of each virtual point for the imaging regulations of the virtual objects to be displayed, the comprehensive illumination intensity range of the real virtual exhibition hall, and the virtual object imaging brightness adjustment range.

[0020] The coordinate system conversion module is connected to the imaging display adjustment module, the imaging display adjustment module is connected to the light source data acquisition module, the light source data acquisition module is connected to the imaging color adjustment module, and both the imaging display adjustment module and the imaging color adjustment module are connected to the database.

[0021] The imaging coordinate system conversion module obtains the three-dimensional model of the virtual scene and the three-dimensional point cloud data of the real virtual exhibition hall, and establishes a spatial mapping relationship between the two through a coordinate transformation algorithm, so that the coordinate system of the virtual object to be displayed is aligned with the coordinate system of the real virtual exhibition hall.

[0022] It should be noted that it is connected to the metaverse platform through a network interface to obtain the three-dimensional model of the virtual scene, and it obtains the three-dimensional point cloud data of the real virtual exhibition hall by emitting a laser beam through a lidar and receiving the reflected signal.

[0023] In a specific embodiment of the present invention, the specific implementation process of establishing the spatial mapping relationship between the two through the coordinate transformation algorithm is as follows: extract the three-dimensional coordinate values of each virtual point in the virtual object to be displayed from the three-dimensional model of the virtual scene, and obtain the three-dimensional coordinate values of the corresponding real points from the three-dimensional point cloud data of the real virtual exhibition hall.

[0024] It should be noted that obtaining the three-dimensional coordinate values of each virtual point in the virtual object to be displayed and the corresponding real points in the real virtual exhibition hall, these corresponding point pairs are the basis for subsequent calculations, and the corresponding point pairs can be automatically obtained by using feature detection and matching algorithms.

[0025] Respectively obtain the centroids of the virtual point set and the real point set, translate the point sets to the local coordinate systems with their respective centroids as the origin, and construct a covariance matrix accordingly, and perform singular value decomposition on the covariance matrix to obtain the rotation matrix.

[0026] It should be noted that the way to obtain the centroids of the virtual point set and the real point set is: , , where and respectively represent the centroid of the virtual point set and the centroid of the real point set, and respectively represent the three-dimensional coordinate values of the virtual points and the corresponding three-dimensional coordinate values of the real points in the th point pair, , , represents the point pair number, , represents the number of point pairs. The translation of the point set to the local coordinate system with its respective centroid as the origin is specifically manifested as: , . The construction of the covariance matrix is specifically manifested as: , where represents the covariance matrix. The singular value decomposition of the covariance matrix is manifested as: . The rotation matrix is expressed as: , where represents the rotation matrix.

[0027] It should be further noted that the singular value decomposition is an important matrix decomposition method in linear algebra, which can decompose any m×n real matrix into the product of three matrices, that is . Among them: is an m×m orthogonal matrix ( , and the column vectors are called left singular vectors), is an m×n diagonal matrix, and the elements on the diagonal are non-negative singular values, arranged from large to small, is an n×n orthogonal matrix ( , and the column vectors are called right singular vectors).

[0028] Based on the rotation matrix and the centroids of the virtual point set and the real point set, a translation vector is obtained through fusion processing.

[0029] It should be noted that the translation vector is specifically expressed as: , where represents the translation vector.

[0030] Using the rotation matrix and the translation vector, the coordinates of each virtual point in the virtual object to be displayed are transformed.

[0031] It should be noted that the transformation of the coordinates of each virtual point in the virtual object to be displayed is specifically manifested as: .

[0032] In the embodiment of the present invention, by using the coordinate transformation algorithm, the corresponding point coordinates are extracted from the virtual scene and the real virtual exhibition hall, and the rotation matrix and the translation vector are obtained through centroid translation, covariance matrix processing and singular value decomposition, so as to achieve high-precision alignment of the coordinate systems of the virtual object to be displayed and the real virtual exhibition hall, and improve the accuracy of virtual object positioning.

[0033] The imaging display adjustment module determines whether the virtual object to be displayed accurately falls within the specified position of the real virtual exhibition hall after the coordinate systems are aligned, and adjusts the position of the virtual object to be displayed according to the judgment result.

[0034] In a specific embodiment of the present invention, the specific process of determining whether the virtual object to be displayed accurately falls within the specified position of the real virtual exhibition hall is as follows: coupling processing is performed based on the coordinate values of each virtual point in the virtual object to be displayed after the coordinate systems are aligned and the standard coordinate values of each virtual point specified for the imaging of the virtual object to be displayed stored in the database, to obtain the imaging offset degree of the virtual object to be displayed.

[0035] In a specific embodiment of the present invention, the specific manner of obtaining the imaging offset degree of the virtual object to be displayed is: respectively obtaining the coordinate values of each virtual point in the virtual object to be displayed after the coordinate systems are aligned and the standard coordinate values of each virtual point specified for the imaging of the virtual object to be displayed in the square of the difference in the axis coordinate, the square of the difference in the

[0036] axis coordinate, and Figure 2 the square of the difference in the

[0037] axis coordinate. After adding up these three squared values and then taking the square root and averaging, the imaging offset degree of the virtual object to be displayed is obtained.

[0038] When it is determined that the virtual object to be displayed does not accurately fall within the specified position of the real virtual exhibition hall, a position adjustment strategy for the virtual object to be displayed is generated based on the iterative closest point algorithm.

[0039] Please refer to Figure 3 shown. In a specific embodiment of the present invention, the specific implementation process of generating a position adjustment strategy for the virtual object to be displayed based on the iterative closest point algorithm is as follows: Step 1: Find the point with the closest Euclidean distance in the standard point set specified for the imaging of the virtual object to be displayed for each virtual point in the virtual object to be displayed after the coordinate systems are aligned, to form each temporary point pair.

[0040] It should be noted that the point with the closest Euclidean distance refers to: for a certain virtual point of the virtual object to be displayed after the coordinate systems are aligned, the distances between this virtual point and each point in the set of standard points specified for the imaging of the virtual object to be displayed are calculated respectively according to the Euclidean distance formula (that is, the square root of the sum of the squares of the differences of the corresponding coordinate components). Among them, the standard point with the smallest calculated distance value is the point with the closest Euclidean distance to this virtual point.

[0041] Step 2: Use the least squares method to solve the rigid body transformation matrix for each pair of temporary points, and update the coordinates of each virtual point in the virtual object to be displayed.

[0042] It should be noted that the specific method for using the least squares method to solve the rigid body transformation matrix for each pair of temporary points is: minimizing the sum of the squares of the distances corresponding to the pairs of temporary points , by taking the derivative and setting the derivative to zero, solve for and , where, represents the three-dimensional coordinate value of the th virtual point in the virtual object to be displayed, represents the three-dimensional coordinate value of the point with the closest Euclidean distance found in the set of standard points specified for the imaging of the virtual object to be displayed for the th virtual point in the virtual object to be displayed, represents the virtual point number, .

[0043] Step 3: Similarly obtain the new global offset of the virtual object to be displayed according to the analysis method of the imaging offset of the virtual object to be displayed. Compare the new global offset with the set reference imaging offset. If the new global offset is less than or equal to the set reference imaging offset, stop the iteration. If the new global offset is greater than the set reference imaging offset, repeat Step 1 to Step 2.

[0044] In the embodiment of the present invention, by comparing the actual coordinates of the virtual points with the standard coordinates according to the coordinate system alignment result to calculate the imaging offset, based on the iterative closest point algorithm, a position adjustment strategy is automatically generated when the virtual object is not accurately positioned, and its position is continuously optimized to ensure the authenticity of the display.

[0045] The light source data acquisition module, when the virtual object to be displayed accurately falls at the specified position in the real virtual exhibition hall, acquires the illumination intensity, RGB values of each light source received by the virtual object to be displayed in the real virtual exhibition hall, and the distances between each light source and the photosensitive sensor.

[0046] In a specific embodiment of the present invention, the light source types include but are not limited to natural light sources and lighting fixture light sources.

[0047] It should be noted that the illumination intensity of each light source is collected by the light sensor. By using a camera to capture an image containing the light source, and then analyzing the image through digital image processing technology, the image is converted from the common RGB color space to other spaces convenient for analyzing color features, the color information of the light source area in the image is extracted, and then converted back to the RGB value, so as to obtain the RGB values of each light source. By arranging the distance sensor close to the photosensitive sensor in the virtual reality exhibition hall, distance measurement is realized.

[0048] The imaging color adjustment module adjusts the current brightness and RGB values of the virtual object to be displayed based on the light source data.

[0049] In a specific embodiment of the present invention, the specific implementation process of adjusting the current brightness and RGB values of the virtual object to be displayed based on the light source data is as follows: taking the reciprocal of the square of the distance between each light source and the photosensitive sensor as the light source weight of each light source in the sum of the reciprocals of the squares of the distances between all light sources and the photosensitive sensor.

[0050] It should be noted that the sum of the reciprocals of the squares of the distances between all light sources and the photosensitive sensor in the above expression plays a role of normalization, ensuring that the sum of all light source weights is equal to 1.

[0051] Multiply the illumination intensity of each light source received by the virtual object to be displayed in the virtual reality exhibition hall by the corresponding light source weight and accumulate them to obtain the current comprehensive illumination intensity, and perform coupling processing based on the comprehensive illumination intensity interval of the virtual reality exhibition hall stored in the database and the virtual object imaging brightness adjustment interval to obtain the brightness adjustment value of the virtual object to be displayed.

[0052] In a specific embodiment of the present invention, the specific method for obtaining the brightness adjustment value of the virtual object to be displayed is: based on the minimum value of the virtual object imaging brightness adjustment interval, and perform fusion calculation according to the relative proportion of the current comprehensive illumination intensity in the comprehensive illumination intensity interval of the virtual reality exhibition hall to obtain the brightness adjustment value of the virtual object to be displayed.

[0053] It should be noted that the calculation formula for the brightness adjustment value of the virtual object to be displayed is: , where represents the brightness adjustment value, represents the virtual object imaging brightness adjustment interval, represents the comprehensive illumination intensity interval of the virtual reality exhibition hall, represents the current comprehensive illumination intensity.

[0054] It should be further noted that the meaning of the above formula is explained as: the numerator part : Represents the difference between the current comprehensive light intensity and the minimum value of the comprehensive light intensity, reflecting the relative position of the current light intensity within the entire range of light intensity changes. The denominator part : Is the range of change of the comprehensive light intensity, used to normalize the difference of the numerator to obtain a proportional value between 0 and 1. The middle fraction : Calculates the relative proportion of the current comprehensive light intensity within the entire range of light intensity changes. The overall formula: First, obtain the relative proportion of the current comprehensive light intensity through the middle fraction, then multiply it by the range of the brightness adjustment interval to obtain the brightness adjustment amount based on the relative proportion of the comprehensive light intensity. Finally, add the minimum value of the brightness adjustment interval to obtain the final brightness adjustment value.

[0055] It should also be noted that by recording the comprehensive light intensity when the real virtual exhibition hall is at its darkest in history as , and recording the comprehensive light intensity when it is at its brightest in history as , thus obtaining the comprehensive light intensity interval of the real virtual exhibition hall.

[0056] Multiply the RGB values of each light source that the virtual object to be displayed currently receives in the real virtual exhibition hall by the corresponding light source weights and accumulate them to obtain the comprehensive RGB value, and perform in-depth analysis based on this to obtain the RGB adjustment value of the virtual object to be displayed.

[0057] In a specific embodiment of the present invention, the specific process of obtaining the RGB adjustment value of the virtual object to be displayed is as follows: Calculate the average value of the R value, G value, and B value in the comprehensive RGB value to obtain the average color intensity. Obtain the gain coefficients corresponding to the R value, G value, and B value in the current comprehensive RGB value according to the average color intensity, and multiply the R value, G value, and B value in the current comprehensive RGB value by their corresponding gain coefficients respectively to obtain the R adjustment value, G adjustment value, and B adjustment value of the virtual object to be displayed.

[0058] In a specific embodiment of the present invention, the specific method of obtaining the gain coefficients corresponding to the R value, G value, and B value in the current comprehensive RGB value according to the average color intensity is as follows: When a certain color component in the current comprehensive RGB value is greater than the average color intensity, the gain coefficient of this color channel is the reference value minus a quantity related to the difference between this color component and the average color intensity, and the gain coefficients of the other two color channels are the reference value plus a quantity related to the difference between their respective color components and the average color intensity. Among them, the color components specifically include the R value, G value, and B value.

[0059] In a specific embodiment of the present invention, taking the case where the B value in the current comprehensive RGB value is greater than the average color intensity as an example, analyze the specific process of obtaining the gain coefficient: , , , where 1 represents a reference coefficient, indicating the original gain state, represents the average color intensity. In the RGB color mode, the value range of each color channel is 0 to 255. "255" is the maximum value that the color channel can reach. Using "255" in the formula is to normalize the difference of the color components.

[0060] It should be further noted that the design logic of the above gain coefficient is as follows: The purpose is to adjust the color ratio of the holographic imaging according to the ambient light color to make the imaging color more natural. When a certain color component of the ambient light dominates (larger than the average color intensity), it will cause color imbalance. Therefore, it is necessary to "shrink" this color component (reduce its gain coefficient), and at the same time appropriately "enlarge" other color components (increase their gain coefficients) to achieve color balance. By dividing by "255" to normalize the difference of the color components, the change range of the color components is mapped to 0 to 1, so as to reasonably control the adjustment degree of the gain coefficient.

[0061] In the embodiment of the present invention, by collecting the light intensity, RGB values, and the light source distance, and calculating the light source weight based on these data, the comprehensive light intensity and the comprehensive RGB values are obtained, and then the brightness and color of the virtual object are adjusted. By adapting to the lighting environment of the real scene, the fusion effect between the virtual object and the real scene is enhanced, providing a more realistic visual experience.

[0062] The above content is only an example and explanation of the concept of the present invention. Those skilled in the art of this technology can make various modifications or supplements to the described specific embodiments or use similar methods to replace them, as long as they do not deviate from the concept of the invention or exceed the scope defined by the present invention, they should all belong to the protection scope of the present invention.

Claims

1. A holographic optical imaging system for metaverse augmented reality display, characterized in that: include: The coordinate system conversion module obtains the three-dimensional model of the virtual scene and the three-dimensional point cloud data of the real virtual exhibition hall, and establishes a spatial mapping relationship between the two through a coordinate transformation algorithm, so that the coordinate system of the virtual object to be displayed is aligned with the coordinate system of the real virtual exhibition hall; The imaging display adjustment module determines whether the virtual object to be displayed is accurately located at the specified position of the real virtual exhibition hall after the coordinate system is aligned, and adjusts the position of the virtual object to be displayed according to the judgment result; The light source data acquisition module collects the light intensity and RGB value of each light source currently received by the virtual object in the real virtual exhibition hall, as well as the distance between each light source and the photosensitive sensor, when the virtual object to be displayed is accurately placed at the specified position of the real virtual exhibition hall; The imaging color adjustment module adjusts the current brightness and RGB value of the virtual object to be displayed based on the light source data.

2. The holographic optical imaging system for metaverse augmented reality display according to claim 1, characterized in that: The specific implementation process of establishing the spatial mapping relationship between the two through the coordinate transformation algorithm is as follows: Extracting the three-dimensional coordinate values ​​of each virtual point in the virtual object to be displayed from the three-dimensional model of the virtual scene, and obtaining the three-dimensional coordinate values ​​of each corresponding real point from the three-dimensional point cloud data of the real virtual exhibition hall; Get the centroids of the virtual point set and the real point set respectively, translate the point sets to the local coordinate system with their respective centroids as the origin, and construct the covariance matrix based on this, perform singular value decomposition on the covariance matrix, and thus obtain the rotation matrix; The translation vector is obtained by fusing the rotation matrix and the centroids of the virtual point set and the real point set; The coordinates of each virtual point in the virtual object to be displayed are transformed using the rotation matrix and translation vector.

3. The holographic optical imaging system for metaverse augmented reality display according to claim 2, characterized in that: The specific process of judging whether the virtual object to be displayed is accurately located at the specified position of the real virtual exhibition hall is as follows: Coupling processing is performed according to the coordinate values ​​of each virtual point in the virtual object to be displayed after the coordinate system is aligned and the standard coordinate values ​​of each virtual point in the imaging regulation of the virtual object to be displayed stored in the database to obtain the imaging deviation degree of the virtual object to be displayed; The imaging offset of the virtual object to be displayed is compared with the imaging offset of the set reference. If the imaging offset of the virtual object to be displayed is greater than the imaging offset of the set reference, it is determined that the virtual object to be displayed does not accurately fall at the specified position of the real virtual exhibition hall. Otherwise, it is determined that the virtual object to be displayed accurately falls at the specified position of the real virtual exhibition hall.

4. The holographic optical imaging system for metaverse augmented reality display according to claim 3, characterized in that: The specific method of obtaining the imaging deviation of the virtual object to be displayed is: respectively obtaining the coordinate value of each virtual point in the virtual object to be displayed after the coordinate system is aligned and the standard coordinate value of each virtual point specified by the imaging of the virtual object to be displayed. The square of the axis coordinate difference, The sum of squares of the axis coordinate differences The square of the axis coordinate difference is accumulated and then the square root is taken to get the average value to obtain the imaging offset of the virtual object to be displayed.

5. The holographic optical imaging system for metaverse augmented reality display according to claim 3, characterized in that: The specific process of adjusting the position of the virtual object to be displayed according to the judgment result is: When it is determined that the virtual object to be displayed is accurately located at the specified position of the real virtual exhibition hall, there is no need to adjust the position of the virtual object to be displayed; When it is determined that the virtual object to be displayed does not accurately fall on the specified position of the real virtual exhibition hall, a position adjustment strategy of the virtual object to be displayed is generated based on an iterative closest point algorithm.

6. The holographic optical imaging system for metaverse augmented reality display according to claim 5, characterized in that: The specific implementation process of the position adjustment strategy for generating the virtual object to be displayed based on the iterative closest point algorithm is as follows: Step 1: After the coordinate system is aligned, each virtual point in the virtual object to be displayed finds the point with the closest Euclidean distance in the standard point set specified for the imaging of the virtual object to be displayed, so as to form each temporary point pair; Step 2: Use the least squares method to solve the rigid body transformation matrix of each temporary point pair, and update the coordinates of each virtual point in the virtual object to be displayed; Step 3: Obtain a new global offset of the virtual object to be displayed in the same way as analyzing the imaging offset of the virtual object to be displayed, and compare the new global offset with the imaging offset of the set reference. If the new global offset is less than or equal to the imaging offset of the set reference, stop the iteration; if the new global offset is greater than the imaging offset of the set reference, repeat steps 1 to 2.

7. The holographic optical imaging system for metaverse augmented reality display according to claim 1, characterized in that: The specific implementation process of adjusting the current brightness and RGB value of the virtual object to be displayed based on the light source data is as follows: The proportion of the square reciprocal of the distance between each light source and the photosensor to the sum of the square reciprocals of the distances between all light sources and the photosensors is used as the light source weight of each light source; The illumination intensity of each light source currently received by the virtual object to be displayed in the real virtual exhibition hall is multiplied and accumulated with the corresponding light source weight to obtain the current comprehensive illumination intensity, and coupled processing is performed based on the comprehensive illumination intensity range of the real virtual exhibition hall and the virtual object imaging brightness adjustment range stored in the database to obtain the brightness adjustment value of the virtual object to be displayed; The RGB values ​​of each light source currently received by the virtual object to be displayed in the real virtual exhibition hall are multiplied and accumulated with the corresponding light source weight to obtain the current comprehensive RGB value, and a deep analysis is performed based on this to obtain the RGB adjustment value of the virtual object to be displayed.

8. The holographic optical imaging system for metaverse augmented reality display according to claim 7, characterized in that: The specific method for obtaining the brightness adjustment value of the virtual object to be displayed is: based on the minimum value of the virtual object imaging brightness adjustment range, and according to the relative proportion of the current comprehensive light intensity in the comprehensive light intensity range of the real virtual exhibition hall, a fusion calculation is performed to obtain the brightness adjustment value of the virtual object to be displayed.

9. The holographic optical imaging system for metaverse augmented reality display according to claim 7, characterized in that: The specific process of obtaining the RGB adjustment value of the virtual object to be displayed is: average calculating the R value, G value and B value in the comprehensive RGB value to obtain the average color intensity, obtaining the gain coefficients corresponding to the R value, G value and B value in the current comprehensive RGB value according to the average color intensity, and multiplying the R value, G value and B value in the current comprehensive RGB value by the corresponding gain coefficients to obtain the R adjustment value, G adjustment value and B adjustment value of the virtual object to be displayed.

10. The holographic optical imaging system for metaverse augmented reality display according to claim 9, characterized in that: The specific method of obtaining the gain coefficients corresponding to the R value, G value and B value in the current comprehensive RGB value according to the average color intensity is as follows: when a color component in the current comprehensive RGB value is greater than the average color intensity, the gain coefficient of the color channel is the reference value minus an amount related to the difference between the color component and the average color intensity, and the gain coefficients of the other two color channels are the reference value plus an amount related to the difference between the respective color components and the average color intensity, wherein the color components specifically include the R value, the G value and the B value.

Citation Information

Patent Citations

  • White balance regulation device and white balance regulation method

    CN105611265A

  • Light field source orientation method for augmented and virtual reality and front-end equipment

    CN106530406A

  • Positioning and interaction method for real image in virtual space

    CN110060354A

  • Retinex-based adaptive non-uniform low-illumination image enhancement method

    CN111223068A

  • Depth-based re-illumination in augmented reality

    CN115769268A

Cited By

  • Scene VR interaction method based on artificial intelligence

    CN120803280A