A virtual reality three-dimensional space data correction method and system

By acquiring and dividing 3D spatial anchor points in virtual reality technology, and collecting and adjusting feature points of real-world images, the accuracy problem of 3D spatial image overlay in virtual reality is solved, enabling efficient construction of virtual scenes and a realistic experience.

CN119251442BActive Publication Date: 2025-12-26XIUJIA TECH (BEIJING) CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411455513.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-10-17
Publication Date
2025-12-26
Estimated Expiration
2044-10-17

AI Technical Summary

Technical Problem

Existing technologies cannot fully, completely, and accurately reproduce the three-dimensional space of virtual reality, cannot accurately analyze the superposition state of real images and three-dimensional space, and cannot identify anomalies in the image superposition process, resulting in distortion of virtual scenes.

Method used

By acquiring basic 3D spatial information and camera lens information, dividing spatial basic anchor points, collecting real-world image information, obtaining real-world image feature points and spatial anchor points, predicting the position of image feature points based on boundary anchor point information, matching and adjusting abnormal positioning markers, and re-acquiring and overlaying real-world images.

Benefits of technology

It improves the efficiency of virtual scene construction, reduces positioning errors, enhances users' trust in the virtual environment and their sense of immersion, and provides a richer and more realistic experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119251442B_ABST
    Figure CN119251442B_ABST
Patent Text Reader

Abstract

The application discloses a kind of virtual reality three-dimensional space data correction method and system, it is related to virtual reality technical field, including obtaining basic three-dimensional space information and camera lens information, real image feature points and corresponding preset image feature points are matched, obtain normal positioning mark information and abnormal positioning mark information.The application is divided to basic space anchor point, improve the efficiency of virtual scene construction, the position of real image in three-dimensional space is predicted, it is convenient to evaluate the accuracy of image superposition, by comparing the actual position of real image in three-dimensional space with predicted position, whether real image meets virtual scene demand is judged, by adjusting abnormal image feature points, reduce positioning deviation, improve the degree of trust and immersion of user to virtual environment, provide more abundant and real experience for user.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the field of virtual reality, in particular to a three-dimensional space data correction method and system for virtual reality. BACKGROUND

[0002] Virtual reality technology is a computer simulation technology that can create and experience a virtual reality world. Based on virtual reality technology, in the manufacturing industry, medical field, entertainment field and other fields, visual, auditory, tactile and interaction with virtual objects can get more and more similar experience to the real scene, and thus complete many tasks that cannot be completed in the real scene. The implementation of virtual reality technology needs to be based on the construction of virtual scene, therefore, a perfect and comprehensive construction result of virtual scene is the basis to ensure the virtual reality experience, and the effect of virtual scene construction can also improve the authenticity of the tasks performed in the virtual scene.

[0003] At present, there are still problems that virtual reality cannot be fully, completely and highly restored to represent the real scene, cannot accurately analyze the three-dimensional space of virtual reality, cannot accurately evaluate the image superposition state of real image and three-dimensional space, cannot accurately identify the abnormal positioning in the image superposition process, is easy to cause distortion of virtual scene, and cannot correct the three-dimensional space according to the abnormal positioning. SUMMARY

[0004] In order to solve the above technical problems, a three-dimensional space data correction method and system for virtual reality are provided, which solve the problems that virtual reality cannot be fully, completely and highly restored to represent the real scene, cannot accurately analyze the three-dimensional space of virtual reality, cannot accurately evaluate the image superposition state of real image and three-dimensional space, cannot accurately identify the abnormal positioning in the image superposition process, is easy to cause distortion of virtual scene, and cannot correct the three-dimensional space according to the abnormal positioning.

[0005] In order to achieve the above purposes, the technical scheme adopted by the present application is as follows:

[0006] A three-dimensional space data correction method for virtual reality, comprising:

[0007] obtaining basic three-dimensional space information and camera lens information, the basic three-dimensional space information comprising space basic anchor points, and the camera lens information representing lens position information for taking a shot of a three-dimensional space to generate a virtual display image;

[0008] dividing the space basic anchor points to obtain space core anchor point information and space boundary anchor point information;

[0009] Collecting real image information, the real image information representing a real image used for image superimposition on a three-dimensional space to form a virtual scene;

[0010] According to the real image information, acquiring real image feature points and real image space anchor points;

[0011] Taking the real image feature points and the real image space anchor points as references, acquiring preset image feature points based on the space boundary anchor point information, the preset image feature points being predicted positions of each real image feature point in the three-dimensional space, and the preset image feature points corresponding to the real image feature points;

[0012] Matching the real image feature points and the corresponding preset image feature points, acquiring normal positioning identification information and abnormal positioning identification information;

[0013] According to the abnormal positioning identification information, judging whether the real image needs to be re-collected, if yes, re-collecting the real image based on the abnormal positioning identification position information, and if no, forming a virtual scene by image superimposition on the three-dimensional space according to the real image information.

[0014] Preferably, the space basic anchor points are divided to acquire space core anchor point information and space boundary anchor point information, and specifically include:

[0015] According to the camera lens information, acquiring lens movement track information;

[0016] Based on the lens movement track information, acquiring the nearest distance and the farthest distance between the space basic anchor points and the lens;

[0017] Taking the square difference between the farthest distance and the nearest distance between the space basic anchor points and the lens as a virtual image influence feature coefficient;

[0018] Taking the space basic anchor point with the smallest virtual image influence feature coefficient as a space core anchor point;

[0019] Based on a three-dimensional space coordinate system, analyzing the lens movement track to acquire movement track pole information, the movement track pole information being extreme point information of the lens movement track on the three-dimensional space coordinate axis;

[0020] Selecting the space basic anchor point closest to the movement track pole as a space boundary anchor point.

[0021] Preferably, the preset image feature points are acquired based on the space boundary anchor point information with the real image feature points and the real image space anchor points as references, and specifically include:

[0022] According to the real image information, acquiring real image space center information;

[0023] According to the spatial core anchor point and the spatial boundary anchor point, spatial vector information is obtained, the spatial vector information being a direction vector with the spatial core anchor point as a starting point and each spatial boundary anchor point as an ending point;

[0024] The real image space center is corresponded with the spatial core anchor point, and the spatial vector is proportionally enlarged based on the spatial vector until the spatial vector reaches the real image space boundary, so as to obtain real image space vector information;

[0025] The ending point of the real image space vector is taken as a real image space anchor point;

[0026] According to the positional relationship between the real image feature points and the real image space anchor points, a preset image feature point is obtained based on the spatial boundary anchor point, the preset image feature point being used to predict the spatial position of each real image feature point after the real image is superimposed on the three-dimensional space.

[0027] Preferably, the matching of the real image feature points and the corresponding preset image feature points to obtain the normal positioning identification information and the abnormal positioning identification information specifically comprises:

[0028] According to the real image feature points, two real image feature points are selected as image positioning feature points;

[0029] The preset image feature points corresponding to the image positioning feature points are taken as spatial positioning feature points;

[0030] According to the positional relationship between the real image feature points and the image positioning feature points, real image feature point position correlation information is obtained;

[0031] The image positioning feature points and the spatial positioning feature points are overlapped, the spatial positioning feature points are taken as reference points, and real image space position information is obtained according to the real image feature point position correlation information, the real image space position information indicating the specific position of the real image feature points in the three-dimensional space when the image is superimposed;

[0032] According to the real image space position information and the preset image feature points, image position difference information is obtained, the image position difference information being the distance between the real image space position information and the corresponding preset image feature point;

[0033] Based on virtual scene production requirements, an image position difference distance threshold value is obtained;

[0034] According to the image position difference information and the image position difference distance threshold value, it is determined whether the preset image feature point is abnormal, if the image position difference information exceeds the image position difference distance threshold value, the preset image feature point is a normal positioning identification, and if the image position difference information does not exceed the image position difference distance threshold value, the preset image feature point is an abnormal positioning identification.

[0035] Preferably, the judging whether the real image needs to be re-collected according to the abnormal positioning identification information specifically comprises:

[0036] According to the abnormal positioning identification information and the preset image feature points, an abnormal positioning coefficient is obtained, the abnormal positioning coefficient being a ratio of the number of abnormal positioning identifications to the total number of preset image feature points;

[0037] Based on the virtual scene production requirements, a positioning abnormal coefficient threshold is obtained;

[0038] According to the abnormal positioning coefficient, it is judged whether the real image needs to be re-collected;

[0039] If the abnormal positioning coefficient exceeds the abnormal positioning coefficient threshold, the real image needs to be re-collected, the real image collection position is adjusted based on the abnormal positioning identification position information, and the real image is re-collected;

[0040] If the abnormal positioning coefficient does not exceed the abnormal positioning coefficient threshold, the real image does not need to be re-collected, and the three-dimensional space is image superimposed to form a virtual scene according to the real image information.

[0041] Preferably, the real image information is used to image superimpose the three-dimensional space to form a virtual scene, which specifically comprises:

[0042] According to the abnormal positioning identification information, a real image correction feature point corresponding to the abnormal positioning identification is obtained;

[0043] The distance information of the correction feature point is obtained, the distance information of the correction feature point being the distance between the real image correction feature point and the real image feature point;

[0044] The correction feature point distance is sorted in descending order to obtain correction feature point distance sorting information;

[0045] Based on the correction feature point distance sorting information, the first two real image feature points are selected as the first correction influence feature point and the second correction influence feature point;

[0046] The image positioning feature point and the space positioning feature point are obtained;

[0047] According to the first correction influence feature point, the second correction influence feature point, the image positioning feature point, the space positioning feature point, the space core anchor point information and the space boundary anchor point information, a distance correction coefficient is obtained;

[0048] The preset image feature point positions corresponding to the first correction influence feature point, the second correction influence feature point and the real image correction feature point are adjusted by a distance correction coefficient;

[0049] The first correction influence feature point, the second correction influence feature point and the real image correction feature point are directly overlapped with the preset image feature points corresponding to the adjusted positions, image superposition is completed, and virtual scene information is obtained;

[0050] The calculation formula of the distance correction coefficient is:

[0051]

[0052] In the formula, Q is the distance correction coefficient, is a position influence coefficient of the first correction influence feature point on the second correction influence feature point, is a position influence coefficient of the second correction influence feature point on the real image correction feature point, S1 is a movement distance of the preset image feature point corresponding to the first correction influence feature point, S2 is a movement distance of the preset image feature point corresponding to the second correction influence feature point, S3 is a movement distance of the preset image feature point corresponding to the real image correction feature point, σ0 is a virtual image influence feature coefficient of a space core anchor point, σ i is a virtual image influence feature coefficient of the ith space boundary anchor point.

[0053] Further, a virtual reality three-dimensional space data correction system is provided for implementing the above-mentioned data correction method, comprising:

[0054] The main control module is used for judging whether the preset image feature points are abnormal according to the image position difference information and the image position difference distance threshold, judging whether the real image needs to be re-collected according to the positioning abnormality coefficient, adjusting the real image collection position based on the abnormal positioning identification position information and re-collecting the real image, and obtaining the distance correction coefficient according to the first correction influence feature point, the second correction influence feature point, the image positioning feature point, the space positioning feature point, the space core anchor point information and the space boundary anchor point information, directly overlapping the first correction influence feature point, the second correction influence feature point and the real image correction feature point with the preset image feature points corresponding to the adjusted positions, and completing image superposition.

[0055] The information acquisition module is used for acquiring basic three-dimensional space information, camera lens information and space basic anchor points, dividing the space basic anchor points, obtaining the space core anchor point information and the space boundary anchor point information, collecting real image information, and obtaining the real image feature points and the real image space anchor points according to the real image information.

[0056] An image preset module is configured to acquire preset image feature points based on the positional relationship between real image feature points and real image space anchor points, take space boundary anchor points as a reference, coincide image positioning feature points and space positioning feature points, take space positioning feature points as reference points, acquire real image space position information based on real image feature point position correlation information, and acquire image position difference information based on real image space position information and preset image feature points.

[0057] A display module is configured to display real image information, basic three-dimensional space information, and virtual scene information.

[0058] Optionally, the main control module specifically includes:

[0059] A control unit is configured to adjust a real image acquisition position based on abnormal positioning identification position information, reacquire a real image, acquire a distance correction coefficient based on first correction influence feature points, second correction influence feature points, image positioning feature points, space positioning feature points, space core anchor point information, and space boundary anchor point information, and complete image superposition by directly coinciding the first correction influence feature points, the second correction influence feature points, and real image correction feature points with corresponding preset image feature points after adjustment.

[0060] An information receiving unit is configured to receive data and transmit the data to a judgment unit.

[0061] The judgment unit is configured to judge whether preset image feature points are abnormal based on image position difference information and an image position difference distance threshold value, and judge whether real images need to be reacquired based on a positioning abnormality coefficient.

[0062] Optionally, the information acquisition module specifically includes:

[0063] A first acquisition unit is configured to acquire basic three-dimensional space information, camera lens information, and space basic anchor points, divide the space basic anchor points, and acquire space core anchor point information and space boundary anchor point information.

[0064] A second acquisition unit is configured to acquire real image information, and acquire real image feature points and real image space anchor points based on the real image information.

[0065] Optionally, the image preset module specifically includes:

[0066] A preset image unit is configured to acquire a preset image feature point based on a positional relationship between a real image feature point and a real image space anchor point, and based on a space boundary anchor point as a reference.

[0067] An image positioning evaluation unit is configured to superimpose an image positioning feature point and a space positioning feature point, to acquire real image space position information based on the real image feature point position association information and based on the space positioning feature point as a reference point, and to acquire image position difference information based on the real image space position information and the preset image feature point.

[0068] Compared with the prior art, the present application has the following beneficial effects:

[0069] The present application proposes a virtual reality three-dimensional space data correction method and system, which improves the virtual scene construction efficiency by dividing the basic space anchor points, predicts the position of the real image in the three-dimensional space, evaluates the accuracy of image superposition, compares the actual position of the real image in the three-dimensional space with the predicted position, judges whether the real image meets the virtual scene requirements, adjusts the abnormal image feature points, reduces the positioning deviation, improves the user's trust in the virtual environment and the sense of immersion, and provides a more rich and real experience for the user. BRIEF DESCRIPTION OF DRAWINGS

[0070] Figure 1 A virtual reality three-dimensional space data correction method flowchart is proposed in the present application.

[0071] Figure 2 A space core anchor point and a space boundary anchor point acquisition flowchart is proposed in the present application.

[0072] Figure 3 A preset image feature point acquisition flowchart is proposed in the present application.

[0073] Figure 4 A normal positioning identification information and an abnormal positioning identification information acquisition flowchart is proposed in the present application.

[0074] Figure 5 A virtual scene information acquisition flowchart is proposed in the present application.

[0075] Figure 6 A virtual reality three-dimensional space data correction system structure block diagram is proposed in the present application. DETAILED DESCRIPTION

[0076] The following description is used to disclose the present application so that those skilled in the art can implement the present application. The preferred embodiments in the following description are only as examples, and other obvious modifications can be made by those skilled in the art.

[0077] ReferenceFigure 1 Figure 5 The virtual reality three-dimensional space data correction method in the embodiment of the application shown in the figure includes:

[0078] Obtain basic three-dimensional space information and camera lens information, the basic three-dimensional space information includes space basic anchor points, and the camera lens information represents lens position information for taking a shot of a three-dimensional space to generate a virtual display image;

[0079] Divide the space basic anchor points to obtain space core anchor point information and space boundary anchor point information;

[0080] Specifically, the space basic anchor points are divided to obtain the space core anchor point information and the space boundary anchor point information, and the division specifically includes:

[0081] According to the camera lens information, obtain lens movement trajectory information;

[0082] Based on the lens movement trajectory information, obtain the nearest distance and the farthest distance between the space basic anchor points and the lens;

[0083] Take the square difference between the farthest distance and the nearest distance between the space basic anchor points and the lens as a virtual image influence characteristic coefficient;

[0084] Take the space basic anchor point with the minimum virtual image influence characteristic coefficient as a space core anchor point;

[0085] Based on a three-dimensional space coordinate system, analyze the lens movement trajectory to obtain movement trajectory extreme point information, and the movement trajectory extreme point information is extreme value point information of the lens movement trajectory on three-dimensional space coordinate axes;

[0086] Select the space basic anchor point closest to the movement trajectory extreme point as a space boundary anchor point.

[0087] In this scheme, the nearest distance and the farthest distance between the space basic anchor points and the lens are obtained through the lens movement trajectory information, the square difference between the farthest distance and the nearest distance between the space basic anchor points and the lens is taken as a virtual image influence characteristic coefficient, and the space basic anchor point closest to the movement trajectory extreme point is selected as a space boundary anchor point.

[0088] It can be understood that for the virtual reality three-dimensional space, the three-dimensional space is analyzed according to a space direction, the space boundary anchor points are selected through the boundaries of the three-dimensional space in different space directions, and accurate analysis of the three-dimensional space is realized, which is convenient for subsequent construction of a virtual scene.

[0089] Take the space basic anchor point with the minimum virtual image influence characteristic coefficient as a space core anchor point

[0090] ​Collect real image information, the real image information represents a real image used for image superposition on a three-dimensional space to form a virtual scene;

[0091] According to the real image information, obtain real image feature points and real image space anchor points;

[0092] In the present scheme, the real image feature points are at least six, and the real image feature points can be color blocks, pixel points, image contour points, markers, etc.

[0093] With the real image feature points and the real image space anchor points as the reference, based on the space boundary anchor point information, obtain preset image feature points, the preset image feature points are the predicted positions of each real image feature point in the three-dimensional space, and the preset image feature points correspond to the real image feature points;

[0094] Specifically, with the real image feature points and the real image space anchor points as the reference, based on the space boundary anchor point information, obtain preset image feature points, specifically including:

[0095] According to the real image information, obtain real image space center information;

[0096] According to the space core anchor point and the space boundary anchor point, obtain space vector information, the space vector information is a directional vector with the space core anchor point as the starting point and each space boundary anchor point as the terminal point;

[0097] Correspond the real image space center to the space core anchor point, scale the space vector based on the space vector until the space vector reaches the real image space boundary, and obtain real image space vector information;

[0098] Take the terminal point of the real image space vector as the real image space anchor point;

[0099] According to the positional relationship between the real image feature points and the real image space anchor points, take the space boundary anchor point as the reference, and obtain preset image feature points, the preset image feature points are used to predict the spatial positions of each real image feature point after the real image is superimposed on the three-dimensional space.

[0100] In the present scheme, through the space core anchor point and the space boundary anchor point, obtain space vector information, correspond the real image space center to the space core anchor point, scale the space vector based on the space vector until the space vector reaches the real image space boundary, and obtain real image space vector information, according to the positional relationship between the real image feature points and the real image space anchor points, take the space boundary anchor point as the reference, and obtain preset image feature points;

[0101] It can be understood that, in the construction of the virtual scene, the spatial relationship of the real image is directly related to the reality of the virtual scene. By coinciding the spatial center of the real image with the spatial core anchor point in the three-dimensional space, and taking the direction of the spatial core anchor point pointing to the spatial boundary anchor point as the reference, the real image spatial anchor point is selected in the real image space, which corresponds to the spatial boundary anchor point, and the positional relationship between the real image spatial anchor point and the real image spatial center is the same as that between the spatial boundary anchor point and the spatial core anchor point.

[0102] On this basis, the positional relationship between the real image feature point and the real image spatial anchor point is taken as the reference, and the preset image feature point with the same positional relationship with the spatial boundary anchor point is selected in the three-dimensional space, that is, the spatial position of each real image feature point after the real image is superimposed on the three-dimensional space is predicted.

[0103] The real image feature point and the corresponding preset image feature point are matched to obtain normal positioning identification information and abnormal positioning identification information.

[0104] Specifically, the real image feature point and the corresponding preset image feature point are matched to obtain normal positioning identification information and abnormal positioning identification information, specifically including:

[0105] According to the real image feature point, two real image feature points are selected as image positioning feature points;

[0106] The preset image feature point corresponding to the image positioning feature point is taken as a spatial positioning feature point;

[0107] According to the positional relationship between the real image feature point and the image positioning feature point, real image feature point positional association information is obtained.

[0108] The image positioning feature point and the spatial positioning feature point are coincided, the spatial positioning feature point is taken as the reference point, the real image spatial position information is obtained according to the real image feature point positional association information, and the real image spatial position information represents the specific position of the real image feature point in the three-dimensional space when the image is superimposed;

[0109] According to the real image spatial position information and the preset image feature point, image position difference information is obtained, and the image position difference information is the distance between the real image spatial position information and the corresponding preset image feature point.

[0110] Based on the virtual scene production requirement, an image position difference distance threshold is obtained.

[0111] According to the image position difference information and the image position difference distance threshold, it is judged whether the preset image feature point is abnormal. If the image position difference information exceeds the image position difference distance threshold, the preset image feature point is a normal positioning mark. If the image position difference information does not exceed the image position difference distance threshold, the preset image feature point is an abnormal positioning mark.

[0112] In the scheme, two real image feature points are selected as image positioning feature points. According to the positional relationship between the real image feature points and the image positioning feature points, real image feature point position association information, i.e. the mapping relationship of the real image in the three-dimensional space, is obtained. The image positioning feature points and the spatial positioning feature points are overlapped, and the spatial positioning feature points are taken as the reference points. According to the real image feature point position association information, the real image spatial position information is obtained. The specific position of the real image feature points in the three-dimensional space is analyzed. According to the image position difference information and the image position difference distance threshold, it is judged whether the preset image feature point is abnormal. The identification of the abnormal positioning mark is realized, which is convenient for the correction of the three-dimensional space. In the embodiment, the image position difference distance threshold is 0.05m.

[0113] According to the abnormal positioning mark information, it is judged whether the real image needs to be re-collected. If yes, the real image is re-collected based on the abnormal positioning mark position information. If no, the three-dimensional space is image superimposed to form a virtual scene according to the real image information.

[0114] Specifically, according to the abnormal positioning mark information, it is judged whether the real image needs to be re-collected. Specifically, it includes:

[0115] According to the abnormal positioning mark information and the preset image feature point, a positioning abnormality coefficient is obtained. The positioning abnormality coefficient is the ratio of the number of abnormal positioning marks to the total number of preset image feature points.

[0116] Based on the virtual scene production requirements, a positioning abnormality coefficient threshold is obtained.

[0117] According to the positioning abnormality coefficient, it is judged whether the real image needs to be re-collected.

[0118] If the positioning abnormality coefficient exceeds the positioning abnormality coefficient threshold, the real image needs to be re-collected. The real image collection position is adjusted based on the abnormal positioning mark position information, and the real image is re-collected.

[0119] If the positioning abnormality coefficient does not exceed the positioning abnormality coefficient threshold, the real image does not need to be re-collected. The three-dimensional space is image superimposed to form a virtual scene according to the real image information.

[0120] In the scheme, the positioning abnormality coefficient is obtained through the abnormal positioning identification information and the preset image feature point, and whether the real image needs to be re-collected is judged according to the positioning abnormality coefficient, so that the authenticity and stability of the virtual scene are ensured, and the positioning abnormality coefficient threshold is 0.2.

[0121] Specifically, according to the real image information, the three-dimensional space is image superimposed to form a virtual scene, specifically including:

[0122] According to the abnormal positioning identification information, the real image correction feature point corresponding to the abnormal positioning identification is obtained.

[0123] The correction feature point distance information is obtained, which is the distance between the real image correction feature point and the real image feature point.

[0124] The correction feature point distance is sorted in descending order to obtain the correction feature point distance sorting information.

[0125] Based on the correction feature point distance sorting information, the first two real image feature points are selected as the first correction influence feature point and the second correction influence feature point.

[0126] The image positioning feature point and the space positioning feature point are obtained.

[0127] The distance correction coefficient is obtained according to the first correction influence feature point, the second correction influence feature point, the image positioning feature point, the space positioning feature point, the space core anchor point information and the space boundary anchor point information.

[0128] The position of the preset image feature point corresponding to the first correction influence feature point, the second correction influence feature point and the real image correction feature point is adjusted through the distance correction coefficient.

[0129] The first correction influence feature point, the second correction influence feature point and the real image correction feature point are directly overlapped with the preset image feature point corresponding to the adjusted position to complete image superposition, and the virtual scene information is obtained.

[0130] The calculation formula of the distance correction coefficient is:

[0131]

[0132] In the formula, Q is the distance correction coefficient, The position influence coefficient of the first correction influence feature point on the second correction influence feature point is A, that is, if the preset image feature point corresponding to the first correction influence feature point is moved by A, and the preset image feature point corresponding to the second correction influence feature point is moved by B, then The position influence coefficient of the second correction influence feature point on the real image correction feature point is S1, the moving distance of the preset image feature point corresponding to the first correction influence feature point is S2, the moving distance of the preset image feature point corresponding to the second correction influence feature point is S3, the moving distance of the preset image feature point corresponding to the real image correction feature point is σ0, the virtual image influence feature coefficient of the space core anchor point is σ i The virtual image influence feature coefficient of the i-th space boundary anchor point is σi.

[0133] In the scheme, the values of S1, S2 and S3 are adjusted until Q·H≤0.05m and The minimum value is S1≤0.02 and S2≤0.03. By adjusting the abnormal image feature points, the data correction of the three-dimensional space is realized, the positioning deviation is reduced, the trust degree and the immersion of the user to the virtual environment are improved, and a more rich and real experience is provided for the user.

[0134] It should be noted that in the embodiment, the real image feature points remaining after the first correction influence feature points, the second correction influence feature points and the real image correction feature points are removed, the image positioning feature points and the space positioning feature points are overlapped, the space positioning feature points are taken as the reference points, and the image superposition is performed according to the positional relationship between the real image feature points and the image positioning feature points.

[0135] Referring to Figure 6 Further, in combination with the above-mentioned virtual reality three-dimensional space data correction method, a virtual reality three-dimensional space data correction system is provided, which comprises:

[0136] A main control module is configured to judge whether the preset image feature points are abnormal according to the image position difference information and the image position difference distance threshold, judge whether the real image needs to be re-collected according to the positioning abnormality coefficient, adjust the real image collection position based on the abnormal positioning identification position information, re-collect the real image, obtain the distance correction coefficient according to the first correction influence feature point, the second correction influence feature point, the image positioning feature point, the space positioning feature point, the space core anchor point information and the space boundary anchor point information, and directly overlap the first correction influence feature point, the second correction influence feature point and the real image correction feature point with the corresponding preset image feature points after adjustment to complete the image superposition.

[0137] An information acquisition module is configured to acquire the basic three-dimensional space information, the camera lens information and the space basic anchor point, divide the space basic anchor point, acquire the space core anchor point information and the space boundary anchor point information, collect the real image information, and acquire the real image feature point and the real image space anchor point according to the real image information.

[0138] an image preset module, which is configured to acquire preset image feature points based on the positional relationship between real image feature points and real image space anchor points, take the space boundary anchor points as a reference, coincide image positioning feature points and space positioning feature points, take the space positioning feature points as reference points, acquire real image space position information based on real image feature point position correlation information, and acquire image position difference information based on the real image space position information and the preset image feature points;

[0139] a display module, which interacts with the main control module and is configured to display real image information, basic three-dimensional space information, and virtual scene information.

[0140] a main control module, specifically comprising:

[0141] a control unit, which is configured to adjust the real image acquisition position based on the abnormal positioning identification position information, reacquire the real image, acquire a distance correction coefficient based on the first correction influence feature points, the second correction influence feature points, the image positioning feature points, the space positioning feature points, the space core anchor point information, and the space boundary anchor point information, and directly coincide the first correction influence feature points, the second correction influence feature points, and the real image correction feature points with the corresponding preset image feature points after adjustment to complete image superposition.

[0142] an information receiving unit, which interacts with the information acquisition module and the image preset module and is configured to receive data and transmit the data to a judgment unit;

[0143] a judgment unit, which is configured to judge whether the preset image feature points are abnormal based on the image position difference information and an image position difference distance threshold value, and judge whether the real image needs to be reacquired based on the positioning abnormality coefficient.

[0144] an information acquisition module, specifically comprising:

[0145] a first acquisition unit, which is configured to acquire basic three-dimensional space information, camera lens information, and space basic anchor points, divide the space basic anchor points, and acquire space core anchor point information and space boundary anchor point information;

[0146] a second acquisition unit, which is configured to acquire real image information, and acquire real image feature points and real image space anchor points based on the real image information.

[0147] an image preset module, specifically comprising:

[0148] a preset image unit, which is configured to acquire preset image feature points based on the positional relationship between real image feature points and real image space anchor points, take the space boundary anchor points as a reference.

[0149] The image positioning evaluation unit is used for superimposing the image positioning feature points and the space positioning feature points, taking the space positioning feature points as the reference points, obtaining the real image space position information according to the real image feature point position correlation information, and obtaining the image position difference information according to the real image space position information and the preset image feature points.

[0150] In summary, the application has the advantages that: by setting the basic space anchor point in the virtual reality, the virtual scene can be analyzed conveniently, by dividing the basic space anchor point, the virtual scene construction efficiency is improved, by analyzing the real image, the real image feature points are obtained, by comparing the real image space and the three-dimensional space, the position of the real image in the three-dimensional space is predicted, the accuracy of image superposition can be evaluated conveniently, by comparing the actual position of the real image in the three-dimensional space with the predicted position, whether the real image meets the virtual scene demand is judged, by adjusting the abnormal image feature points, the data of the three-dimensional space is corrected, the positioning deviation is reduced, the trust degree and the immersion of the user to the virtual environment are improved, and the user is provided with more rich and real experience.

[0151] The basic principle, main features and advantages of the application are shown and described above. It should be understood by those skilled in the art that the application is not limited by the above examples, and the above examples and descriptions in the specification are only the principles of the application. Without departing from the spirit and scope of the application, various changes and improvements can be made to the application, and these changes and improvements all fall within the scope of the claimed application. The scope of protection claimed by the application is defined by the appended claims and their equivalents.

Claims

1. A method of correcting three-dimensional space data of virtual reality, characterized by, The method comprises the following steps: acquiring basic three-dimensional space information and camera lens information, the basic three-dimensional space information comprising space basic anchor points, and the camera lens information representing lens position information for taking a shot of a three-dimensional space to generate a virtual display image; dividing the space basic anchor points to acquire space core anchor point information and space boundary anchor point information; collecting real image information, the real image information representing a real image used for image superimposition on a three-dimensional space to form a virtual scene; acquiring real image feature points and real image space anchor points according to the real image information; taking the real image feature points and the real image space anchor points as a reference, acquiring preset image feature points based on the space boundary anchor point information, the preset image feature points being predicted positions of each real image feature point in the three-dimensional space, and the preset image feature points corresponding to the real image feature points; matching the real image feature points and the corresponding preset image feature points to acquire normal positioning identification information and abnormal positioning identification information; judging whether the real image needs to be re-collected according to the abnormal positioning identification information, if yes, re-collecting the real image based on the abnormal positioning identification position information, and if no, forming a virtual scene by image superimposition on the three-dimensional space according to the real image information; the step of dividing the space basic anchor points to acquire the space core anchor point information and the space boundary anchor point information specifically comprises: acquiring lens movement track information according to the camera lens information; acquiring the nearest distance and the farthest distance between the space basic anchor points and the lens based on the lens movement track information; taking the square difference between the farthest distance and the nearest distance between the space basic anchor points and the lens as a virtual image influence feature coefficient; taking the space basic anchor point with the smallest virtual image influence feature coefficient as a space core anchor point; analyzing the lens movement track based on a three-dimensional space coordinate system to acquire movement track pole information, the movement track pole information being extreme point information of the lens movement track on three-dimensional space coordinate axes; selecting the space basic anchor point closest to the movement track pole as a space boundary anchor point; the step of taking the real image feature points and the real image space anchor points as a reference, acquiring preset image feature points based on the space boundary anchor point information specifically comprises: acquiring real image space center information according to the real image information; acquiring space vector information according to the space core anchor point and the space boundary anchor point, the space vector information being a directional vector with the space core anchor point as a starting point and each space boundary anchor point as a terminal point; corresponding the real image space center to the space core anchor point, and proportionally enlarging the space vector as a reference until the space vector reaches a real image space boundary to acquire real image space vector information; taking the terminal point of the real image space vector as a real image space anchor point; acquiring preset image feature points according to the positional relationship between the real image feature points and the real image space anchor points and taking the space boundary anchor point as a reference, the preset image feature points being used for predicting the spatial positions of each real image feature point after real image superimposition on a three-dimensional space.

2. The method of claim 1, wherein, The matching of the real image feature points and the corresponding preset image feature points, the acquisition of the normal positioning mark information and the abnormal positioning mark information, specifically comprises: According to the real image feature points, two real image feature points are selected as image positioning feature points; The preset image feature points corresponding to the image positioning feature points are taken as spatial positioning feature points; According to the positional relationship between the real image feature points and the image positioning feature points, real image feature point position correlation information is acquired; The image positioning feature points and the spatial positioning feature points are overlapped, and the spatial positioning feature points are taken as reference points. According to the real image feature point position correlation information, real image spatial position information is acquired, which represents the specific position of the real image feature points in the three-dimensional space when the images are superimposed; According to the real image spatial position information and the preset image feature points, image position difference information is acquired, which is the distance between the real image spatial position information and the corresponding preset image feature points; Based on virtual scene production requirements, an image position difference distance threshold value is acquired; According to the image position difference information and the image position difference distance threshold value, it is determined whether the preset image feature points are abnormal. If the image position difference information exceeds the image position difference distance threshold value, the preset image feature points are normal positioning marks. If the image position difference information does not exceed the image position difference distance threshold value, the preset image feature points are abnormal positioning marks.

3. The method of claim 1, wherein, According to the abnormal positioning mark information, it is determined whether the real image needs to be re-collected, specifically comprising: According to the abnormal positioning mark information and the preset image feature points, a positioning abnormality coefficient is acquired, which is the ratio of the number of abnormal positioning marks to the total number of preset image feature points; Based on virtual scene production requirements, a positioning abnormality coefficient threshold value is acquired; According to the positioning abnormality coefficient, it is determined whether the real image needs to be re-collected; If the positioning abnormality coefficient exceeds the positioning abnormality coefficient threshold value, the real image needs to be re-collected. Based on the abnormal positioning mark position information, the real image collection position is adjusted, and the real image is re-collected. If the positioning abnormality coefficient does not exceed the positioning abnormality coefficient threshold value, the real image does not need to be re-collected. According to the real image information, the three-dimensional space is image superimposed to form a virtual scene.

4. The method of claim 1, wherein, According to the real image information, the three-dimensional space is image superimposed to form a virtual scene, specifically comprising: According to the abnormal positioning mark information, real image correction feature points corresponding to the abnormal positioning marks are acquired; Correction feature point distance information is acquired, which is the distance between the real image correction feature points and the real image feature points; The correction feature point distances are sorted in descending order to acquire correction feature point distance sorting information; Based on the correction feature point distance sorting information, the first two real image feature points are selected as the first correction influence feature point and the second correction influence feature point, respectively; Image positioning feature points and spatial positioning feature points are acquired; According to the first correction influence feature point, the second correction influence feature point, the image positioning feature point, the space positioning feature point, the space core anchor point information and the space boundary anchor point information, a distance correction coefficient is obtained; The preset image feature point positions corresponding to the first correction influence feature point, the second correction influence feature point and the real image correction feature point are adjusted through the distance correction coefficient; The first correction influence feature point, the second correction influence feature point and the real image correction feature point are directly overlapped with the adjusted corresponding preset image feature points to complete image superposition and obtain virtual scene information; The calculation formula of the distance correction coefficient is: wherein, is a distance correction coefficient, is a position influence coefficient of the first correction-influencing feature point on the second correction-influencing feature point, is a position influence coefficient of the second correction-influencing feature point on the real image correction feature point, is a movement distance of the preset image feature point corresponding to the first correction-influencing feature point, is a movement distance of the preset image feature point corresponding to the second correction-influencing feature point, is a movement distance of the preset image feature point corresponding to the real image correction feature point, is a virtual image influence feature coefficient of the spatial core anchor point, is a virtual image influence feature coefficient of the i-th spatial boundary anchor point.

5. A virtual reality three-dimensional space data correction system for implementing the data correction method according to any one of claims 1 to 4, characterized by, It includes: The main control module is used for judging whether the preset image feature point is abnormal according to the image position difference information and the image position difference distance threshold, judging whether the real image needs to be re-collected according to the positioning abnormality coefficient, adjusting the real image collection position based on the abnormal positioning mark position information, re-collecting the real image, obtaining the distance correction coefficient according to the first correction influence feature point, the second correction influence feature point, the image positioning feature point, the space positioning feature point, the space core anchor point information and the space boundary anchor point information, and directly overlapping the first correction influence feature point, the second correction influence feature point and the real image correction feature point with the adjusted corresponding preset image feature points to complete image superposition; The information acquisition module is used for acquiring basic three-dimensional space information, camera lens information and space basic anchor points, dividing the space basic anchor points, obtaining space core anchor point information and space boundary anchor point information, collecting real image information, and obtaining real image feature points and real image space anchor points according to the real image information; The image preset module is used for obtaining preset image feature points based on the positional relationship between the real image feature points and the real image space anchor points, taking the space boundary anchor point as the reference, overlapping the image positioning feature point and the space positioning feature point, taking the space positioning feature point as the reference point, obtaining real image space position information according to the real image feature point position correlation information, and obtaining image position difference information according to the real image space position information and the preset image feature points; The display module interacts with the main control module and is used for displaying real image information, basic three-dimensional space information and virtual scene information.

6. The virtual reality three-dimensional space data correction system of claim 5, wherein The main control module specifically includes: The control unit is used for adjusting the real image collection position based on the abnormal positioning mark position information, re-collecting the real image, obtaining the distance correction coefficient according to the first correction influence feature point, the second correction influence feature point, the image positioning feature point, the space positioning feature point, the space core anchor point information and the space boundary anchor point information, directly overlapping the first correction influence feature point, the second correction influence feature point and the real image correction feature point with the adjusted corresponding preset image feature points to complete image superposition; The information receiving unit interacts with the information acquisition module and the image preset module, and is used for receiving data and transmitting to the judgment unit; The judging unit is configured to judge whether the preset image feature point is abnormal according to the image position difference information and an image position difference distance threshold value, and judge whether the real image needs to be re-collected according to the positioning abnormality coefficient.

7. The virtual reality three-dimensional space data correction system of claim 5, wherein The information acquisition module specifically comprises: The first acquisition unit is configured to acquire basic three-dimensional space information, camera lens information and a space basic anchor point, divide the space basic anchor point, acquire space core anchor point information and space boundary anchor point information; The second acquisition unit is configured to acquire real image information, and acquire real image feature points and real image space anchor points according to the real image information.

8. The virtual reality three-dimensional space data correction system of claim 5, wherein The image preset module specifically comprises: The preset image unit is configured to acquire preset image feature points according to the positional relationship between the real image feature points and the real image space anchor points, and take the space boundary anchor point as a reference; The image positioning evaluation unit is configured to superimpose the image positioning feature points and the space positioning feature points, take the space positioning feature points as reference points, acquire real image space position information according to real image feature point position correlation information, and acquire image position difference information according to the real image space position information and the preset image feature points.

Citation Information

Patent Citations

  • Virtual scene display method and device, terminal and storage medium

    CN111672104A

  • Virtual reality three-dimensional space data correction method

    CN116152469A