Video generation and virtual reality fusion adjustment system

Abstract

The invention, which relates to the technical field of virtual reality fusion, discloses a video generation and virtual reality fusion adjustment system comprising an information acquisition module, a video generation module, a component splitting module, a virtual fusion module, a fusion verification module, a gap analysis module and an adjustment scheme generation module. The system has the advantages that the composition structure of a video can be deeply analyzed through the gap analysis module, the authenticity of virtual fusion is improved, whether fusion of a finished product virtual model and video information is natural or not and whether the problems of position deviation, proportion imbalance and the like exist or not can be accurately judged through the fusion verification module, the comprehensiveness and randomness of verification are guaranteed, and the verification efficiency is improved. Therefore, the situation that the local part is normal but the whole is not coordinated is prevented from being omitted, the difference analysis module is beneficial to further optimization of the fusion effect, the virtual building is more truly fused into the actual environment video, the system can continuously improve the fusion strategy, and the fusion precision and fidelity are improved.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality fusion technology, in particular to a video generation and virtual reality fusion adjustment system. Background Art

[0002] Virtual reality is the combination of virtuality and reality. In theory, virtual reality technology is a computer simulation system that can create and experience a virtual world. It uses computers to generate simulated environments and immerse users in them. Virtual reality technology combines real-life data with electronic signals generated by computer technology and various output devices to transform them into phenomena that people can perceive. When using the common virtual reality fusion adjustment system, it is impossible to fully understand the specific composition details of the video. When checking the fused virtual reality model, it is difficult to ensure the comprehensiveness of the verification, which leads to poor overall fusion effect. In addition, the system cannot make targeted adjustments and optimizations based on the specific circumstances of the video and virtual model. For this reason, we propose a video generation and virtual reality fusion adjustment system. Summary of the invention

[0003] The purpose of the present invention is to provide a video generation and virtual reality fusion adjustment system.

[0004] In order to solve the problems raised in the above background technology, the present invention provides the following technical solutions: a video generation and virtual reality fusion adjustment system, comprising an information acquisition module, the information acquisition module can collect virtual information and object information, and also comprises a video generation module, a component separation module, a virtual fusion module, a fusion verification module and a gap analysis module; The video generation module collects video information and converts the video information into video content information according to the needs of the user and the virtual information; A component splitting module extracts video content information, analyzes component information of the video content information, splits the video content information, and obtains sub-content information; A virtual fusion module generates a virtual reality model based on virtual information, and uses computer vision technology to fuse sub-content information with objects in the virtual reality model to generate a finished virtual model; A fusion verification module extracts a finished virtual model, randomly intercepts n virtual model information, where n is an unknown number, obtains virtual intercept information, extracts component information in the virtual intercept information, obtains virtual component information, and extracts component information in the corresponding video content information, constructs two sets of rectangular coordinate systems, inserts the virtual component information and the component information in the video content information into the rectangular coordinate system respectively, places the same corner of the component information in the virtual component information and the video content information at the origin, generates a virtual coordinate system and a component coordinate system, enlarges the virtual coordinate system and the component coordinate system, draws along the outer edges of the component information in the virtual component information and the video content information according to the set spacing, generates two sets of outer edge frame line information, determines whether the two sets of outer edge frame line information are the same, and verifies the fusion effect of the finished virtual model; The gap analysis module extracts the coordinate system of different spacing points, generates virtual component spacing coordinates and constituent component spacing coordinates, and calculates the gap between the virtual component spacing coordinates and the constituent component spacing coordinates.

[0005] As a further solution of the present invention: it also includes an adjustment scheme generating module; The adjustment scheme generation module analyzes the adjustment spacing of the virtual component spacing coordinates according to the virtual component spacing coordinates and the component spacing coordinates, analyzes the method of adjusting the finished virtual model, generates an adjustment scheme, transmits the adjustment scheme to the virtual fusion module, and adjusts the finished virtual model.

[0006] As a further solution of the present invention: after analyzing the component information of the video content information, the component splitting module determines the arrangement order of the component information, reverses the arrangement order, generates external splitting order information, and uses the external splitting order information to split the video content information.

[0007] As a further solution of the present invention: when randomly intercepting n virtual model information, the fusion verification module will analyze the time of the virtual model information, divide the time of the virtual model information into n areas evenly, and randomly intercept a virtual model information in different areas, thereby obtaining n virtual model information.

[0008] As a further solution of the present invention: when the fusion verification module determines whether two sets of outer edge frame line information are the same, it collects the lengths of the four border lines on the two sets of outer edge frame line information, obtains the virtual border length information and the component border length information, and calculates the ratio of the virtual border length information and the component border length information.

[0009] As a further solution of the present invention: when the fusion verification module calculates the ratio of the virtual border length information to the component border length information, it simultaneously determines whether the ratio of the virtual border length information to the component border length information is the same; When the ratios are the same, the two sets of outer edge frame information are judged to be similar; When the ratios are different, it is determined that the two sets of outer edge frame line information are not similar, and the gap analysis module is used to calculate the gap between the two sets of outer edge frame line information; Determine the relationship between all virtual interception information and component information according to the above method; When there are two or more virtual interception information that are not similar to the component information, it is determined whether the two virtual interception information are adjacent; When the positions of two virtual intercepted information are in an adjacent state, the times corresponding to the two virtual intercepted information are extracted, the middle time between the two times is analyzed, the virtual model information corresponding to the middle time is intercepted, a layer of intercepted information is obtained, and whether the first layer of intercepted information is similar to the component information is analyzed; When the first interception information is similar to the component information, the virtual model information between the first time and the time of the first interception information is marked, and the virtual model information within the time period is optimized; When the first-layer interception information is not similar to the component information, the virtual model information between the two time periods will be marked, and the virtual model information within the time period will be optimized; When the positions of two virtual intercepted information are not adjacent, the time interval between the two virtual intercepted information is analyzed, and the virtual model information of half the time interval before and after is intercepted with the time point of the dissimilar virtual intercepted information as the center, and the virtual model information is optimized; When there is only one virtual interception information that is not similar to the component information, the virtual model information of half the time interval before and after the time point of the dissimilar virtual interception information will be intercepted and optimized.

[0010] As a further solution of the present invention: when the gap analysis module calculates the gap between the virtual component spacing coordinate and the component spacing coordinate, the virtual component spacing coordinate is set to , let the component spacing coordinates be , let the gap index be , let the number of spacing coordinates be K;

[0011] The gap index can be calculated according to the above formula.

[0012] As a further solution of the present invention: after calculating the gap index, the gap analysis module sets an adjustment plan generation threshold, analyzes whether the gap index is less than the adjustment plan generation threshold, and sets the adjustment plan generation threshold as ; when The generation signal will not be transmitted to the adjustment plan generation module, and the gap index will not be displayed; when When the adjustment scheme generation module is activated, a generation signal is transmitted to the adjustment scheme generation module.

[0013] As a further solution of the present invention, when analyzing the adjustment spacing of the virtual component spacing coordinates, the adjustment scheme generation module will re-extract the virtual component spacing coordinate information and the component spacing coordinate information, and convert them into virtual coordinate values ​​and component coordinate values, and set the total virtual coordinate values ​​to , , ,……, , assuming that the coordinate values ​​of all components are , , ,……, , the adjustment spacing of the virtual component spacing coordinates is ; , , ,……, The adjustment interval of the virtual component interval coordinates can be calculated according to the above formula.

[0014] By adopting the above technical solution, compared with the prior art, the beneficial effects of the present invention are: 1. The present invention can deeply analyze the composition structure of the video through the gap analysis module, improve the authenticity of virtual fusion, and accurately judge whether the fusion of the finished virtual model and the video information is natural, whether there are problems such as position deviation and disproportion, and ensure the comprehensiveness and randomness of the verification, thereby avoiding the omission of the situation where the local part is normal but the whole is not coordinated. The gap analysis module helps to further optimize the fusion effect, so that the virtual building can be more realistically integrated into the actual environment video, so that the system can continuously improve the fusion strategy and improve the accuracy and fidelity of the fusion; 2. The present invention can more easily identify and separate various components from the whole to the part through the component splitting module, thereby improving the efficiency of splitting. The fusion verification module can ensure that the intercepted virtual model information is representative and random in the time dimension, thus avoiding the problem of inaccurate evaluation of the overall fusion effect caused by only intercepting a specific time period. It helps to more comprehensively obtain the fusion status of the virtual model at different time stages, and can more accurately locate the time period where the fusion problem is located, thereby avoiding unnecessary large-scale adjustments to the entire virtual model. 3. The present invention can comprehensively consider the relationship between the coordinate differences in two dimensions through the gap analysis module, and can quantify the gap between the two more comprehensively and accurately, which helps to avoid overly frequent or unnecessary adjustments and ensure that the system strikes a balance between stability and optimization requirements. Through the adjustment plan generation module, the direction and degree of difference between the two coordinate systems can be accurately analyzed, providing key data for formulating accurate adjustment plans. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 Schematic diagram of the system flow in an embodiment of the present invention. DETAILED DESCRIPTION

[0016] The specific embodiments of the present invention will be further described below in conjunction with the accompanying drawings. It should be noted that the description of these embodiments is used to help understand the present invention, but does not constitute a limitation of the present invention.

[0017] In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0018] Embodiment 1: Therefore, in order to effectively solve the above problems, the present application proposes a video generation and virtual reality fusion adjustment system, as shown in the accompanying drawings of the specification. Figure 1 As shown, it includes an information acquisition module, which can collect virtual information and item information, and also includes a video generation module, a component separation module, a virtual fusion module, a fusion verification module and a gap analysis module; The video generation module collects video information and converts the video information into video content information according to the needs of the user and the virtual information; A component splitting module extracts video content information, analyzes component information of the video content information, splits the video content information, and obtains sub-content information; A virtual fusion module generates a virtual reality model based on virtual information, and uses computer vision technology to fuse sub-content information with objects in the virtual reality model to generate a finished virtual model; A fusion verification module extracts a finished virtual model, randomly intercepts n virtual model information, where n is an unknown number, obtains virtual intercept information, extracts component information in the virtual intercept information, obtains virtual component information, and extracts component information in the corresponding video content information, constructs two sets of rectangular coordinate systems, inserts the virtual component information and the component information in the video content information into the rectangular coordinate system respectively, places the same corner of the component information in the virtual component information and the video content information at the origin, generates a virtual coordinate system and a component coordinate system, enlarges the virtual coordinate system and the component coordinate system, draws along the outer edges of the component information in the virtual component information and the video content information according to the set spacing, generates two sets of outer edge frame line information, determines whether the two sets of outer edge frame line information are the same, and verifies the fusion effect of the finished virtual model; A gap analysis module extracts coordinate systems of different spacing points, generates virtual component spacing coordinates and component spacing coordinates, and calculates the gap between the virtual component spacing coordinates and the component spacing coordinates; It also includes an adjustment plan generation module; An adjustment scheme generating module analyzes the adjustment interval of the virtual component interval coordinates according to the virtual component interval coordinates and the component interval coordinates, analyzes the method of adjusting the finished virtual model, generates an adjustment scheme, transmits the adjustment scheme to the virtual fusion module, and adjusts the finished virtual model; Specific workflow: Collect virtual information and object information, convert video information into video content information, split video content information, merge sub-content information with objects in the virtual reality model, intercept virtual model information, extract component information from the corresponding video content information, construct two sets of rectangular coordinate systems, draw two sets of outer edge frame line information, determine whether the two sets of outer edge frame line information are the same, calculate the difference between virtual component spacing coordinates and component spacing coordinates, and analyze the method of adjusting the finished virtual model; Furthermore, the gap analysis module can deeply analyze the composition structure of the video and improve the authenticity of virtual fusion. The fusion verification module can accurately judge the natural degree of fusion between the finished virtual model and the video information, ensuring the comprehensiveness and randomness of the verification, thereby avoiding the omission of situations where the local part is normal but the whole is not coordinated. The gap analysis module helps to further optimize the fusion effect, make the virtual building more realistically integrated into the actual environment video, and improve the accuracy and realism of the fusion.

[0019] Embodiment 2: Based on the first embodiment, as shown in the accompanying drawings of the specification Figure 1 As shown, after analyzing the component information of the video content information, the component splitting module determines the arrangement order of the component information, reverses the arrangement order, generates external splitting order information, and uses the external splitting order information to split the video content information; By rearranging and combining the components obtained by the disassembly according to different rules or creative ideas, a component change trajectory diagram can be generated based on the disassembly sequence information. The diagram can intuitively show the order of each component in the original video and the change path after disassembly and possible re-combination; When the fusion verification module randomly intercepts n virtual model information, it analyzes the time of the virtual model information, divides the time of the virtual model information into n areas evenly, and randomly intercepts one virtual model information in different areas, thereby obtaining n virtual model information; When determining whether two sets of outer edge frame line information are the same, the fusion verification module collects the lengths of four frame lines on the two sets of outer edge frame line information, obtains virtual frame length information and component frame length information, and calculates the ratio of the virtual frame length information to the component frame length information; When the fusion verification module calculates the ratio of the virtual border length information to the component border length information, it simultaneously determines whether the ratio of the virtual border length information to the component border length information is the same; When the ratios are the same, the two sets of outer edge frame information are judged to be similar; When the ratios are different, it is determined that the two sets of outer edge frame line information are not similar, and the gap analysis module is used to calculate the gap between the two sets of outer edge frame line information; Determine the relationship between all virtual interception information and component information according to the above method; When there are two or more virtual interception information that are not similar to the component information, it is determined whether the two virtual interception information are adjacent; When the positions of two virtual intercepted information are in an adjacent state, the times corresponding to the two virtual intercepted information are extracted, the middle time between the two times is analyzed, the virtual model information corresponding to the middle time is intercepted, a layer of intercepted information is obtained, and whether the first layer of intercepted information is similar to the component information is analyzed; When the first interception information is similar to the component information, the virtual model information between the first time and the time of the first interception information is marked, and the virtual model information within the time period is optimized; When the first-layer interception information is not similar to the component information, the virtual model information between the two time periods will be marked, and the virtual model information within the time period will be optimized; When the positions of two virtual intercepted information are not adjacent, the time interval between the two virtual intercepted information is analyzed, and the virtual model information of half the time interval before and after is intercepted with the time point of the dissimilar virtual intercepted information as the center, and the virtual model information is optimized; When there is only one virtual intercept information that is not similar to the component information, the virtual model information of half the time interval before and after the time point of the dissimilar virtual intercept information is intercepted and optimized; Specific workflow: determine the arrangement order of component information, reverse the arrangement order, use the external disassembly order information to split the video content information, analyze the time of virtual model information, divide the time of virtual model information into n areas evenly, randomly intercept a virtual model information in different areas, collect the lengths of four border lines on two groups of outer edge frame line information, determine whether the ratio of virtual border length information and component border length information is the same, and analyze the relationship between all virtual interception information and component information; Furthermore, through the component splitting module, it is easier to identify and separate each component from the whole to the part, thereby improving the efficiency of splitting. The fusion verification module can ensure that the intercepted virtual model information is representative and random in the time dimension, avoiding the problem of inaccurate evaluation of the overall fusion effect due to only intercepting a specific time period. It helps to obtain a more comprehensive understanding of the fusion status of the virtual model at different time stages, and at the same time can more accurately locate the time period where the fusion problem occurs, thereby avoiding unnecessary large-scale adjustments to the entire virtual model.

[0020] Embodiment three: Based on the second embodiment, as shown in the accompanying drawings of the specification Figure 1 As shown, when the gap analysis module calculates the gap between the virtual component spacing coordinate and the component spacing coordinate, the virtual component spacing coordinate is set to , let the component spacing coordinates be , let the gap index be , let the number of spacing coordinates be K;

[0021] According to the above formula, the gap index can be calculated; After calculating the gap index, the gap analysis module sets the adjustment plan generation threshold to analyze whether the gap index is less than the adjustment plan generation threshold. ; when The generation signal will not be transmitted to the adjustment plan generation module, and the gap index will not be displayed; when When the adjustment scheme generation module is activated, a generation signal is transmitted to the adjustment scheme generation module; We can first perform cluster analysis on the coordinate points, divide them into several regions, calculate the average gap in each region, assign different weights according to the importance of the region, and finally obtain the gap index; When analyzing the adjustment spacing of the virtual component spacing coordinates, the adjustment scheme generation module will re-extract the virtual component spacing coordinate information and the component spacing coordinate information, and convert them into virtual coordinate values ​​and component coordinate values. Set the total virtual coordinate value to , , ,……, , assuming that the coordinate values ​​of all components are , , ,……, , the adjustment spacing of the virtual component spacing coordinates is ; , , ,……, According to the above formula, the adjustment spacing of the virtual component spacing coordinates can be calculated; Specific workflow: calculate the gap index, set the threshold for generating an adjustment plan, and analyze whether the gap index is less than the threshold for generating an adjustment plan. The generated signal will not be transmitted to the adjustment plan generation module, and the gap index will be displayed. When the virtual component spacing coordinate information and the component spacing coordinate information are extracted, the virtual component spacing coordinate information and the component spacing coordinate information are converted into virtual coordinate values ​​and component coordinate values, and the adjustment spacing of the virtual component spacing coordinates is calculated using the virtual coordinate values ​​and the component coordinate values; Furthermore, through the gap analysis module, the relationship between the coordinate differences in two dimensions can be comprehensively considered, and the gap between the two can be quantified more comprehensively and accurately, which helps to avoid overly frequent or unnecessary adjustments and ensure that the system strikes a balance between stability and optimization requirements. Through the adjustment plan generation module, the direction and degree of difference between the two coordinate systems can be accurately analyzed, providing key data for formulating accurate adjustment plans.

[0022] The above shows and describes the basic principles, main features and advantages of the present invention. It should be understood by those skilled in the art that the present invention is not limited to the above embodiments. The above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention. The scope of protection of the present invention is defined by the attached claims and their equivalents.

Claims

1. A video generation and virtual reality fusion adjustment system, comprising an information collection module, wherein the information collection module can collect virtual information and object information, and is characterized in that: It also includes a video generation module, a component separation module, a virtual fusion module, a fusion verification module, and a gap analysis module; The video generation module collects video information and converts the video information into video content information according to the needs of the user and virtual information; A component splitting module extracts video content information, analyzes component information of the video content information, splits the video content information, and obtains sub-content information; A virtual fusion module generates a virtual reality model based on virtual information, and uses computer vision technology to fuse sub-content information with objects in the virtual reality model to generate a finished virtual model; A fusion verification module extracts a finished virtual model, randomly intercepts n virtual model information, where n is an unknown number, obtains virtual intercept information, extracts component information in the virtual intercept information, obtains virtual component information, and extracts component information in the corresponding video content information, constructs two sets of rectangular coordinate systems, inserts the virtual component information and the component information in the video content information into the rectangular coordinate system respectively, places the same corner of the component information in the virtual component information and the video content information at the origin, generates a virtual coordinate system and a component coordinate system, enlarges the virtual coordinate system and the component coordinate system, draws along the outer edges of the component information in the virtual component information and the video content information according to the set spacing, generates two sets of outer edge frame line information, determines whether the two sets of outer edge frame line information are the same, and verifies the fusion effect of the finished virtual model; The gap analysis module extracts the coordinate system of different spacing points, generates virtual component spacing coordinates and constituent component spacing coordinates, and calculates the gap between the virtual component spacing coordinates and the constituent component spacing coordinates.

2. The video generation and virtual reality fusion adjustment system according to claim 1, characterized in that: It also includes an adjustment plan generation module; The adjustment scheme generation module analyzes the adjustment spacing of the virtual component spacing coordinates according to the virtual component spacing coordinates and the component spacing coordinates, analyzes the method of adjusting the finished virtual model, generates an adjustment scheme, transmits the adjustment scheme to the virtual fusion module, and adjusts the finished virtual model.

3. The video generation and virtual reality fusion adjustment system according to claim 1, characterized in that: After analyzing the component information of the video content information, the component splitting module determines the arrangement order of the component information, reverses the arrangement order, generates external splitting order information, and uses the external splitting order information to split the video content information.

4. The video generation and virtual reality fusion adjustment system according to claim 1, characterized in that: When randomly intercepting n virtual model information, the fusion verification module analyzes the time of the virtual model information, divides the time of the virtual model information into n areas evenly, randomly intercepts a virtual model information in different areas, and obtains n virtual intercepted information.

5. The video generation and virtual reality fusion adjustment system according to claim 4, characterized in that: When determining whether two sets of outer edge frame line information are the same, the fusion verification module collects the lengths of four frame lines on the two sets of outer edge frame line information, obtains virtual frame length information and component frame length information, and calculates the ratio of the virtual frame length information to the component frame length information.

6. The video generation and virtual reality fusion adjustment system according to claim 5, characterized in that: When the fusion verification module calculates the ratio of the virtual border length information to the component border length information, it simultaneously determines whether the ratio of the virtual border length information to the component border length information is the same; When the ratios are the same, the two sets of outer edge frame information are judged to be similar; When the ratios are different, it is determined that the two sets of outer edge frame line information are not similar, and the gap analysis module is used to calculate the gap between the two sets of outer edge frame line information; Determine the relationship between all virtual interception information and component information according to the above method; When there are two or more virtual interception information that are not similar to the component information, it is determined whether the two virtual interception information are adjacent; When the positions of two virtual intercepted information are in an adjacent state, the times corresponding to the two virtual intercepted information are extracted, the middle time between the two times is analyzed, the virtual model information corresponding to the middle time is intercepted, a layer of intercepted information is obtained, and whether the first layer of intercepted information is similar to the component information is analyzed; When the first interception information is similar to the component information, the virtual model information between the first time and the time of the first interception information is marked, and the virtual model information within the time period is optimized; When the first-layer interception information is not similar to the component information, the virtual model information between the two time periods will be marked, and the virtual model information within the time period will be optimized; When the positions of two virtual intercepted information are not adjacent, the time interval between the two virtual intercepted information is analyzed, and the virtual model information of half the time interval before and after is intercepted with the time point of the dissimilar virtual intercepted information as the center, and the virtual model information is optimized; When there is only one virtual interception information that is not similar to the component information, the virtual model information of half the time interval before and after the time point of the dissimilar virtual interception information will be intercepted and optimized.

7. The video generation and virtual reality fusion adjustment system according to claim 2, characterized in that: When the gap analysis module calculates the gap between the virtual component spacing coordinate and the component spacing coordinate, the virtual component spacing coordinate is set to , let the component spacing coordinates be , let the gap index be , let the number of spacing coordinates be K; The gap index can be calculated according to the above formula.

8. The video generation and virtual reality fusion adjustment system according to claim 7, characterized in that: After calculating the gap index, the gap analysis module sets an adjustment plan generation threshold to analyze whether the gap index is less than the adjustment plan generation threshold. ; when The generation signal will not be transmitted to the adjustment plan generation module, and the gap index will not be displayed; when When the adjustment scheme generation module is activated, a generation signal is transmitted to the adjustment scheme generation module.

9. The video generation and virtual reality fusion adjustment system according to claim 2, characterized in that: When analyzing the adjustment interval of the virtual component interval coordinate, the adjustment scheme generation module will re-extract the virtual component interval coordinate information and the component interval coordinate information, and convert them into virtual coordinate values ​​and component coordinate values. , , ,……, , assuming that the coordinate values ​​of all components are , , ,……, , the adjustment spacing of the virtual component spacing coordinates is ; 、 、 、……、 The adjustment interval of the virtual component interval coordinates can be calculated according to the above formula.

Images