Virtual reality rural environment design system based on AR technology

Abstract

The invention relates to the technical field of AR, in particular to a virtual reality rural environment design system based on the AR technology, which comprises a data acquisition module, a 3D modeling and digital processing module, an AR engine and interactive design module and a storage and cloud platform module. According to the virtual reality rural environment design system based on the AR technology, for culture inheritance, rural memory is awakened, the old can regain the beauty of children, young people can relieve the thinking, scattered folk custom and historical data are fused into a scene, rural veins are continued, visual historical blueprint is provided for planners in rural construction, and the rural environment design system has the advantages of being high in practicability and convenient to popularize and use. The real plot and the reciprocation style are compared, a scientific transformation scheme is made in an auxiliary mode, the trial and error cost is reduced, students can perceive indigenous knowledge in an immersive mode in the aspect of education and science popularization, and in the economic development, virtual tourism is guided in advance, and the on-site visiting willingness of tourists is motivated.

Description

Technical Field

[0001] The present invention relates to the field of AR technology, and in particular to a virtual reality rural environment design system based on AR technology. Background Art

[0002] With the rapid advancement of urbanization, rural areas are undergoing rapid changes, and many rural landscapes and buildings that carry rich historical culture and collective memory are gradually disappearing. Traditional recording methods, such as photos and text archives, make it difficult for people to immerse themselves in past rural life scenes. Existing virtual reality systems mostly focus on the construction of urban or science fiction theme scenes. There is still a lack of systems for virtual reconstruction of rural environments, especially the use of AR technology to achieve a deep integration of virtual and reality, so that people can evoke rural memories and inherit rural context. This not only limits the retention and dissemination of rural memories, but also brings many inconveniences to the subsequent scientific transformation of rural areas. For this reason, a virtual reality rural environment design system based on AR technology is proposed. Summary of the invention

[0003] In view of this, the present invention provides a virtual reality rural environment design system based on AR technology to solve or alleviate the technical problems existing in the prior art and at least provide a beneficial option.

[0004] The technical solution of the present invention is implemented as follows: a virtual reality rural environment design system based on AR technology, including a data acquisition module, a 3D modeling and digital processing module, an AR engine and interactive design module, and a storage and cloud platform module;

[0005] The data collection module is responsible for collecting original materials such as images, audio, and documents of the village, laying the foundation for the subsequent construction of the virtual environment;

[0006] The 3D modeling and digital processing module converts the collected data into a high-precision 3D model and optimizes it to fit the real rural landscape;

[0007] The AR engine and interactive design module: realize the precise superposition of virtual rural scenes and real scenes, and design interactive functions at the same time;

[0008] The storage and cloud platform module is responsible for local caching and cloud storage of data, as well as ensuring data synchronization between different devices.

[0009] Further preferably, the data acquisition module includes image capture, audio collection and document integration. The image capture is equipped with a professional high-definition drone equipped with a high-resolution camera, which can fly flexibly at different altitudes and angles to capture a panoramic bird's-eye view of the village, obtain the overall layout of the village, the outline of the surrounding farmland and mountains, and the distribution of building communities. A 360-degree panoramic camera is placed at various key nodes in the village, such as the village entrance, square, ancestral hall, etc., to capture the complete scene in the horizontal and vertical directions at one time, and collect full information such as building details, road directions, and small landscape facilities. Position information, the audio recording uses a high-precision, highly directional recording microphone, with a portable recorder, to record the sounds of nature, such as wind, rain, frogs, villagers' daily exchanges, and folk activities, like suona, gongs and drums at weddings and funerals, and hawking at the market, etc. The document integration is composed of historians, folk experts, and archivists. They go deep into rural cultural centers, villagers' homes, and local archives, and read local chronicles, family trees, old photos, personal notes and other materials to sort out the history of rural changes, the deeds of important figures, and the former architectural styles and uses.

[0010] Further preferably, the 3D modeling and digital processing module includes model building, texture mapping and optimization and simplification. The model building uses Maya, 3dsMax or Blender3D modeling tools. Modelers use their rich polygon modeling and surface modeling functions to shape various entities such as rural buildings and natural landscapes. The texture mapping uses software such as Substance Painter and Photoshop. Painters draw textures that match real materials based on collected real-life images. The optimization and simplification uses special polygon simplification tools and baking software to reduce the number of model faces and compress the texture size while ensuring that the visual effect of the model is not distorted.

[0011] Further preferably, the AR engine and interaction design module include virtual-real fusion, interaction design and multi-device adaptation. The virtual-real combination uses AR development frameworks such as Vuforia, ARKit and ARCore, which can analyze the real images captured by the camera in real time and calculate the position and angle of virtual objects. The interaction design includes UI designers, UX designers and programmers. The UI designers are responsible for designing the operating interface that conforms to the rural theme, the UX designers plan the process logic of the user's interaction with the virtual village, and the programmers use programming languages ​​such as C# and Java to implement the design. The multi-device adaptation optimizes and debugs the interactive functions according to the screen size, resolution and sensor performance of different devices.

[0012] Further preferably, the storage and cloud platform module includes local cache, cloud storage and data synchronization. The local cache is located on the user device side, and uses the SQLite database or lightweight file storage system to open up a special space to store virtual village scene fragments, commonly used interaction settings and other data that users have frequently visited recently. The cloud storage builds a server cluster based on cloud computing architecture, equipped with a large-capacity hard disk array for storing massive and complete virtual village data, deploys firewalls and encryption algorithms to ensure data security, and has a data distribution server responsible for quickly pushing updated content according to user requests. The data synchronization develops a cross-platform data synchronization program, one end of which is connected to the user device and the other end is connected to the cloud server. It monitors the difference between the local data of the device and the cloud data in real time, automatically uploads newly collected data and user personalized settings, and downloads the latest virtual village update package.

[0013] Further preferably, the formula for accurately determining the positions of virtual rural buildings, landscapes and other elements in the real picture is as follows:

[0014] When using a camera to match and locate virtual objects with real scenes, it involves coordinate transformation in computer vision algorithms. Assuming that the camera's intrinsic parameter matrix is ​​K, a point P in the world coordinate system is w =(X w ,Y w ,Z w ) is transformed to the camera coordinate system P through the rotation matrix R and the translation vector t c =(X c ,Y c ,Z c ), satisfying P c =R·P w +t, and then projected onto the image plane through the intrinsic parameter matrix to obtain the pixel coordinates (u, v), the relationship is:

[0015] The embodiment of the present invention has the following advantages due to the adoption of the above technical solution:

[0016] The virtual reality rural environment design system based on AR technology in the present invention awakens rural memories in terms of cultural heritage, allowing the elderly to regain the beauty of their childhood and the young to relieve homesickness. It also integrates scattered folk customs and historical materials into the scene to continue the rural context. In rural construction, it provides planners with a visual historical blueprint to compare the actual plots with the past styles, assist in formulating scientific transformation plans, and reduce the cost of trial and error. In terms of education and popular science, students can immerse themselves in the perception of local knowledge. In economic development, virtual tourism can be used to attract tourists in advance and stimulate their willingness to visit the site.

[0017] The above summary is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present invention will be readily apparent by reference to the accompanying drawings and the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 It is a system flow chart of the present invention. DETAILED DESCRIPTION

[0020] In the following, only some exemplary embodiments are briefly described. As those skilled in the art will appreciate, the described embodiments may be modified in various ways without departing from the spirit or scope of the present invention. Therefore, the drawings and descriptions are considered to be exemplary and non-restrictive in nature.

[0021] The embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0022] like Figure 1 As shown, an embodiment of the present invention provides a virtual reality rural environment design system based on AR technology, including a data acquisition module, a 3D modeling and digital processing module, an AR engine and interactive design module, and a storage and cloud platform module;

[0023] Data collection module: responsible for collecting original materials such as images, audio, and documents of the village to lay the foundation for the subsequent construction of the virtual environment;

[0024] 3D modeling and digital processing module: convert the collected data into a high-precision 3D model and optimize it to make it fit the real rural landscape;

[0025] AR engine and interactive design module: realize the precise superposition of virtual rural scenes and real scenes, and design interactive functions at the same time;

[0026] Storage and cloud platform module: responsible for local data caching, cloud storage, and ensuring data synchronization between different devices.

[0027] In one embodiment, the data acquisition module includes image capture, audio collection and document integration. Image capture is equipped with a professional high-definition drone equipped with a high-resolution camera, which can fly flexibly at different altitudes and angles to capture a panoramic bird's-eye view of the village, obtain the overall layout of the village, the outline of the surrounding farmland and mountains, and the distribution of building communities. A 360-degree panoramic camera is used and placed at various key nodes in the village, such as the village entrance, square, ancestral hall, etc., to capture the complete scene in the horizontal and vertical directions at one time, and collect all-round information such as building details, road directions, and small landscape facilities. Audio collection uses a high-precision, highly directional recording microphone, with a portable recorder, to record the sounds of nature, such as wind, rain, frogs, daily exchanges among villagers, and sounds of folk activities, such as suona, gongs and drums at weddings and funerals, and hawking at the market. Document integration is composed of historians, folk experts, and archivists. They go deep into rural cultural centers, villagers' homes, and local archives to read local chronicles, family trees, old photos, private notes and other materials, and sort out the history of rural changes, the deeds of important figures, and the former architectural styles and uses.

[0028] In one embodiment, the 3D modeling and digital processing module includes model building, texture mapping and optimization and simplification. The model building uses Maya, 3dsMax or Blender 3D modeling tools. Modelers use their rich polygon modeling and surface modeling functions to shape various entities such as rural buildings and natural landscapes. Texture mapping uses software such as Substance Painter and Photoshop. Painters draw textures that match real materials based on the collected real-life images. Optimization and simplification use special polygon simplification tools and baking software to reduce the number of model faces and compress the texture size while ensuring that the model's visual effect is not distorted.

[0029] In one embodiment, the AR engine and interaction design module include virtual-reality fusion, interaction design and multi-device adaptation. The combination of virtual and real uses AR development frameworks such as Vuforia, ARKit, and ARCore, which can analyze the real images captured by the camera in real time and calculate the position and angle of virtual objects. Interaction design includes UI designers, UX designers and programmers. UI designers are responsible for designing operating interfaces that conform to the rural theme, UX designers plan the process logic of user interaction with the virtual village, and programmers use programming languages ​​​​such as C#, Java, etc. to implement the design plan. Multi-device adaptation optimizes and debugs the interactive functions according to the screen size, resolution, and sensor performance of different devices.

[0030] In one embodiment, the storage and cloud platform module includes local cache, cloud storage and data synchronization. The local cache is on the user device side, using the SQLite database or lightweight file storage system to open up a special space to store virtual village scene fragments, common interaction settings and other data that users have frequently visited recently. The cloud storage builds a server cluster based on the cloud computing architecture, equipped with a large-capacity hard disk array for storing massive and complete virtual village data, deploys firewalls and encryption algorithms to ensure data security, and has a data distribution server responsible for quickly pushing updated content according to user requests. Data synchronization develops a cross-platform data synchronization program, one end of which is connected to the user device and the other end is connected to the cloud server. It monitors the difference between the local data of the device and the cloud data in real time, automatically uploads newly collected data and user personalized settings, and downloads the latest virtual village update package.

[0031] In one embodiment, the formula for accurately determining the positions of virtual village buildings, landscapes and other elements in the real picture is as follows:

[0032] When using a camera to match and locate virtual objects with real scenes, it involves coordinate transformation in computer vision algorithms. Assuming that the camera's intrinsic parameter matrix is ​​K, a point P in the world coordinate system is w =(X w ,Y w ,Z w ) is transformed to the camera coordinate system P through the rotation matrix R and the translation vector t c =(X c ,Y c ,Z c ), satisfying P c =R·P w +t, and then projected onto the image plane through the intrinsic parameter matrix to obtain the pixel coordinates (u, v), the relationship is:

[0033] When the present invention is working: the materials collected by the data acquisition module are transmitted to the 3D modeling and digital processing module. After the modeling and optimization are completed, the model data enters the AR engine and interactive design module. Here, the AR engine uses the camera to capture the real scene and accurately embeds the virtual village, and the interactive design responds to user operations to drive scene changes. During the whole process, the storage and cloud platform module is responsible for data storage, updating and synchronization, so that users can access the personalized virtual rural environment anytime and anywhere. Considering that the devices in the hands of users are different, it is adapted to various terminals such as smart phones, tablets, AR glasses, etc. According to the differences in screen resolution, processor performance, and sensor sensitivity of each device, the interactive function and display effect are fine-tuned to ensure that whether it is a convenient mobile phone end or a more immersive AR glasses end, you can experience the virtual village smoothly.

[0034] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of various changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A virtual reality rural environment design system based on AR technology, characterized by: It includes data acquisition module, 3D modeling and digital processing module, AR engine and interactive design module, and storage and cloud platform module; The data collection module is responsible for collecting original materials such as images, audio, and documents of the village, laying the foundation for the subsequent construction of the virtual environment; The 3D modeling and digital processing module converts the collected data into a high-precision 3D model and optimizes it to fit the real rural landscape; The AR engine and interactive design module: realize the precise superposition of virtual rural scenes and real scenes, and design interactive functions at the same time; The storage and cloud platform module is responsible for local caching and cloud storage of data, as well as ensuring data synchronization between different devices.

2. The virtual reality rural environment design system based on AR technology according to claim 1 is characterized by: The data acquisition module includes image capture, audio recording and document integration. The image capture is equipped with a professional high-definition drone equipped with a high-resolution camera, which can fly flexibly at different altitudes and angles to capture a panoramic bird's-eye view of the village, obtain the overall layout of the village, the outline of the surrounding farmland and mountains, and the distribution of building communities. A 360-degree panoramic camera is placed at various key nodes in the village, such as the village entrance, square, ancestral hall, etc., to capture the complete scene in the horizontal and vertical directions at one time, and collect all-round information such as building details, road directions, and small landscape facilities. The audio recording uses a high-precision, highly directional recording microphone, combined with a portable recorder, to record the sounds of nature, such as wind, rain, and frogs, as well as the sounds of villagers' daily communications and folk activities, like the suona, gongs and drums at weddings and funerals, and the hawking at the market. The document integration is composed of historians, folk experts, and archivists. They go deep into rural cultural centers, villagers' homes, and local archives, and read local chronicles, family trees, old photos, personal notes and other materials to sort out the history of rural changes, the deeds of important figures, and the former architectural styles and uses.

3. The virtual reality rural environment design system based on AR technology according to claim 1 is characterized by: The 3D modeling and digital processing module includes model construction, texture mapping and optimization and simplification. The model construction uses Maya, 3dsMax or Blender3D modeling tools. Modelers use their rich polygon modeling and surface modeling functions to shape various entities such as rural buildings and natural landscapes. The texture mapping uses software such as Substance Painter and Photoshop. Painters draw textures that match real materials based on the collected real-life images. The optimization and simplification uses special polygon simplification tools and baking software to reduce the number of model faces and compress the texture size while ensuring that the model's visual effect is not distorted.

4. The virtual reality rural environment design system based on AR technology according to claim 1 is characterized by: The AR engine and interaction design module include virtual-reality fusion, interaction design and multi-device adaptation. The virtual-reality combination uses AR development frameworks such as Vuforia, ARKit, and ARCore, which can analyze the real images captured by the camera in real time and calculate the position and angle of virtual objects. The interaction design includes UI designers, UX designers and programmers. UI designers are responsible for designing operating interfaces that conform to the rural theme, UX designers plan the process logic of user interaction with the virtual village, and programmers use programming languages ​​such as C#, Java, etc. to implement the design plan. The multi-device adaptation optimizes and debugs the interactive functions according to the screen size, resolution, and sensor performance of different devices.

5. The virtual reality rural environment design system based on AR technology according to claim 1 is characterized by: The storage and cloud platform module includes local cache, cloud storage and data synchronization. The local cache is located on the user device side, using the SQLite database or lightweight file storage system to open up a special space to store virtual village scene fragments, commonly used interaction settings and other data that users have frequently visited recently. The cloud storage builds a server cluster based on cloud computing architecture, equipped with a large-capacity hard disk array for storing massive and complete virtual village data, deploys firewalls and encryption algorithms to ensure data security, and has a data distribution server responsible for quickly pushing updated content based on user requests. The data synchronization develops a cross-platform data synchronization program, one end of which is connected to the user device and the other end is connected to the cloud server. It monitors the difference between the local data of the device and the cloud data in real time, automatically uploads newly collected data and user personalized settings, and downloads the latest virtual village update package.

6. The virtual reality rural environment design system based on AR technology according to claim 1 is characterized by: The formula used to accurately determine the position of virtual rural buildings, landscapes and other elements in the real picture is as follows: When using a camera to match and locate virtual objects with real scenes, it involves coordinate transformation in computer vision algorithms. Assuming that the camera's intrinsic parameter matrix is ​​K, a point P in the world coordinate system is w =(X w ,Y w ,Z w) After the rotation matrix R and the translation vector t are transformed to the camera coordinate system P c =(X c ,Y c ,Z c ), satisfying P c =R·P w +t, and then projected onto the image plane through the intrinsic parameter matrix to obtain the pixel coordinates (u, v), the relationship is:

Images