Virtual environment generation method, electronic device, medium and virtual reality device
By accurately modeling and reconstructing the environment to be restored in the virtual space, the target virtual environment is formed and presented through virtual reality devices, the problem that immigrants cannot visit their hometowns virtually is solved, users' virtual tour needs are realized, and the experience is improved.
Patent Information
- Application Number
- CN202410347786.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-26
- Publication Date
- 2025-04-01
- Estimated Expiration
- 2044-03-26
AI Technical Summary
The existing technology cannot allow immigrant users to virtually visit a specific target environment, making it difficult to solve the problem of immigrants missing their hometown and wanting to visit their hometown.
By obtaining the terrain and landform data, laser dot matrix data, texture data and image data of the environment to be restored, the environment to be restored is accurately modeled and reconstructed in the virtual space to form a target virtual environment, and present it to the user in a stereoscopic way through virtual reality devices.
It enables users to virtually visit specific target environments, meets users' virtual tour needs for a specific target environment, solves the problem of immigrants missing their hometown, and improves the user experience.
Smart Images

Figure CN117953176B_ABST
Abstract
Description
Background Art
[0002] With the rapid development of urbanization, immigrant communities have become a special type of community that has grown rapidly in recent years. After moving away from their original residence, immigrants are usually unable to quickly establish new social relationships, lack a sense of belonging, have difficulty integrating into the new environment, and have problems such as homesickness. In reality, social science methods are usually used to guide immigrants' psychology, but it is still difficult to overcome the problem that some immigrants miss their hometowns and want to visit their hometowns.
[0003] Therefore, how to use technological means to enable immigrants to return to their hometowns for sightseeing becomes an important issue.
[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention
[0005] The purpose of the present disclosure is to provide a virtual environment generation method, an electronic device and a virtual reality device, so as to overcome the problem that the prior art cannot enable users to browse a specific target environment.
[0006] According to a first aspect of an embodiment of the present disclosure, a method for generating a virtual environment is provided, comprising: acquiring terrain data of an environment to be restored, and forming a virtual terrain of the environment to be restored in a virtual space according to the terrain data; acquiring laser dot matrix data of multiple acquisition targets of the environment to be restored, and reconstructing multiple virtual targets corresponding to the multiple acquisition targets on the virtual terrain through modeling according to the laser dot matrix data, wherein the multiple acquisition targets include at least buildings, roads, and fixed facilities; acquiring texture data and image data of the multiple acquisition targets, and restoring the appearance of the multiple virtual targets in the virtual space according to the texture data and the image data to form a target virtual environment corresponding to the environment to be restored; and presenting the target virtual environment to the visiting user in a stereoscopic visual manner through a virtual reality device in response to a user access message.
[0007] In an exemplary embodiment of the present disclosure, it further includes:
[0008] Acquiring cultural and historical information of the environment to be restored, wherein the cultural and historical information includes traditional handicrafts, folk cultural activities, and historical events;
[0009] The cultural history information is associated with the topographic data of the environment to be restored, the laser dot matrix data, the texture data and the image data of multiple acquisition targets in a database and stored.
[0010] In an exemplary embodiment of the present disclosure, it further includes:
[0011] A plurality of non-player characters and virtual props are set in the target virtual environment according to the cultural history information, and the plurality of non-player characters operate the virtual props in the target virtual environment to restore at least one of the traditional handicraft, the folk cultural activities, and the historical events.
[0012] In an exemplary embodiment of the present disclosure, it further includes:
[0013] A virtual object corresponding to the accessing user is set in the target virtual environment, wherein the virtual object is controlled by the accessing user to move in the target virtual environment and interact with the non-player character and / or other virtual objects.
[0014] In an exemplary embodiment of the present disclosure, the cultural history information includes regional cultural history information corresponding to the regional coordinates of the environment to be restored, and presenting the target virtual environment to the accessing user in a stereoscopic visual manner through a virtual reality device includes:
[0015] Determine the virtual area currently visited by the visiting user according to the coordinates of the visiting user in the target virtual environment;
[0016] After determining the area of the environment to be restored corresponding to the virtual area, determining the regional cultural history information corresponding to the area of the environment to be restored;
[0017] The regional cultural history information is pushed to the visiting user in the target virtual environment.
[0018] In an exemplary embodiment of the present disclosure, presenting the target virtual environment to the accessing user in a stereoscopic visual manner through a virtual reality device includes:
[0019] Obtaining user information of the accessing user;
[0020] Determining the access preference of the access user according to the user information;
[0021] Generate a navigation route and / or access shortcut corresponding to the access user according to the access preference;
[0022] The guided route and / or access shortcut is pushed to the visiting user in the target virtual environment.
[0023] In an exemplary embodiment of the present disclosure, the image data includes 360-degree static images, 360-degree videos, panoramic images, and historical photos.
[0024] According to a second aspect of the present disclosure, an electronic device is provided, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute a method as described in any one of the above embodiments based on instructions stored in the memory.
[0025] According to a third aspect of the present disclosure, a computer-readable storage medium is provided, on which a program is stored, and when the program is executed by a processor, the method for generating a virtual environment as described in any one of the above embodiments is implemented.
[0026] According to a fourth aspect of the present disclosure, there is provided a virtual reality device having data stored thereon, the data being used to enable the virtual reality device to present a target virtual environment generated by the virtual environment generation method described in any of the above embodiments.
[0027] The disclosed embodiments can form a target virtual environment corresponding to the environment to be restored by accurately modeling and reconstructing the environment to be restored in a virtual space based on the topographic data of the environment to be restored, laser dot data of multiple acquisition targets, texture data and image data, and then enable users to access the target virtual environment through virtual reality devices, thereby satisfying the users' needs for virtual tours of a specific target environment.
[0028] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.
[0030] Figure 1 is a flowchart of a method for generating a virtual environment in an exemplary embodiment of the present disclosure.
[0031] Figure 2 It is a sub-flow chart of step S4 in one embodiment of the present disclosure.
[0032] Figure 3 It is a schematic diagram for displaying cultural and historical information in one embodiment of the present disclosure.
[0033] Figure 4 is a schematic diagram of a target virtual environment in one embodiment of the present disclosure.
[0034] Figure 5 It is a sub-flow chart of step S4 in another embodiment of the present disclosure.
[0035] Figure 6 is a block diagram of an electronic device in an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION
[0036] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; on the contrary, these embodiments are provided so that the present disclosure will be more comprehensive and complete, and the concepts of the example embodiments will be fully conveyed to those skilled in the art. The described features, structures, or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted.
[0037] In addition, the accompanying drawings are only schematic diagrams of the present disclosure, and the same reference numerals in the drawings represent the same or similar parts, so their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities, which do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.
[0038] The exemplary embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.
[0039] Figure 1 is a flowchart of a method for generating a virtual environment in an exemplary embodiment of the present disclosure.
[0040] refer to Figure 1 , the virtual environment generation method 100 may include:
[0041] Step S1, obtaining topographic data of an environment to be restored, and forming a virtual topographic data of the environment to be restored in a virtual space according to the topographic data;
[0042] Step S2, obtaining laser dot matrix data of multiple acquisition targets of the environment to be restored, and reconstructing multiple virtual targets corresponding to the multiple acquisition targets on the virtual terrain through modeling according to the laser dot matrix data, wherein the multiple acquisition targets at least include buildings, roads, and fixed facilities;
[0043] Step S3, acquiring texture data and image data of the plurality of acquisition targets, and restoring the appearance of the plurality of virtual targets in the virtual space according to the texture data and image data to form a target virtual environment corresponding to the environment to be restored;
[0044] Step S4, in response to the user access message, presenting the target virtual environment to the accessing user in a stereoscopic visual manner through a virtual reality device.
[0045] The disclosed embodiments can form a target virtual environment corresponding to the environment to be restored by accurately modeling and reconstructing the environment to be restored in a virtual space based on the topographic data of the environment to be restored, laser dot data of multiple acquisition targets, texture data and image data, and then enable users to access the target virtual environment through virtual reality devices, thereby satisfying the users' needs for virtual tours of a specific target environment.
[0046] The method of the disclosed embodiment can be used to reproduce various environments to be restored, such as villages, communities, cities, and natural environments within a certain range, in a virtual space to form a target virtual environment, and allow users to visit the target virtual environment through virtual reality devices.
[0047] The method of the embodiment of the present disclosure can realize the data collection process when the environment to be restored does not disappear or change.
[0048] The method of the embodiment of the present disclosure may be automatically executed by a computer or manually executed.
[0049] Next, each step of the virtual environment generation method 100 is described in detail.
[0050] In step S1, the topographic data of the environment to be restored are obtained, and a virtual topographic data of the environment to be restored is formed in a virtual space according to the topographic data.
[0051] In the embodiments of the present disclosure, the environment to be restored includes but is not limited to villages, communities, cities, natural environments within a certain range (such as mountains, rivers), etc.
[0052] Topography refers to the physical shape, height and structure of the earth's surface, describing various features of the earth's surface, such as mountains, hills, plains, rivers, etc. Topography can be quantitatively described by indicators such as altitude, slope, and aspect. Landforms are terrain features caused by various geological, climatic and hydrological processes, including mountains, canyons, glaciers, wind-blown sand dunes, etc. Landforms can reflect the geological and geographical history of the earth's surface over a long period of time.
[0053] To obtain the topographic data of the environment to be restored, the regional information or watershed information corresponding to the environment to be restored can be systematically organized through a geographic information system (GIS) to form data such as geographical features, natural resource distribution, and environmental conditions, thereby forming topographic data based on these data.
[0054] For example, GIS can be used to collect topographic data of the area where the environment to be restored is located, such as terrain elevation, slope, and water system information, including the distribution of rivers, lakes, and wetlands. Secondly, GIS can also be used to integrate climate data of the environment to be restored, including meteorological information such as precipitation and temperature, as well as land use data, including different types of land use such as farmland, forests, and cities. Environmental quality data can also be integrated, such as soil type, water quality, etc. In addition, in GIS, topographic data can also include terrain elevation data, terrain slope data, landform type data, etc.
[0055] In some embodiments, the topographic data may also include real-time or historical geographic data of traditional villages and historical buildings that have been collected and stored in advance. When the real-time or historical geographic data of traditional villages and historical buildings that have been collected in advance are stored, these data may be integrated together to generate detailed maps, and these maps may present the overall picture of the geographic space and provide record data of the geographic space relationship.
[0056] In addition, the height information and geomorphic features of the terrain to be restored can be obtained through lidar scanning, satellite remote sensing data, digital elevation model (DEM), etc. to form topographic and geomorphic data.
[0057] After obtaining the topographic data, modeling can be performed in the virtual space to form a virtual topography of the environment to be restored.
[0058] First, the terrain data can be processed and edited, including smoothing, filling blank areas, adjusting proportions and other operations, so as to better meet the needs of the virtual space. Next, the virtual terrain is automatically constructed according to the imported terrain data. In some embodiments, in addition to automatically generating virtual terrain, the ups and downs and features of the terrain can also be simulated manually by adding, moving, stretching vertices and other operations. Finally, suitable material maps can be automatically added to the virtual terrain data to increase the sense of reality and visual effects. Suitable maps can be automatically determined or automatically generated according to terrain features and object types. In some embodiments, appropriate light and shadow and special effects can also be automatically set according to parameters such as time and weather to enhance the visual effects of the terrain. For example, elements such as sunlight, shadows, and fog effects can be automatically added according to real-time parameters such as time and weather set by the system to make the virtual terrain look more vivid and natural.
[0059] After the virtual topography is formed, the natural geographical environment of the environment to be restored is reproduced. Next, the human geographical environment of the environment to be restored is further constructed.
[0060] In step S2, laser dot matrix data of multiple acquisition targets of the environment to be restored are obtained, and multiple virtual targets corresponding to the multiple acquisition targets are reconstructed on the virtual terrain through modeling based on the laser dot matrix data. The multiple acquisition targets include at least buildings, roads, and fixed facilities.
[0061] In one embodiment, three-dimensional laser scanning technology can be used in advance to perform laser scanning to collect and store laser dot matrix information of the road network and buildings of the original site of the environment to be restored (such as a village), and automatically extract the data when generating the target virtual environment. The laser scanner can accurately measure the geometric shape and structure of the surface of an object and generate a large amount of point cloud data. Through high-precision laser scanning, it is possible to achieve a full-dimensional three-dimensional perception of the environment to be restored, capture the subtle details of every corner, and obtain the laser dot matrix data of the geographic space of the environment to be restored, including the shape, structure and overall topography of the building.
[0062] Next, three-dimensional laser scanning modeling and reconstruction technology can be used to generate multiple virtual targets corresponding to multiple collected objects in the environment to be restored.
[0063] In the disclosed embodiments, the collection objects may be buildings, roads, fixed facilities, etc., wherein fixed facilities are, for example, water wells, electric poles, stones, trash cans, community fitness facilities, fixed seats, etc., which are objects that do not move under normal circumstances. In some cases, the collection objects may also include non-fixed facilities such as animals and plants. The number of collection objects should be as large as possible, and the collected laser dot matrix data should be as detailed as possible, so as to better restore the environment to be restored in the virtual space.
[0064] When the acquisition object is a building, the laser dot matrix data can include not only the outer contour of the building, but also the internal structure of the building, such as doors, windows, furniture, stairs, etc.
[0065] When reconstructing a virtual target based on laser point cloud data, the point cloud data can be processed first, including denoising, filtering, alignment and other operations to ensure the accuracy and integrity of the data. Next, the three-dimensional model of the collected object is reconstructed based on the processed point cloud data. Surfaces or polygonal meshes can be created by connecting point cloud points to gradually reconstruct the shape and structure of the object. During the modeling process, details can be automatically added, surfaces can be modified, the smoothness of the surface can be adjusted, textures can be added, colors can be adjusted, etc. can be adjusted according to the properties of the collected object to enhance the visual effect of the model. In addition, the above process can also be achieved by manually operating the laser modeling software.
[0066] In the disclosed embodiment, the virtual target may be directly constructed in the virtual environment so as to restore the position of the virtual target most accurately.
[0067] In addition, each virtual target may be automatically constructed in external software according to the laser point cloud data, and then the virtual target file may be exported so as to reuse the virtual target later. In this case, when performing step S2, the virtual target file may be directly imported into the virtual space.
[0068] After the virtual target is formed in step S2, in order to make the restoration effect more realistic, the surface of the virtual target needs to be further processed.
[0069] In step S3, texture data and image data of the multiple acquisition targets are obtained, and the appearance of the multiple virtual targets is restored in the virtual space according to the texture data and image data to form a target virtual environment corresponding to the environment to be restored.
[0070] In some embodiments, acquiring texture data and image data may be acquiring orthophotos of the acquisition target at multiple angles through laser point cloud data and photography data.
[0071] In the embodiments of the present disclosure, image data includes but is not limited to 360-degree static images, 360-degree videos, panoramic images, and historical photos. Texture data can be obtained by analyzing image data or by three-dimensional scanning technology (such as laser scanning, structured light scanning, etc.). In addition, optical property information such as reflection, absorption, and scattering of the surface of an object can be obtained through sensors such as lidar and infrared cameras to reconstruct the texture and material information of the surface of the object. For some special objects, physical texture information of the surface of the object can also be obtained through tactile sensors, including roughness, hardness, surface morphology, etc., to simulate the texture and texture of the surface of the object.
[0072] In addition, RTK (Real-Time Kinematic) measurement and panoramic photography can be used to record the geographic coordinates and surrounding environment of villages and buildings, and combined with the entry of historical pictures and digital modeling technology (CAD, SU) to build technology to display the environment to be restored.
[0073] At this point, a target virtual environment corresponding to the environment to be restored is formed in the virtual space. The topography, natural scenery, buildings, roads, fixed facilities, etc. of the target virtual environment are highly similar to those of the environment to be restored.
[0074] Finally, set up access capabilities for the target virtual environment.
[0075] In step S4, in response to the user access message, the target virtual environment is presented to the accessing user in a stereoscopic visual manner through a virtual reality device.
[0076] Virtual reality devices include but are not limited to virtual reality glasses, virtual reality headsets, etc.
[0077] Through virtual reality (VR) technology, the environment to be restored is rebuilt in the virtual space, allowing users to personally experience the cultural heritage of the original village through a digital platform. By building a target virtual environment with 360-degree images or videos, users can roam freely in the virtual space and observe the restored buildings and scenery around them, meeting the needs of users to visit specific target environments.
[0078] In the disclosed embodiment, more humanistic factors may be added to the target virtual environment to make the target virtual environment closer to the real state of the environment to be restored.
[0079] In one embodiment, cultural and historical information of the environment to be restored can be obtained, and the cultural and historical information includes traditional handicrafts, folk cultural activities, historical events, etc. Then, the cultural and historical information is associated with the topographic data of the environment to be restored, the laser dot matrix data of multiple acquisition targets, the texture data and the image data in the database and stored.
[0080] The stored cultural and historical information that can be directly obtained can be collected in advance using a variety of methods, including but not limited to questionnaires, visits and other means to obtain information on the rich local traditional crafts, folk customs, cultural activities and community history. For example, by designing a questionnaire, systematically understand the residents' cognition and participation in traditional crafts and cultural activities. Or, by visiting community residents, gain an in-depth understanding of their daily lives and explore the inheritance and evolution of folk customs. Establish a full picture of community culture and capture the personal experiences and insights of residents. Finally, through comprehensive analysis of these data, cultural and historical information corresponding to the environment to be restored is formed and stored after sorting.
[0081] When storing data, the collected data can be systematically organized and archived, and the data can be formatted to ensure its consistency and readability. Next, the database stores a corresponding combination of data on the environment to be restored, covering multi-dimensional information such as the spatial structure of the building, the technical elements of traditional skills, and the time and place of community activities, to ensure efficient storage, rapid retrieval, and updating of data. By setting up appropriate indexes and tags, flexible retrieval of information in the database can be achieved, making it convenient for users to query according to different dimensions. In addition, by comprehensively integrating various types of data and building a rich and real digital database, cultural information can be recorded and passed on in a more comprehensive and three-dimensional way.
[0082] Figure 2 It is a sub-flow chart of step S4 in one embodiment of the present disclosure.
[0083] refer to Figure 2 In one embodiment, the cultural history information includes regional cultural history information corresponding to the regional coordinates of the environment to be restored, and step S4 includes:
[0084] Step S41, determining the virtual area currently visited by the visiting user according to the coordinates of the visiting user in the target virtual environment;
[0085] Step S42, after determining the area of the environment to be restored corresponding to the virtual area, determine the regional cultural history information corresponding to the area of the environment to be restored;
[0086] Step S43: Pushing regional cultural history information to visiting users in the target virtual environment.
[0087] In the database, cultural and historical information can be classified by region, and when cultural and historical information has a corresponding location, the regional cultural and historical information is recorded according to the regional coordinates. When a visiting user visits the area, the regional cultural and historical information is automatically pushed through animation, images, text and other methods.
[0088] Figure 3 It is a schematic diagram for displaying cultural and historical information in one embodiment of the present disclosure.
[0089] refer to Figure 3 , location A is a temple, and location B is a vegetable market. The coordinates of the visiting user in the virtual environment are monitored in real time to determine the virtual area where the visiting user is located. When the visiting user is determined to have visited the virtual location A according to the virtual area, the corresponding location A of the environment to be restored is determined according to the virtual location A, and the introduction of location A corresponding to the location A of the environment to be restored (regional cultural and historical information) is found. The introduction of location A can be automatically popped up next to the temple of the virtual location A, and the vegetable market B can be indicated by a brief text description. The above virtual area is defined by a coordinate range. For example, the coordinate range of the virtual location A can be (a≤x<b and c≤y<d), where x and y are coordinate variables, and a, b, c, and d are constants.
[0090] In addition to being used to display information, cultural and historical information can also be used to construct richer environmental elements.
[0091] In one embodiment, multiple non-player characters (NPCs) and virtual props can be set in the target virtual environment based on cultural and historical information. The multiple non-player characters operate the virtual props in the target virtual environment to restore at least one of traditional handicrafts, folk cultural activities, and historical events.
[0092] Figure 4 is a schematic diagram of a target virtual environment in one embodiment of the present disclosure.
[0093] refer to Figure 4 In one embodiment, a plurality of non-player characters 41 operate virtual props 42 in a specific area, such as a road, to reproduce a cultural activity. Figure 4 Taking acrobatics and sales activities as an example, in actual applications, non-player characters and virtual props can be automatically generated based on preset keywords mentioned in cultural and historical information (such as acrobatics, candied haws, etc.), and the actions of non-player characters and their positional relationship with virtual props can be automatically set according to the preset keywords, thereby restoring the activities corresponding to the preset keywords.
[0094] In addition, interactive functions can also be set up in the virtual environment.
[0095] In one embodiment, a virtual object corresponding to the accessing user may be set in the target virtual environment. The virtual object is controlled by the accessing user to move in the target virtual environment and interact with non-player characters and / or other virtual objects.
[0096] The interactive method can be that the visiting user actively interacts with the non-player characters and / or other virtual objects, and the non-player characters automatically generate reply actions and reply words based on the analysis of the visiting user's actions and language; in addition, the visiting user can also be invited to participate in humanistic activities with multiple non-player characters and / or other virtual objects.
[0097] Based on cultural and historical information, we can plan and build diversified online interactive channels, covering various forms, such as online cultural courses, virtual craft workshops, community cultural event calendars, etc., to stimulate and promote cultural exchanges among members of the immigrant community. Through online cultural courses, a platform is provided for community members to learn and share cultural knowledge. Virtual craft workshops provide opportunities to participate in practice and master craft skills. The community cultural event calendar covers a variety of activities, providing members with opportunities to participate, experience and interact. Strengthening the connection between community members, creating a richer cultural experience, and promoting a more comprehensive and in-depth realization of cultural inheritance and exchange.
[0098] The above-mentioned humanistic activities can be respectively set up in fixed activity venues. When a visiting user visits the target virtual environment, he can directly enter the activity venue of the humanistic activities to participate in the interaction, or he can push an activity invitation to the visiting user, and the visiting user can express his intention to participate by clicking an icon or other interactive methods, and the virtual object corresponding to the visiting user can be directly moved to the activity venue.
[0099] By establishing diversified online interactive channels, we can promote communication between users, increase user stickiness and improve user experience.
[0100] In some embodiments, smart navigation services can also be provided to users.
[0101] Figure 5 It is a sub-flow chart of step S4 in another embodiment of the present disclosure.
[0102] refer to Figure 5 In another embodiment, step S4 comprises:
[0103] Step S44, obtaining user information of the accessing user;
[0104] Step S45, determining the access preference of the access user according to the user information;
[0105] Step S46, generating a navigation route and / or access shortcut corresponding to the accessing user according to the access preference;
[0106] Step S47: Pushing a navigation route and / or a shortcut to the visiting user in the target virtual environment.
[0107] Figure 5 The illustrated embodiment may be referred to as an intelligent tour guide service.
[0108] The disclosed embodiments can provide users with personalized navigation services and make recommendations based on user interests and historical information. Based on big data processing, user interests and historical information are collected and analyzed. Through data such as user behavior, browsing history, and search preferences, a user profile is established to determine the user's access preferences, and personalized navigation recommendations are generated for each user based on the access preferences.
[0109] For example, if user A is determined to like rural scenery based on the user profile, a route map from user A's current location to the edge of the field is automatically generated to guide user A to the edge of the field. If user B likes to visit his original residence, the location coordinates of the original residence are obtained, and a shortcut to his original residence is pushed directly to user B, so that user B can directly visit his original residence through simple operations (such as clicking on the shortcut).
[0110] In addition, when there are multiple different target virtual environments, a target virtual environment can also be recommended to the user according to the access preference of the accessing user. Those skilled in the art can implement intelligent navigation in a target virtual environment or between multiple target virtual environments in a variety of ways, and the present disclosure does not impose any special restrictions on this.
[0111] By introducing the smart guide function, we can provide customized cultural experience based on user preferences and historical information, thereby increasing user stickiness and engagement.
[0112] The target virtual environment generated by the method of the embodiment of the present disclosure can be displayed through a network platform and can be accessed by users through the network platform. The target virtual environment can be used to reproduce the original address of the immigrant community, and allow immigrants to visit the original address in a virtual space and interact with other immigrants, meet the needs of immigrants to access a specific target environment, and solve the technical problem that users cannot access a specific environment. Therefore, it can effectively solve the dilemma of immigrants who cannot quickly establish new social relationships after relocation, lack a sense of belonging, and have difficulty integrating into the cultural inheritance and communication of the new environment, thereby improving the user experience.
[0113] Corresponding to the above method embodiments, the present disclosure further provides a virtual reality device on which data is stored, and the data is used to enable the virtual reality device to present a target virtual environment generated by the virtual environment generation method as described in any of the above items.
[0114] In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.
[0115] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as a system, method or program product. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as a "circuit", "module" or "system".
[0116] Refer to the following Figure 6 The electronic device 600 according to this embodiment of the present invention is described. Figure 6 The electronic device 600 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.
[0117] like Figure 6 As shown, the electronic device 600 is in the form of a general computing device. The components of the electronic device 600 may include but are not limited to: at least one processing unit 610, at least one storage unit 620, and a bus 630 connecting different system components (including the storage unit 620 and the processing unit 610).
[0118] The storage unit stores program codes, which can be executed by the processing unit 610, so that the processing unit 610 performs the steps according to various exemplary embodiments of the present invention described in the above “Exemplary Method” section of this specification. For example, the processing unit 610 can perform the method shown in the embodiment of the present disclosure.
[0119] The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 6201 and / or a cache memory unit 6202 , and may further include a read-only memory unit (ROM) 6203 .
[0120] The storage unit 620 may also include a program / utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.
[0121] Bus 630 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
[0122] The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 600, and / or communicate with any device that enables the electronic device 600 to communicate with one or more other computing devices (e.g., routers, modems, etc.). This communication may be performed through an input / output (I / O) interface 650. In addition, the electronic device 600 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) through a network adapter 660. As shown, the network adapter 660 communicates with other modules of the electronic device 600 through a bus 630. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.
[0123] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes a number of instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation of the present disclosure.
[0124] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of the present specification.
[0125] The program product for implementing the above method according to an embodiment of the present invention can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto, and in this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.
[0126] The program product may be any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.
[0127] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.
[0128] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.
[0129] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).
[0130] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.
[0131] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are to be considered exemplary only, and the true scope and concept of the present disclosure are indicated by the claims.
Claims
1. A method for generating a virtual environment, characterized in that: include: Acquiring topographic data of the environment to be restored, and forming a virtual topographic data of the environment to be restored in a virtual space according to the topographic data; Acquire laser point cloud data of multiple acquisition objects of the environment to be restored, and reconstruct multiple virtual targets corresponding to the multiple acquisition objects on the virtual terrain through modeling according to the laser point cloud data, wherein the multiple acquisition objects include at least buildings, roads, and fixed facilities; Acquire texture data and image data of the multiple acquisition objects, and restore the appearance of the multiple virtual targets in the virtual space according to the texture data and image data to form a target virtual environment corresponding to the environment to be restored; In response to a user access message, the target virtual environment is presented to the accessing user in a stereoscopic visual manner through a virtual reality device; Forming the virtual topography of the environment to be restored in the virtual space according to the topography data includes: Processing and editing the terrain data, including smoothing, filling blank areas, and adjusting proportions, to better suit the needs of the virtual space; Automatically build virtual terrain based on imported terrain data; Reconstructing multiple virtual targets corresponding to the multiple acquisition objects on the virtual terrain through modeling according to the laser point cloud data includes: Processing the laser point cloud data, including denoising, filtering and alignment; Reconstruct the 3D model of the collected object based on the processed point cloud data, including connecting the point cloud points to create a surface or polygonal mesh, gradually rebuilding the shape and structure of the object. In the modeling process, automatically add details, modify the surface, adjust the smoothness of the surface, add textures, and adjust colors according to the properties of the collected object; Acquiring cultural and historical information of the environment to be restored, wherein the cultural and historical information includes traditional handicrafts, folk cultural activities, and historical events; The cultural history information is associated with the topographic data of the environment to be restored, the laser point cloud data, the texture data and the image data of the multiple acquisition objects in a database and stored; Setting a virtual object corresponding to the accessing user in the target virtual environment, wherein the virtual object is controlled by the accessing user to move in the target virtual environment and interact with non-player characters and / or other virtual objects; The interaction method includes the visiting user actively interacting with non-player characters and / or other virtual objects, the non-player characters automatically generating reply actions and reply languages based on analyzing the visiting user's actions and language, and inviting the visiting user to participate in humanistic activities with multiple non-player characters and / or other virtual objects.
2. The method for generating a virtual environment according to claim 1, wherein: Also includes: A plurality of non-player characters and virtual props are set in the target virtual environment according to the cultural history information, and the plurality of non-player characters operate the virtual props in the target virtual environment to restore at least one of the traditional handicraft, the folk cultural activities, and the historical events.
3. The method for generating a virtual environment according to claim 2, wherein: Also includes: A virtual object corresponding to the accessing user is set in the target virtual environment, wherein the virtual object is controlled by the accessing user to move in the target virtual environment and interact with the non-player character and / or other virtual objects.
4. The method for generating a virtual environment according to claim 1, wherein: The cultural history information includes regional cultural history information corresponding to the regional coordinates of the environment to be restored, and presenting the target virtual environment to the accessing user in a stereoscopic visual manner through a virtual reality device includes: Determine the virtual area currently visited by the visiting user according to the coordinates of the visiting user in the target virtual environment; After determining the area of the environment to be restored corresponding to the virtual area, determining the regional cultural history information corresponding to the area of the environment to be restored; The regional cultural history information is pushed to the visiting user in the target virtual environment.
5. The method for generating a virtual environment according to claim 1, wherein: Presenting the target virtual environment to the accessing user in a stereoscopic visual manner through a virtual reality device includes: Obtaining user information of the accessing user; Determining the access preference of the access user according to the user information; Generate a navigation route and / or access shortcut corresponding to the access user according to the access preference; The guided route and / or access shortcut is pushed to the visiting user in the target virtual environment.
6. The method for generating a virtual environment according to claim 1, wherein: The image data includes 360-degree static images, 360-degree videos, panoramic images, and historical photos.
7. An electronic device, characterized in that: include: Memory; as well as A processor coupled to the memory, the processor being configured to execute the method according to any one of claims 1 to 6 based on instructions stored in the memory.
8. A computer-readable storage medium having a program stored thereon, wherein when the program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.
9. A virtual reality device, characterized in that: Data is stored thereon, and the data is used to enable the virtual reality device to present a target virtual environment generated by the virtual environment generation method according to any one of claims 1-6.
Citation Information
Patent Citations
Data access control for augmented reality devices
US20230089622A1