A VR house viewing cloud exhibition hall system based on metaverse model and its metaverse system

Through the VR house viewing cloud exhibition hall system based on the metaverse model, combined with 3Ds Max, AutoCAD and Unity 3D engines, the problems of poor immersion and high resource consumption in virtual house viewing are solved, and efficient virtual scene display and interactive operation are achieved. Improve user experience and computing efficiency.

CN118521697BActive Publication Date: 2024-11-05FUZHOU CONSTR BIG DATA TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410972031.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-07-19
Publication Date
2024-11-05
Estimated Expiration
2044-07-19

AI Technical Summary

Technical Problem

The existing VR technology has poor immersion in virtual house viewing, consumes a lot of rendering and computing resources, making it difficult to accurately present real virtual scenes, and buyers cannot objectively understand the advantages and disadvantages of houses and conduct rational analysis.

Method used

Using the VR house viewing cloud exhibition hall system based on the metaverse model, virtual house models are generated through 3Ds Max and AutoCAD, combining the Unity 3D engine and Google CardBoard SDK to achieve efficient integration of virtual houses and furniture, and adopt directional light sources and light rays. Tracking technology performs optical rendering, sets a collision detection mechanism, optimizes model face number and maps, reduces rendering resource consumption, and provides an interactive operation mechanism to improve user experience.

Benefits of technology

It improves the immersion and interactive accuracy of virtual house viewing, reduces the consumption of rendering computing resources, reduces the burden on processors and GPUs, and improves the overall computing efficiency and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118521697B_ABST
    Figure CN118521697B_ABST
Patent Text Reader

Abstract

The invention discloses a metaverse model-based VR house viewing cloud exhibition hall and a metaverse system thereof, belonging to the field of virtual visual technology, a virtual house model framework module, which adopts 3Ds Max and AutoCAD for joint modeling, uses AutoCAD to draw a planning diagram of a house model room, imports the planning diagram into 3Ds Max to generate a virtual house model according to the planning diagram; a virtual furniture model framework module, which adopts 3Ds Max for modeling to generate a furniture model; during modeling, the lines that affect the appearance of the model outer frame are retained, the lines that do not affect the appearance are deleted and optimized to a low-precision model, and the corresponding body structure and light and shadow effect information of the high-precision model before optimization are retained and generated by translating, and then the texture is assigned to the optimized low-precision model, thereby improving the visual effect of the low-precision model while reducing the consumption of rendering computing resources; and triggering a virtual key mode by gazing to improve the interaction accuracy and reduce the complexity of the interaction operation, thereby improving the user's immersion and experience of the interaction operation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention discloses a virtual vision technology, and more particularly relates to a metaverse model-based VR house viewing cloud exhibition hall system and a metaverse system thereof. Background Art

[0002] The metaverse refers to a virtual world constructed by humans using digital technology, which maps or transcends the real world and can interact with the real world. It is a digital living space with a new social system.

[0003] At present, virtual reality technology has already touched the field of virtual exhibition halls and has been sought after by a large number of users. This form is different from the previous dull reproduction methods such as pictures and videos. The audience does not need to be physically present at the scene, but can achieve an immersive feeling by watching through online operations.

[0004] Among them, for the real estate industry, house viewing is a direct way for buyers to choose houses, but when viewing houses, they need to go to the community one by one to view them, which takes up a lot of time and energy of buyers; and for the source of houses, buyers are limited by time and other conditions, and cannot objectively and professionally know the pros and cons of the source of houses, and cannot make a rational analysis of the structure of the house and the subsequent decoration design prediction. They can only make subjective judgments, resulting in information asymmetry. The existing VR headsets use VR technology for virtual house viewing, but the virtual scene display method displayed by the existing VR technology has a poor sense of immersion; the use of high-precision models requires a lot of rendering computing resources. In order to save resources, some 3D renderings such as furniture and house structures use static frame (non-real-time) rendering, which is difficult to accurately present a more realistic virtual scene to buyers. Summary of the invention

[0005] The purpose of the present invention is to solve the above-mentioned problems and provide a metaverse model-based VR house viewing cloud exhibition hall system and its metaverse system.

[0006] To achieve the above purpose, the present invention provides the following technical solutions: a VR house viewing cloud exhibition hall system based on the metaverse model, comprising the following modules:

[0007] The virtual house model framework module adopts 3Ds Max and AutoCAD for joint modeling. The planning diagram of the house model room is drawn by AutoCAD, and the planning diagram is imported into 3Ds Max to generate a virtual house model according to the planning diagram.

[0008] Virtual furniture model framework module, which uses 3Ds Max modeling to generate furniture models;

[0009] The cloud display module uses the Unity 3D engine to integrate furniture models and virtual house models, arrange and adjust the angles according to the plan of the house model room, and build the EventSystem component through the Google CardBoard SDK;

[0010] Virtual reality human-computer interaction module, which includes a VR head display and an interactive handle;

[0011] The cloud display module is provided with a light source setting, which adopts a directional light source, performs global light rendering on the outdoor outside the virtual house model, and uses ray tracing to fill light indoors. The cloud display module has a collision detection mechanism:

[0012] Y1, when the light source is set to fill the indoor light, a snapshot of the indoor light after global light rendering will be recorded in snapshot mode;

[0013] Y2, light source setting: obtain the lighting entity of the virtual house model and furniture model in space through the ray tracing feedback obtained by supplementing the virtual house model and furniture model with the indoor light snapshot, record the lighting entity, and set the trigger area with the area where the lighting entity is formed. The trigger area is larger than the area where the lighting entity is formed, and set the point threshold area between the lighting entity and the trigger area boundary;

[0014] Y3, the light source setting defines the user model as a trigger body. When the trigger body enters the trigger area, the indoor interactive display system triggers the collision detection of the trigger area, and compares the point threshold area of ​​the trigger body intruding into the trigger area with the initially recorded lighting entity. When the trigger body intrusion into the trigger area is greater than the point threshold area, the collision mechanism of the lighting entity is triggered, and it is determined that the user model cannot continue to move to the area where the lighting entity is formed. The user model activity is restricted and cannot move to a position that tends to increase the intrusion trigger area; when the user model activity tends to reduce the intrusion trigger area, the user model activity is unrestricted.

[0015] A metaverse system includes a metaverse model-based VR house viewing cloud exhibition hall system, which has an indoor interactive display system. The indoor interactive display system includes a virtual roaming module and a VR interaction module. The virtual roaming module includes camera roaming and walking roaming, and the VR interaction module includes a furniture transformation unit and a background transformation unit.

[0016] Preferably, the furniture transformation unit and the background transformation unit have an interactive operation mechanism, and the process is as follows:

[0017] K1, when a user walks in a virtual house model wearing a VR headset and an interactive handle, if the visual center is detected to be looking at a changeable furniture or interior, the furniture or interior will be highlighted and a virtual button for clicking to change the furniture or interior will appear;

[0018] K2, if you click the confirmation button of the interactive handle, the furniture or interior will become an alternative option, and other replaceable furniture or interior models will appear. Select the corresponding furniture or interior model to replace the current furniture or interior.

[0019] Preferably, the interactive handle and the VR head display have a gaze-triggered virtual key mode for the confirmation button, and the process is as follows:

[0020] M1, the VR headset is equipped with a visual tracking unit that can track the eyeballs. The visual tracking unit captures the center point where the left and right eyeballs meet and generates an aiming crosshair;

[0021] An aiming crosshair touch area will be generated near the virtual button in M2 and K1. When the aiming crosshair stays in the touch area for 3 seconds, it will be automatically identified as the trigger confirmation button.

[0022] Compared with the prior art, the present invention has the following beneficial effects:

[0023] During modeling, the lines that affect the shape of the model frame are retained, and the lines that do not affect the shape are deleted to optimize it into a low-precision model. The corresponding body structure and light and shadow effect information of the high-precision model before optimization are retained and the texture generated by translating is assigned to the optimized low-precision model, thereby improving the visual effect of the low-precision model while reducing the consumption of rendering computing resources; the virtual button mode is triggered by gaze to improve the interaction accuracy and reduce the complexity of the interaction, thereby enhancing the user's immersion and experience of the interaction operation; during collision detection, the virtual house model and furniture model are set to use the user model as the trigger body to compare the threshold area of ​​the trigger point when invading the trigger area, which can reduce the processing burden of the processor and GPU graphics card, thereby improving the overall computing and output efficiency and reducing the occupation of computing resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 A diagram showing the use of triangles and polygons as the units of face counting for 3D models;

[0025] Figure 2 Demonstration diagram for optimizing and reducing the number of model faces for the example model;

[0026] Figure 3 A working diagram of the aiming crosshairs approaching the touch area;

[0027] Figure 4 A demonstration diagram of the relationship between the distance and size of the aiming crosshair;

[0028] Figure 5 This is a demonstration diagram of the BIM virtual scene;

[0029] Figure 6 After selecting the furniture, the demonstration picture is highlighted;

[0030] Figure 7 The interface demonstration diagram is an interactive operation mechanism of the furniture transformation unit and the background transformation unit;

[0031] Figure 8 Modeling diagram of BIM virtual scene;

[0032] Fig. 9 This is a schematic diagram of the light probe settings in the static lighting in the light source settings;

[0033] Fig.10 This is a schematic diagram of the reflection probe settings;

[0034] Fig.11 A schematic diagram of the collision detection mechanism. DETAILED DESCRIPTION

[0035] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the drawings in the embodiments of the present invention. In the description of the present invention, it should be understood that the terms "upper", "lower", "front", "back", "left", "right", "top", "bottom", "inside", "outside" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, which are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0036] Example 1

[0037] A VR house viewing cloud exhibition hall system based on a metaverse model and its metaverse system, such as Figure 5 and Figure 8 As shown, it includes the following modules:

[0038] The virtual house model framework module adopts 3Ds Max and AutoCAD for joint modeling. The planning diagram of the house model room is drawn by AutoCAD, and the planning diagram is imported into 3Ds Max to generate a virtual house model according to the planning diagram.

[0039] Virtual furniture model framework module, which uses 3Ds Max modeling to generate furniture models;

[0040] The cloud display module uses the Unity 3D engine to integrate furniture models and virtual house models, arrange and adjust the angles according to the plan of the house model room, and build the EventSystem component through the Google CardBoard SDK;

[0041] Virtual reality human-computer interaction module, which includes a VR head display and an interactive handle;

[0042] The cloud display module builds the BIM virtual scene through the cloud server's processor and rendering graphics card, and transmits the display data stream to the VR headset through the cloud server;

[0043] The model created by the Unity 3D engine is configured using an optimized model. The configuration method of the optimized model is as follows:

[0044] S1, reduce the number of model faces, keep the lines that affect the shape of the model frame during poly modeling, delete the lines that do not affect the shape inside and optimize it into a low-precision model;

[0045] like Figure 1 The 3D model uses triangles and polygons as the counting units of the number of faces. A rectangular face is counted as 1 polygon and 2 triangles. For example, the model is optimized to a low-precision model. Figure 2 As shown in the figure, the model composed of 5 cuboids has 22 polygons and 44 triangular faces. The internal lines that have no effect on the shape are deleted, and the lines that affect the shape are retained to ensure that the shape remains unchanged. After optimization, it becomes 14 polygons and 28 triangular faces, reducing unnecessary faces and preserving the shape of the model.

[0046] S2, texture generation, using 3Ds Max to translate the shape structure and light and shadow effect information corresponding to the high-precision model before poly modeling to generate a texture;

[0047] S3, texture baking, assigns the texture mapping generated by S2 to the low-precision model in S1 to bake the UV texture;

[0048] The low-precision model obtained by S1 optimization alone cannot guarantee a high visual effect. Therefore, the body structure and light and shadow effect information of the high-precision model before optimization are retained and translated into two types of maps: normal map and environment map.

[0049] Among them, the normal map is a special two-dimensional map, which is technically expressed as a concave-convex texture extension. In fact, it is to locally raise and lower the points on the flat surface. The concave-convex changes can be over-smoothed and can be applied to the special texture of the 3D model surface. The height information can produce corresponding light and shadow and reflection changes under different light sources, so that the low-precision model has similar visual details to the high-precision model while reducing the consumption of rendering computing resources.

[0050] The environment map stores the brightness and darkness information of light and shadow, which is actually the GI global light effect with ray tracing. After the brightness and darkness information of light and shadow is given to the low-precision model, it can improve the three-dimensional sense, visual effect and details of the low-precision model. It can be used as a mask, attached to the model to show the corresponding changes in light and dark contrast without the help of light source, thereby reducing the consumption of rendering computing resources.

[0051] When the Unity 3D engine integrates the furniture model and the virtual house model, it uses the shader to set up the material editor, imports the normal map and environment map into the corresponding configuration of the model, and matches the corresponding material properties of the generated model according to the actual light source settings and color settings.

[0052] Example 2

[0053] A metaverse system, including a VR house viewing cloud exhibition hall system based on a metaverse model, which has an indoor interactive display system, wherein the indoor interactive display system includes a virtual roaming module and a VR interactive module, the virtual roaming module includes camera roaming and walking roaming, and the VR interactive module includes a furniture transformation unit and a background transformation unit;

[0054] The furniture transformation unit and the background transformation unit have an interactive operation mechanism, and the process is as follows:

[0055] K1, when a user wears a VR headset and an interactive handle and walks in a virtual house model, when the visual center is detected to be looking at a changeable furniture or interior, the furniture or interior will be highlighted and a virtual button for clicking to change the furniture or interior will appear, such as Figure 6 and Figure 7 As shown;

[0056] K2, if you click the confirmation button of the interactive handle, the furniture or interior will become an alternative option, and other furniture or interior models that can be replaced will appear. Select the corresponding furniture or interior model to replace the current furniture or interior;

[0057] The interactive handle and VR headset have a gaze-triggered virtual key mode for the confirmation button, and the process is as follows:

[0058] M1, the VR headset is equipped with a visual tracking unit that can track the eyeballs. The visual tracking unit captures the center point where the left and right eyeballs meet and generates an aiming crosshair;

[0059] A touch area for the aiming crosshairs will be generated near the virtual buttons in M2 and K1. When the aiming crosshairs stays in the touch area for 3 seconds, it will be automatically identified as a trigger confirmation button.

[0060] like Figure 3The figure shows a schematic diagram of the area where the aiming crosshairs are close to the touch area. By giving the user a certain reaction time, the user is prevented from making an erroneous operation due to delayed reaction. The trigger operation can be canceled as long as the aiming crosshairs formed by the center point of the intersection of the sights are moved away within 3 seconds. While simplifying the interactive operation process, the user's immersive experience is improved. The aiming crosshairs are set to have a certain depth, that is, the size of the aiming crosshairs can be changed according to the distance, such as Figure 4 As shown, this avoids the situation of multiple selections or failure to select in the scene where multiple interactive targets overlap, and the highlighting can further confirm the selection of the interactive object;

[0061] like Figure 5 As shown, the cloud display module is provided with a light source setting, which adopts a directional light source, and performs global light rendering on the outdoor outside the virtual house model, and uses ray tracing to fill the indoor light, that is, the directional light adopts celestial lighting, such as daylight as the single and only main light source, and the shadow produced by the directional light marks the light and shadow depth at that place, predicts the center of the Z-axis direction of the light, and enters a light and shadow cycle repetition mode. The user can walk around in the virtual house model and feel the light and shadow changes of the scene, thereby improving the realism and detail of the virtual roaming, and the parallel light main light source is unique, which can reduce the consumption of global rendering computing resources.

[0062] like Fig. 9 and Fig.10 As shown in the figure, it is a schematic diagram of the setting of light probes in the static lighting in the light source setting. In combination with the reflection probe, the light probe is set at the location where the light changes intensively on the surface of the object, that is, the location where the shadows intersect and the color changes. No light probe is set at the part of the furniture against the wall or the bottom close to the ground to reduce the consumption of rendering computing resources.

[0063] like Fig.11 As shown, the cloud display module has a collision detection mechanism:

[0064] Y1, when the light source is set to fill the indoor light, a snapshot of the indoor light after global light rendering will be recorded in snapshot mode;

[0065] Y2, light source setting: obtain the lighting entity of the virtual house model and furniture model in space through the ray tracing feedback obtained by supplementing the virtual house model and furniture model with the indoor light snapshot, record the lighting entity, and set the trigger area with the area where the lighting entity is formed. The trigger area is larger than the area where the lighting entity is formed, and set the point threshold area between the lighting entity and the trigger area boundary;

[0066] The illumination entity is a light and shadow overlapping body with a light-blocking area under global illumination; the periphery of the trigger area is set to 1.2-1.5 times the area where the illumination entity is formed, and the point threshold area is set to 20% of the area between the trigger area and the illumination entity. The trigger body corresponding to the user model is a fixed size;

[0067] Y3, the light source setting defines the user model as a trigger body. When the trigger body enters the trigger area, the indoor interactive display system triggers the collision detection of the trigger area, and compares the threshold area of ​​the point where the trigger body invades the trigger area with the initial recorded illumination entity. When the trigger body invades the trigger area greater than the threshold area of ​​the point, the collision mechanism of the illumination entity is triggered, and it is determined that the user model cannot continue to move to the area where the illumination entity is formed. The user model activity is restricted and cannot move to a position that tends to increase the intrusion trigger area; when the user model activity tends to reduce the intrusion trigger area, the user model activity is unrestricted;

[0068] If the furniture model is changed, the user model will be ignored and global illumination will be performed again to record the current lighting entity, regenerate the trigger area and the judgment point threshold area;

[0069] The virtual house model and furniture model are generated by texture rendering and have no entity attributes. They are essentially texture shells. If an entity model is set, it will increase the rendering complexity of the GPU graphics card and occupy more resources. Setting the virtual house model and furniture model to use the user model as the trigger body to compare the threshold area of ​​the trigger point when invading the trigger area can reduce the processing burden of the processor and GPU graphics card, thereby improving the overall computing and output efficiency and reducing the occupation of computing resources.

[0070] It will be apparent to those skilled in the art that the invention is not limited to the details of the exemplary embodiments described above and that the invention can be implemented in other specific forms without departing from the spirit or essential features of the invention. Therefore, the embodiments should be considered exemplary and non-limiting in all respects, and the scope of the invention is defined by the appended claims rather than the foregoing description, and it is intended that all variations falling within the meaning and scope of the equivalent elements of the claims be included in the invention. Any reference numeral in a claim should not be considered as limiting the claim to which it relates.

[0071] In addition, it should be understood that although the present specification is described according to implementation modes, not every implementation mode contains only one independent technical solution. This description of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each embodiment may also be appropriately combined to form other implementation modes that can be understood by those skilled in the art.

Claims

1. A VR house viewing cloud exhibition hall system based on the metaverse model, It is characterized in that Includes the following modules: The virtual house model framework module adopts 3Ds Max and AutoCAD for joint modeling. The planning diagram of the house model room is drawn by AutoCAD, and the planning diagram is imported into 3Ds Max to generate a virtual house model according to the planning diagram. Virtual furniture model framework module, which uses 3Ds Max modeling to generate furniture models; The cloud display module uses the Unity 3D engine to integrate furniture models and virtual house models, arrange and adjust the angles according to the plan of the house model room, and build the EventSystem component through the Google CardBoard SDK; Virtual reality human-computer interaction module, which includes a VR head display and an interactive handle; The cloud display module constructs a BIM virtual scene through the cloud server's processor and rendering graphics card, and transmits the display data stream to the VR headset through the cloud server; The model established by the Unity 3D engine is configured using an optimized model, and the configuration method of the optimized model is as follows: S1, reduce the number of model faces, keep the lines that affect the shape of the model frame during poly modeling, delete the lines that do not affect the shape inside and optimize it into a low-precision model; S2, texture generation, using 3Ds Max to translate the shape structure and light and shadow effect information corresponding to the high-precision model before poly modeling to generate a texture; S3, texture baking, assigns the texture mapping generated by S2 to the low-precision model in S1 to bake the UV texture; The cloud display module is provided with a light source setting, which adopts a directional light source, performs global light rendering on the outdoor outside the virtual house model, and uses ray tracing to fill light indoors. The cloud display module has a collision detection mechanism: Y1, when the light source is set to fill the indoor light, a snapshot of the indoor light after global light rendering will be recorded in snapshot mode; Y2, light source setting: obtain the lighting entity of the virtual house model and furniture model in space through the ray tracing feedback obtained by supplementing the virtual house model and furniture model with the indoor light snapshot, record the lighting entity, and set the trigger area with the area where the lighting entity is formed. The trigger area is larger than the area where the lighting entity is formed, and set the point threshold area between the lighting entity and the trigger area boundary; Y3, the light source setting defines the user model as a trigger body. When the trigger body enters the trigger area, the indoor interactive display system triggers the collision detection of the trigger area, and compares the point threshold area of ​​the trigger body intruding into the trigger area with the initially recorded lighting entity. When the trigger body intrusion into the trigger area is greater than the point threshold area, the collision mechanism of the lighting entity is triggered, and it is determined that the user model cannot continue to move to the area where the lighting entity is formed. The user model activity is restricted and cannot move to a position that tends to increase the intrusion trigger area; when the user model activity tends to reduce the intrusion trigger area, the user model activity is unrestricted.

2. A metaverse system, It is characterized in that It includes the metaverse model-based VR house viewing cloud exhibition hall system as described in claim 1, which has an indoor interactive display system, and its indoor interactive display system includes a virtual roaming module and a VR interaction module, the virtual roaming module includes camera roaming and walking roaming, and the VR interaction module includes a furniture transformation unit and a background transformation unit.

3. A metaverse system according to claim 2, It is characterized in that The furniture transformation unit and the background transformation unit have an interactive operation mechanism, and the process is as follows: K1, when a user walks in a virtual house model wearing a VR headset and an interactive handle, if the visual center is detected to be looking at a changeable furniture or interior, the furniture or interior will be highlighted and a virtual button for clicking to change the furniture or interior will appear; K2, if you click the confirmation button of the interactive handle, the furniture or interior will become an alternative option, and other replaceable furniture or interior models will appear. Select the corresponding furniture or interior model to replace the current furniture or interior.

4. A metaverse system according to claim 3, It is characterized in that The interactive handle and the VR head display have a gaze-triggered virtual key mode for the confirmation button, and the process is as follows: M1, the VR headset is equipped with a visual tracking unit that can track the eyeballs. The visual tracking unit captures the center point where the left and right eyeballs meet and generates an aiming crosshair; An aiming crosshair touch area will be generated near the virtual button in M2 and K1. When the aiming crosshair stays in the touch area for 3 seconds, it will be automatically identified as the trigger confirmation button.