Immersive house inspection method and device for hotel, storage medium and program product

Abstract

The invention discloses a hotel immersive house seeing method and device, a storage medium and a program product, immersive house seeing in hotel reservation is realized based on a head-mounted display device, and the method comprises the following steps: obtaining a request for opening an immersive space; loading a hotel room 3D model; adjusting the position and angle of the hotel room 3D model; starting a dynamic light simulation system; and monitoring space gestures and starting an interaction and dynamic effect simulation system. According to the immersive hotel room viewing method, the user can experience super-real virtual room viewing experience in an immersive manner in the hotel booking process by means of the head display device, especially the space size and content layout information of the room, the user can freely walk in the virtual room and browse the information in the room at 360 degrees without dead angles, and the user experience is improved. Various illumination effects in different time periods can be experienced, and natural interaction with virtual articles in a room is carried out; according to the invention, the hotel reservation experience of what you see is what you get is brought to the user, and powerful support is provided for the user to make a correct decision.

Description

Technical Field

[0001] The present invention relates to the field of hotel reservation, and in particular to an immersive hotel room viewing method, device, storage medium and program product. Background Art

[0002] Existing hotel booking platforms mainly rely on pictures, text descriptions, and short videos to display hotel room information. These display methods have the following limitations:

[0003] (1) It cannot provide a real spatial experience, and it is difficult for users to perceive the actual size and proportion of the room

[0004] (2) Static display cannot present the dynamic elements of the room and the lighting effects at different times

[0005] (3) Users cannot interact with the room environment, which leads to a lack of realism and immersion. Summary of the invention

[0006] In view of this, an embodiment of the present invention provides a hotel immersive house viewing method, device, storage medium and program product, which at least partially solve the problems existing in the prior art.

[0007] In a first aspect, an embodiment of the present invention provides an immersive hotel room viewing method, which implements immersive room viewing in hotel reservation based on a head-mounted display device, and the method includes:

[0008] Get a request to open the immersive space;

[0009] Load the hotel room 3D model;

[0010] Adjust the position and angle of the hotel room 3D model;

[0011] Turn on the dynamic lighting simulation system;

[0012] Spatial gesture monitoring and interaction and dynamic effect simulation system.

[0013] According to a specific implementation of an embodiment of the present invention, the loaded hotel room 3D model is constructed in the following manner:

[0014] Scan the hotel room with RoomPlan using a mobile device equipped with LiDAR to obtain a real-time basic model of the room. Based on the basic model, obtain the classification, location, and size of the furniture and items in the room. Use 3D modeling software to build a 3D model of the hotel room and use PBR rendering materials.

[0015] Before loading the hotel room 3D model, present or not present the loading animation; after the hotel room 3D model is loaded, initialize the hotel room 3D model as an entity Entity, and then add the entity to the scene provided by the immersive space.

[0016] According to a specific implementation method of an embodiment of the present invention, the file size of the loaded hotel room 3D model is optimized through texture packing, including putting the roughness, meta l and AO in the material into the three color channels of R, G and B in a picture.

[0017] According to a specific implementation of an embodiment of the present invention, adjusting the position and angle of the 3D model of the hotel room includes:

[0018] While obtaining a request to open the immersive space, call the head display device position API to monitor the real-time position changes of the head display device; calculate the user's current standing or sitting state, and fine-tune the x, y, and z axis positions of the hotel room 3D model in the immersive space to align the floor of the hotel room 3D model with the floor position in the user's real environment;

[0019] The position and direction of the door of the hotel room 3D model are used as the initialization position and direction of the hotel room 3D model;

[0020] When the hotel room 3D model is loaded into the immersive space, the hotel room 3D model is anchored at a fixed position on the user's real room map to achieve 360-degree browsing of various locations in the room without blind spots.

[0021] According to a specific implementation manner of an embodiment of the present invention, an explanation label is provided on the important furniture model of the 3D model of the hotel room, and the explanation label automatically rotates to face the user according to the real-time detection of the head display device.

[0022] According to a specific implementation method of an embodiment of the present invention, in the dynamic lighting simulation system, each hotel room 3D model pre-bakes two sets of lighting materials for daytime effects and nighttime effects. The windows and curtains of the hotel room 3D model simulate the light transmission effect of the real scene. Dynamic lighting is set outside the window to shine into the room through the window. The sunlight light source is turned on during the day and the moonlight light source is turned on at night.

[0023] According to a specific implementation of an embodiment of the present invention, the activation interaction and dynamic effect simulation system includes:

[0024] Based on Shader Graph, dynamic material switching is realized to simulate dynamic effects in real scenes; the dynamic effects include periodic flashing of the red warning light on the smoke alarm and the effect of running water from the faucet;

[0025] and / or, when a request to open the immersive space is obtained, the model entity of the tagged TV model is found, and the material of the model entity is replaced with a video player to implement a TV playback function;

[0026] and / or, after monitoring the user's first spatial gesture, reading out a model animation added to the 3D model of the hotel room and playing it; the model animation includes opening and closing curtains;

[0027] And / or, when the user's second space gesture is monitored, the user can interact naturally with the items in the room, including turning lights on and off and simulating phone calls;

[0028] And / or, control the play and pause of a spatial audio asset in a 3D model of a hotel room.

[0029] In a second aspect, an embodiment of the present invention provides a head mounted display device, the head mounted display device comprising:

[0030] at least one processor; and,

[0031] a memory communicatively connected to the at least one processor; wherein,

[0032] The memory stores instructions that can be executed by the at least one processor. When the instructions are executed by the at least one processor, the at least one processor implements the hotel immersive house viewing method described in any one of the first aspect or any one of the implementations of the first aspect.

[0033] In a third aspect, an embodiment of the present invention further provides a computer-readable storage medium, which stores computer instructions, and when the computer instructions are executed by at least one processor, the at least one processor executes the hotel immersive house viewing method in the aforementioned first aspect or any implementation of the first aspect.

[0034] In a fourth aspect, an embodiment of the present invention further provides a computer program product, which includes computer program instructions, and when the computer program instructions are executed by a processor, the hotel immersive house viewing method in the aforementioned first aspect or any implementation method of the first aspect is implemented.

[0035] The immersive hotel viewing method provided by the present invention can allow users to immersively experience a super-real virtual house viewing experience, especially the spatial dimensions and content layout information of the room, during the hotel booking process with the help of a head display device. Users can not only walk freely in the virtual room and browse the information in the room 360 degrees without dead angles, but also experience a variety of lighting effects at different time periods and interact naturally with virtual objects in the room. The present invention brings a WYSIWYG hotel booking experience to users, and provides strong support for users to make correct decisions. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The above is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0037] Figure 1 A schematic diagram of a process flow of an immersive hotel room viewing method provided by an embodiment of the present invention;

[0038] Figure 2 An overall architecture diagram of an immersive hotel room viewing method provided by an embodiment of the present invention;

[0039] Figure 3 A schematic diagram of a basic model for making provided by an embodiment of the present invention;

[0040] Figure 4 An initial house viewing location map of a user for immersive hotel house viewing provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0041] The embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0042] The following describes the embodiments of the present invention through specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work belong to the scope of protection of the present invention.

[0043] It should be noted that various aspects of the embodiments within the scope of the appended claims are described below. It should be apparent that the aspects described herein may be embodied in a wide variety of forms, and any specific structure and / or function described herein is merely illustrative. Based on the present invention, it should be understood by those skilled in the art that an aspect described herein may be implemented independently of any other aspect, and two or more of these aspects may be combined in various ways. For example, any number of aspects described herein may be used to implement the device and / or practice the method. In addition, other structures and / or functionalities other than one or more of the aspects described herein may be used to implement this device and / or practice this method.

[0044] Additionally, in the following description, specific details are provided to facilitate a thorough understanding of the examples. However, it will be understood by those skilled in the art that the aspects described may be practiced without these specific details.

[0045] The embodiment of the present invention provides an immersive hotel room viewing method, which breaks through the display mode of the existing hotel booking platform and realizes immersive room viewing in hotel booking based on a head-mounted display device. The core principle is to place a 1:1 highly restored 3D virtual high-definition model of the hotel room around the user at a certain position and angle, and then add some simulated interactions of real scenes, such as turning on and off lights, so that the user can browse the room more immersively.

[0046] The following is a detailed explanation using the Vision Pro head-mounted display device as an example.

[0047] Figure 1 A schematic diagram of a process flow of an immersive hotel room viewing method provided by an embodiment of the present invention; Figure 2 An overall architecture diagram of an immersive hotel room viewing method provided in an embodiment of the present invention.

[0048] refer to Figure 1 , 2 As shown, the method mainly includes the following steps S110-S150.

[0049] Step S110 obtains a request to open an immersive space.

[0050] Specifically, before loading the hotel room 3D model on Vision Pro, you must first open an ImmersiveSpace, which is an immersive space. When the immersive space is opened, Vision Pro allows only the loaded 3D model to be rendered, hiding the room information around the user. In this way, the immersive environment of the room model is built.

[0051] Next, go to step S120 to load the hotel room 3D model.

[0052] After the immersive space is successfully opened, the hotel room 3D model needs to be loaded. The format of the hotel room 3D model is preferably usdz, which is a compressed format and is more convenient for dissemination on the Internet. The 3D models of the hotel rooms are stored on the server. Before the loading is successful, it is preferred to present a loading animation to the user. Of course, the loading animation may not be presented; after the model is loaded, the model is initialized as an Entity, that is, an entity, and then the entity is added to the scene provided by the immersive space.

[0053] In the above steps, the core technical problem is how to provide a 3D model of a hotel room with high-precision scene restoration. The hard indicators for high-precision scene restoration are:

[0054] (1) The room dimensions and furniture layout information reflected by the model have an error of less than 5% compared with the real scene;

[0055] (2) The degree of restoration of the materials of furniture and items in the hotel room to the materials in the real hotel room is greater than 90%;

[0056] (3) The file size of the hotel room 3D model is less than 50MB.

[0057] In view of the above-mentioned indicator, the embodiment of the present invention has carried out secondary development of RoomPlan to realize the real-time and rapid construction of the basic model of the room, such as Figure 3 As shown. In addition, a scanning and recording function has been developed to facilitate 3D designers to carry out detailed modeling of furniture and other items in the later stage.

[0058] RoomPlan is a new technology introduced by Apple at the WWDC (Worldwide Developers Conference) in 2022. This is an API (application programming interface) that allows developers to create 3D room scanning applications on iOS devices that support LiDAR scanners.

[0059] Here are some of RoomPlan’s key features:

[0060] (1) 3D Scanning: Use the LiDAR scanner on iPhone and iPad to quickly create a 3D model of a room.

[0061] (2) Object recognition: Able to identify furniture and other objects in the room, such as doors, windows, sofas, etc.

[0062] (3) Dimension measurement: Automatically measure the dimensions of rooms and objects to provide accurate spatial information.

[0063] (4) Swift API: Provides iOS developers with an easy-to-use Swift API for easy integration into applications.

[0064] (5) Real-time feedback: Provide real-time visual feedback during the scanning process to help users understand the scanning progress.

[0065] (6) Data output: Generate output in a standard format that can be used in other 3D applications.

[0066] After obtaining the basic model of the hotel room, the accurate classification, location and size of the furniture and items in the room are also obtained. Next, 3D designers need to fine-tune these models to ensure that they are completely consistent with the real objects, and use PBR (physically based rendering) materials to accurately restore the material effects of various surfaces, so as to ensure that the material restoration degree is greater than 90%.

[0067] As can be seen above, the 3D model of the hotel room loaded above is constructed in the following way:

[0068] Through the mobile terminal with LiDAR, the hotel room is scanned based on RoomPlan to obtain the real-time basic model of the room, and the classification, location and size of the furniture and items in the room are obtained based on the basic model of the room; then the 3D modeling software is used to build a 3D model of the hotel room, and PBR rendering materials are used.

[0069] In order to optimize the file size of the 3D model of the hotel room, Texture packing technology was used. The core principle is to put the Roughness, Meta and AO in the material into the three color channels of R, G and B in one picture, so that only one material map is needed instead of three. Finally, ShaderGraph technology was used in Vision Pro to read the data. The model file size was optimized by about 40%.

[0070] Next, go to step S130 to adjust the position and angle of the 3D model of the hotel room.

[0071] In the above steps, a high-precision scene restoration 3D model of the hotel room is obtained. However, having a high-precision scene restoration model alone is far from enough. It is also necessary to ensure that the position and angle of the model around the user are consistent with the real scene. In essence, the floor of the 3D model of the hotel room should be aligned with the floor position in the user's real environment. This ensures that the user's immersion when viewing the room is in an optimal state.

[0072] To solve the above problems, when the immersive space is opened, the head display device position API is called to monitor the real-time position changes of the head display device. Then the user's current standing or sitting state is calculated, and the x, y, and z axis positions of the room model in the immersive space are fine-tuned to align the floor of the room 3D model with the floor position in the user's real environment.

[0073] There are also requirements for the angle of the room model. According to the actual experience of house viewing, the embodiment of the present invention places the user at the entrance to simulate the user's overview of the entire room at the entrance.

[0074] In order to solve the above problems, 3D designers need to use the position and direction of the room door as the initial position and direction of the hotel room 3D model when making the virtual model, such as Figure 4 As shown, with this setting, only the 3D model of the hotel room needs to be loaded, thus avoiding the performance waste of real-time rendering of the model.

[0075] As a preferred solution, explanatory texts are set on some important furniture models in the hotel rooms. Combined with the real-time detection function of the user's head-mounted display device, all these explanatory labels can automatically rotate to face the user, greatly improving the user experience.

[0076] In addition to the adaptation of position and angle, there is another important problem that needs to be solved. It is expected that users can browse the 3D model of the hotel room 360 degrees without blind spots, that is, to support users to roam in the room.

[0077] In order to solve the above problems, when the 3D model of the hotel room is loaded into the immersive space, that is, when it is placed in the space around the user, the model is anchored at a fixed position in the user's real room map. In other words, the model is absolutely stationary relative to the user's space. This allows the user to move freely with the headset and browse every location in the room in 360 degrees without blind spots.

[0078] Next, go to step S140 to start the dynamic lighting simulation system.

[0079] To further increase user immersion, simulating the lighting effects within the 3D model of the hotel room is also a key step. If all lights are baked into the material, only one state of the room can be simulated, just like an ordinary 2D photo, and the powerful mixed reality capabilities of the headset cannot be brought into play.

[0080] In order to solve the above problems, the embodiment of the present invention has developed a dynamic lighting simulation system. For each hotel room 3D model, two sets of lighting materials are pre-baked, one for daytime effects and the other for nighttime effects. The windows and curtains of the hotel room 3D model are designed to simulate the light transmission effect of real scenes, and then dynamic lighting is set outside the windows to illuminate the room through the windows. Sunlight is used as the light source during the day and moonlight is used as the light source at night. In this way, two states of lighting real scene simulation are realized, which greatly improves the user's immersion when viewing the room.

[0081] So far, the above embodiments have been able to provide users with a very immersive house viewing experience. However, compared with a real-world room, there is still room for further optimization. That is, the room is static. Even if different lighting effects can be simulated, there are many dynamic elements in a real-world room, such as the red warning light on the smoke alarm that flashes periodically, the running water effect of the faucet, and so on.

[0082] In order to solve the key technical problem of making the 3D model of the hotel room animated, an interactive and dynamic effects simulation system was developed based on the ShaderGraph technology provided by the system.

[0083] Therefore, the next step is to go to step S150 to monitor the spatial gesture and start the interaction and dynamic effect simulation system.

[0084] It mainly includes the following aspects:

[0085] (1) Based on Shader Graph, dynamic material switching is implemented to simulate various dynamic effects in real scenes (for example, the periodic flashing of the red warning light on a smoke alarm, the effect of running water from a faucet, etc.). Technically, this is essentially the material of the operating model.

[0086] (2) Add a video playback function to the TV model in the hotel's 3D room virtual model. The specific implementation is that the 3D designer tags the TV model in the hotel room, and then uses code to find the model entity of the tagged TV model when opening the immersive space, and replaces the material of the model entity with a video player, thus realizing the TV playback function.

[0087] (3) Add model animation to achieve effects similar to opening and closing curtains. The specific implementation is that the 3D designer adds model animation when making the model. Then, after the user triggers the spatial gesture, that is, when the user's first spatial gesture is monitored, the code is used to read the added model animation in the hotel room 3D model and then play it.

[0088] (4) Support natural interaction between users and room objects, such as turning lights on and off, simulating phone dialing, etc. Specifically, when the user's second space gestures are monitored, natural interaction between users and room objects is achieved, including turning lights on and off, and simulating phone dialing.

[0089] (5) Add spatial environment sound effects, such as the sound of air conditioning. The specific implementation is based on the spatial audio function provided by the head-mounted display device. Spatial audio resources are added to the model that needs to adapt to spatial audio, and code is used to control playback and pause.

[0090] The embodiment of the present invention realizes immersive browsing of a hotel through a software method on an existing MR mixed reality device, namely a head display device Vision Pro, without the need for a new hardware system design.

[0091] (1) To obtain the basic model of the 3D room model, you need to rely on a device that supports LiDAR, such as an iPhone, iPad, etc., and install the self-developed software based on RoomPlan to scan the room.

[0092] (2) The modeling of high-definition models requires the use of 3D modeling software, such as Blender.

[0093] (3) Use RealityKit in visionOS to render the model around the user and realize immersive house viewing based on the various spatial features provided by visionOS.

[0094] In summary, the immersive hotel viewing method provided by the embodiment of the present invention can allow users to immersively experience a super-real virtual house viewing experience, especially the spatial dimensions and content layout information of the room, during the hotel booking process with the help of a head display device. Users can not only walk freely in the virtual room and browse the information in the room 360 degrees without dead angles, but also experience a variety of lighting effects at different time periods and interact naturally with virtual items in the room. The present invention brings a WYSIWYG hotel booking experience to users, and provides strong support for users to make correct decisions.

[0095] The present invention realizes a truly immersive hotel viewing experience in a head-mounted display device, ensuring that the 3D virtual room model highly restores the real scene in terms of size, material, furniture, lighting, etc.; and can adjust the position and viewing angle of the 3D virtual room model in the immersive mode according to the user's head display position and height; it can also simulate natural lighting and artificial lighting effects at different time periods through dynamic light sources and light baking technology, and realize the interaction and animation effects of dynamic elements in the room, thereby enhancing the realism and immersion of the scene.

[0096] An embodiment of the present invention further provides a head-mounted display device, the head-mounted display device comprising:

[0097] at least one processor; and,

[0098] a memory communicatively connected to the at least one processor; wherein,

[0099] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the hotel immersive house viewing method in the aforementioned method embodiment.

[0100] An embodiment of the present invention also provides a computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable the computer to execute the hotel immersive house viewing method in the aforementioned method embodiment.

[0101] An embodiment of the present invention further provides a computer program product, which includes computer program instructions. When the computer program instructions are executed by a processor, the hotel immersive house viewing method in the aforementioned method embodiment is implemented.

[0102] In particular, according to an embodiment of the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network, or installed from a storage device. When the computer program is executed by a processing device, the above-mentioned functions defined in the method of the embodiment of the present invention are executed.

[0103] It should be noted that the computer-readable medium of the present invention can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal can take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0104] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0105] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: obtains at least two Internet Protocol addresses; sends a node evaluation request including the at least two Internet Protocol addresses to a node evaluation device, wherein the node evaluation device selects an Internet Protocol address from the at least two Internet Protocol addresses and returns it; receives the Internet Protocol address returned by the node evaluation device; wherein the obtained Internet Protocol address indicates an edge node in a content distribution network.

[0106] Alternatively, the computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device: receives a node evaluation request including at least two Internet Protocol addresses; selects an Internet Protocol address from the at least two Internet Protocol addresses; and returns the selected Internet Protocol address; wherein the received Internet Protocol address indicates an edge node in a content distribution network.

[0107] Computer program code for performing the operations of the present invention may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0108] The flow chart and block diagram in the accompanying drawings illustrate the possible implementation architecture, function and operation of the method and computer program product according to various embodiments of the present invention. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0109] The units involved in the embodiments of the present invention may be implemented by software or hardware, wherein the name of a unit does not limit the unit itself in some cases.

[0110] It should be understood that various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof.

[0111] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed by the present invention should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A hotel immersive house viewing method, characterized in that: Immersive room viewing in hotel reservation is realized based on a head-mounted display device, and the method includes: Get a request to open the immersive space; Load the hotel room 3D model; Adjust the position and angle of the hotel room 3D model; Turn on the dynamic lighting simulation system; Spatial gesture monitoring and interaction and dynamic effect simulation system.

2. The immersive hotel house viewing method according to claim 1, characterized in that: The loaded hotel room 3D model is constructed in the following way: Scan the hotel room with RoomPlan using a mobile device equipped with LiDAR to obtain a real-time basic model of the room. Based on the basic model, obtain the classification, location, and size of the furniture and items in the room. Use 3D modeling software to build a 3D model of the hotel room and use PBR rendering materials. Before loading the hotel room 3D model, present or not present a loading animation; after the hotel room 3D model is loaded, initialize the hotel room 3D model as an entity Entity, and then add the entity to the scene provided by the immersive space.

3. The immersive hotel house viewing method according to claim 1, characterized in that: The file size of the loaded hotel room 3D model is optimized through texture packing, including putting the roughness, metal and AO in the material into the three color channels of R, G and B in one image.

4. The immersive hotel house viewing method according to claim 1, characterized in that: The adjustment of the position and angle of the hotel room 3D model includes: While obtaining a request to open the immersive space, call the HMD device location API to monitor the real-time location changes of the HMD device; calculate the user's current standing or sitting state, and fine-tune the x, y, and z axis positions of the 3D hotel room model in the immersive space to align the floor of the 3D hotel room model with the floor position in the user's real environment; The position and direction of the door of the hotel room 3D model are used as the initialization position and direction of the hotel room 3D model; When the hotel room 3D model is loaded into the immersive space, the hotel room 3D model is anchored at a fixed position on the user's real room map to achieve 360-degree browsing of various locations in the room without blind spots.

5. The immersive hotel house viewing method according to claim 4, characterized in that: Description labels are provided on the important furniture models of the 3D model of the hotel room, and the description labels are automatically rotated to face the user according to the real-time detection of the head display device.

6. The immersive hotel house viewing method according to claim 1, characterized in that: In the dynamic lighting simulation system, each hotel room 3D model pre-bakes two sets of lighting materials for daytime effects and nighttime effects. The windows and curtains of the hotel room 3D model simulate the light transmission effect of real scenes. Dynamic lighting is set outside the windows to shine into the room through the windows. The sunlight light source is turned on during the day and the moonlight light source is turned on at night.

7. The immersive hotel house viewing method according to claim 1, characterized in that: The opening interaction and dynamic effect simulation system comprises: Based on Shader Graph, dynamic material switching is realized to simulate dynamic effects in real scenes; the dynamic effects include periodic flashing of the red warning light on the smoke alarm and the effect of running water from the faucet; and / or, when a request to open the immersive space is obtained, the model entity of the tagged TV model is found, and the material of the model entity is replaced with a video player to implement a TV playback function; and / or, after monitoring the user's first spatial gesture, reading out a model animation added to the 3D model of the hotel room and playing it; the model animation includes opening and closing curtains; And / or, when the user's second space gesture is monitored, the user can interact naturally with the items in the room, including turning lights on and off and simulating phone calls; And / or, control the play and pause of a spatial audio asset in a 3D model of a hotel room.

8. A head mounted display device, characterized in that: The head display device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and when the instructions are executed by the at least one processor, the at least one processor executes the hotel immersive house viewing method as described in any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, which, when executed by at least one processor, cause the at least one processor to perform the hotel immersive house viewing method as described in any one of claims 1 to 7.

10. A computer program product, characterized in that The computer program product includes computer program instructions, and when the computer program instructions are executed by a processor, the hotel immersive house viewing method according to any one of claims 1 to 7 is implemented.

Images