A house real scene picture display method and device, a terminal device and a storage medium

Abstract

The application provides a house real scene picture display method and device, terminal equipment and storage medium. The method comprises the following steps: receiving a viewing instruction for a target house, loading and displaying a three-dimensional panoramic image in the target house, and displaying a house type thumbnail of the target house in a thumbnail frame in a display interface of the three-dimensional panoramic image; in response to receiving a viewing instruction for the house type thumbnail in the display interface of the three-dimensional panoramic image, jumping to a display interface of a house type drawing of the target house, wherein an initial display orientation of the house type drawing is consistent with a display orientation of the three-dimensional panoramic image; obtaining a shooting point of the three-dimensional panoramic image currently displayed in the display interface of the three-dimensional panoramic image, and marking a real scene area included in the display interface of the three-dimensional panoramic image on the house type drawing in the display interface of the house type drawing according to the shooting point. Through the visual angle linkage of the house type drawing and the three-dimensional real scene image, the visual experience of the user and the online house viewing efficiency are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of picture processing, and in particular to a house real scene picture display method and device, a terminal device and a storage medium. BACKGROUND

[0002] Traditional online house viewing adopts the form of pictures or videos, and the effective information that can be obtained is extremely limited. The photo scale is distorted, a large number of details are missing, and the photo and the house type lack a correlation. In the actual house searching process, the user needs to fully understand the overall appearance of the house and the overall space structure, so as to select a house that meets his own needs. In order to meet the needs of the user, the real estate agent usually shoots a house real scene picture on site for the user to refer to.

[0003] However, the real scene picture shot by the real estate agent can only present part of the house real scene, and it is difficult to completely show the overall appearance of the house to the user. Therefore, this not only wastes the effort of the agent to shoot on site, but also cannot significantly improve the efficiency of the user's house selection, and the one-sided real scene information may also mislead the user's house selection. SUMMARY

[0004] The embodiments of the present application provide a house real scene picture display method and device, a terminal device and a storage medium, to solve the problem that the existing house display method is difficult to comprehensively and truly present the house real scene, which easily affects the efficiency of the user's house selection and misleads the user's house selection.

[0005] In order to solve the above technical problems, the present application is implemented as follows:

[0006] In a first aspect, the embodiments of the present application provide a house real scene picture display method, comprising:

[0007] receiving a viewing instruction for a target house, loading and displaying a three-dimensional panorama image in the target house, and displaying a house type thumbnail of the target house in a thumbnail frame in the display interface of the three-dimensional panorama image, the house type thumbnail comprising a 3D house type thumbnail and / or a 2D house type thumbnail;

[0008] in response to receiving a viewing instruction for the house type thumbnail in the display interface of the three-dimensional panorama image, jumping to a display interface of a house type drawing of the target house, wherein the house type drawing comprises a 3D house type drawing and a 2D house type drawing, and in the display interface of the house type drawing, the initial display orientation of the house type drawing is consistent with the display orientation of the three-dimensional panorama image;

[0009] acquire a shooting point of a three-dimensional panoramic image currently displayed in a display interface of the three-dimensional panoramic image, and mark a real scene area included in the display interface of the three-dimensional panoramic image on the floor plan of the target house in the display interface of the floor plan of the target house according to the shooting point.

[0010] Optionally, the step of receiving a viewing instruction for a target house, loading and displaying a three-dimensional panoramic image in the target house, and displaying a floor plan thumbnail of the target house in a thumbnail frame in a display interface of the three-dimensional panoramic image comprises:

[0011] receiving a viewing instruction for a target house, loading model data of the target house, the model data comprising 3D floor plan data of the target house and a three-dimensional panoramic image of each room;

[0012] generating a 3D floor plan of the target house and a 2D floor plan of the target house according to the 3D floor plan data of the target house;

[0013] establishing a first correlation between a 3D floor plan of each room in the 3D floor plan of the target house and the three-dimensional panoramic image in the model data;

[0014] scaling down the 3D floor plan and / or the 2D floor plan of the target house to the thumbnail frame to generate a 3D floor plan thumbnail and / or a 2D floor plan thumbnail of the target house;

[0015] displaying the three-dimensional panoramic image in the model data, and displaying the 3D floor plan thumbnail and / or the 2D floor plan thumbnail of the target house in the thumbnail frame in the display interface of the three-dimensional panoramic image.

[0016] Optionally, the step of generating a 3D floor plan of the target house and a 2D floor plan of the target house according to the floor plan data of the target house comprises:

[0017] rendering a 3D model of each room according to the 3D floor plan data of each room, splicing the 3D model of each room to obtain a 3D model of the target house;

[0018] drawing a plane 2D projection corresponding to the 3D model of the target house by using wall data in the 3D floor plan data;

[0019] establishing a second correlation between the 3D model of the target house and the plane 2D projection, so that each room in the plane 2D projection and each room in the 3D model of the target house correspond to each other according to the second correlation to establish the 3D floor plan of the target house;

[0020] The planar 2D projection, which is associated with the 3D model of the target house, is used as the 2D floor plan of the target house.

[0021] Optionally, after the step of responding to receiving a viewing instruction for the floor plan thumbnail in the display interface of the 3D panoramic image and jumping to the display interface of the floor plan of the target house, the method further includes:

[0022] In response to receiving a viewing instruction for any room in the 2D floor plan in the floor plan display interface, the system determines the 3D floor plan of any room associated with the 2D floor plan of any room according to the second association relationship, and then jumps to the 3D panoramic image display interface of the 3D panoramic image to display the 3D panoramic image of any room according to the first association relationship.

[0023] In response to receiving a viewing instruction for any room in the 3D floor plan in the floor plan display interface, the system jumps to the 3D panoramic image display interface to display the corresponding 3D panoramic image of any room, based on the first association relationship.

[0024] Optionally, the step of obtaining the shooting point of the currently displayed 3D panoramic image in the display interface of the 3D panoramic image, and marking the real-scene area included in the display interface of the 3D panoramic image on the floor plan according to the shooting point, includes:

[0025] Obtain the shooting point of the real scene area currently displayed in the display interface of the three-dimensional panoramic image, and determine the target room to which the real scene area currently displayed in the display interface of the three-dimensional panoramic image belongs based on the shooting point.

[0026] The target room is marked in the floor plan display interface.

[0027] Optionally, the step of marking the target room in the floor plan display interface includes:

[0028] In the floor plan display interface, the target room is marked with a specific symbol; and / or,

[0029] The floor plan display interface shows the room information of the target room, which includes at least one of room type, room size, and room area.

[0030] Optionally, before the steps of receiving a viewing instruction for the target house, loading and displaying a three-dimensional panoramic image of the target house, and displaying a floor plan thumbnail of the target house in a thumbnail box in the display interface of the three-dimensional panoramic image, the method further includes:

[0031] acquire panoramic image data of each room in the target house;

[0032] for each room in the target house, project according to the panoramic image data of the room to obtain a three-dimensional panoramic image of the room;

[0033] According to the three-dimensional panoramic image, mark the components contained in the room to obtain the marking point data of each room;

[0034] According to the marking point data and the relative position relationship of each room in the target house, acquire the 3D floor plan data of the target house.

[0035] Optionally, the step of acquiring the 3D floor plan data of the target house according to the marking point data and the relative position relationship of each room in the target house comprises:

[0036] According to the marking point data, acquire the model data of each room;

[0037] According to the connection relationship of each room in the target house and the model data of each room, the 3D floor plan data of the target house is obtained by combination.

[0038] Optionally, before the step of acquiring the 3D floor plan data of the target house according to the connection relationship of each room in the target house and the model data of each room, further comprising:

[0039] According to the three-dimensional panoramic image of each room, acquire the connection relationship of each room in the target house;

[0040] And / or, according to the position information of the shooting point of each room, acquire the connection relationship of each room in the target house.

[0041] Optionally, after the step of acquiring the 3D floor plan data of the target house according to the marking point data and the relative position relationship of each room in the target house, further comprising:

[0042] for any one room in the target house, project the shooting point of the room into the 3D model of the room to acquire the height data of the shooting point in the 3D model;

[0043] According to the actual height of the shooting point and the height data of the shooting point in the 3D model, acquire the conversion relationship between the model length and the real length of the target house;

[0044] According to the conversion relationship, the actual area and the actual size of each room in the target house are obtained.

[0045] Optionally, the step of projecting the panoramic image data of each room in the target house to obtain the three-dimensional panoramic image of the room comprises:

[0046] For each room in the target house, the panoramic image data of the room is projected by an equivalent rectangular projection method to obtain an initial three-dimensional panoramic image of the room.

[0047] The initial three-dimensional panoramic image is vertically corrected to correct the horizontal angle error during shooting to obtain the three-dimensional panoramic image of the room.

[0048] Optionally, the step of vertically correcting the initial three-dimensional panoramic image to correct the horizontal angle error during shooting to obtain the three-dimensional panoramic image of the room comprises:

[0049] By the equivalent rectangular projection method, the auxiliary correction line segment marked in the panoramic image data is projected into a three-dimensional space to obtain a projection line segment, and the auxiliary correction line segment includes at least one line segment perpendicular to the bottom surface of the panoramic image data.

[0050] For any one projection line segment, a plane containing the projection line segment and the center point of the initial three-dimensional panoramic image is obtained.

[0051] The initial three-dimensional panoramic image is adjusted so that the intersection line of all the planes is a vertical line, and the intersection line passes through the center point of the initial three-dimensional panoramic image to obtain the three-dimensional panoramic image of the room.

[0052] Optionally, it further comprises:

[0053] In the display process of the three-dimensional panoramic image, the nearest visible wall foot point from the current view point is obtained.

[0054] The actual size of the wall corner line associated with the visible wall foot point is obtained, and the actual size of the wall corner line is marked in the display interface of the three-dimensional panoramic image.

[0055] Optionally, the step of obtaining the nearest visible wall foot point from the current view point in the display process of the three-dimensional panoramic image comprises:

[0056] The included angle between a first connecting line and the sight line center line of the current view point of the three-dimensional panoramic image is obtained, and the first connecting line is the connecting line between the current view point and the bottom mark point in the beginning mark of each wall surface in the three-dimensional panoramic image.

[0057] According to the first line and the included angle, a bottom mark point satisfying a first preset condition is obtained as a visible wall foot point closest to a current view point;

[0058] The first preset condition includes that the included angle corresponding to the bottom mark point is less than or equal to a preset field of view angle, and the first line length corresponding to the bottom mark point is the shortest.

[0059] Optionally, the step of jumping to a display interface of a floor plan of the target house in response to receiving a viewing instruction for the floor plan thumbnail in the display interface of the three-dimensional panoramic image includes:

[0060] In response to displaying the 3D floor plan in the display interface of the three-dimensional panoramic image in response to receiving a viewing instruction for the floor plan thumbnail in the display interface of the three-dimensional panoramic image, an initial height of a view point is obtained according to a field of view angle and a 3D model size of the target house.

[0061] According to the initial height of the view point, the 3D floor plan is rendered and displayed.

[0062] Optionally, the display interface of the three-dimensional panoramic image further includes a room label of each room in the target house, and the method further includes:

[0063] In response to receiving a viewing instruction for any room label in the display interface of the three-dimensional panoramic image, a three-dimensional panoramic image of a room corresponding to the room label is displayed in the display interface of the three-dimensional panoramic image.

[0064] Optionally, the method further includes:

[0065] During display of the three-dimensional panoramic image and the 3D floor plan, in response to receiving a two-dimensional interaction operation input through a screen, the two-dimensional interaction operation is converted to a three-dimensional space to obtain a three-dimensional interaction operation.

[0066] According to the three-dimensional interaction operation, a target object corresponding to the three-dimensional interaction operation is obtained, and the target object is controlled to perform an action corresponding to the three-dimensional interaction operation.

[0067] Optionally, after the steps of receiving a viewing instruction for a target house, loading and displaying a three-dimensional panoramic image in the target house, and displaying a floor plan thumbnail of the target house in a thumbnail frame in a display interface of the three-dimensional panoramic image, the method further includes:

[0068] in response to receiving a panorama switching instruction in the display interface of the three-dimensional panorama image, decreasing the texture transparency of the sky box of the original three-dimensional panorama image before switching over time, increasing the texture transparency of the sky box of the target three-dimensional panorama image to be switched over time, and ensuring that the sum of the texture transparency of the sky box of the original three-dimensional panorama image and the texture transparency of the sky box of the target three-dimensional panorama image is a preset value;

[0069] moving the spatial position of the virtual camera for rendering from the original three-dimensional panorama image to the target three-dimensional panorama image, so as to switch the displayed three-dimensional panorama image from the original three-dimensional panorama image to the target three-dimensional panorama image in the display interface of the three-dimensional panorama image;

[0070] wherein the center of the sky box of each three-dimensional panorama image is consistent with the spatial camera position of the shooting point of the three-dimensional panorama image.

[0071] Optionally, the floor plan and the coordinate system of the three-dimensional panorama image are the same, and in the display interface of the three-dimensional panorama image, the display orientation of the floor plan thumbnail is consistent with the display orientation of the three-dimensional panorama image.

[0072] In a second aspect, the embodiments of the present application further provide a housing real scene image display device, comprising:

[0073] a panorama image display module, configured to receive a viewing instruction for a target housing, load and display a three-dimensional panorama image in the target housing, and display a floor plan thumbnail of the target housing in a thumbnail frame in a display interface of the three-dimensional panorama image, the floor plan thumbnail comprising a 3D floor plan thumbnail and / or a 2D floor plan thumbnail.

[0074] a floor plan display module, configured to, in response to receiving a viewing instruction for the floor plan thumbnail in the display interface of the three-dimensional panorama image, jump to a display interface of a floor plan of the target housing, wherein the floor plan comprises a 3D floor plan and a 2D floor plan, and in the display interface of the floor plan, the initial display orientation of the floor plan is consistent with the display orientation of the three-dimensional panorama image.

[0075] a real scene area marking module, configured to obtain a shooting point of a three-dimensional panorama image currently displayed in the display interface of the three-dimensional panorama image, and mark a real scene area included in the display interface of the three-dimensional panorama image on the floor plan of the display interface of the floor plan of the target housing according to the shooting point.

[0076] In a third aspect, the embodiments of the present application further provide a terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the computer program is executed by the processor, the steps of the house real scene picture display method described above are implemented.

[0077] In a fourth aspect, the embodiments of the present application further provide a computer readable storage medium, characterized in that the computer readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the house real scene picture display method described above are implemented.

[0078] In the embodiments of the present application, by receiving a viewing instruction for a target house, loading and displaying a three-dimensional panoramic image in the target house, and displaying a house type thumbnail of the target house in a thumbnail frame in the display interface of the three-dimensional panoramic image, the house type thumbnail comprises a 3D house type thumbnail and / or a 2D house type thumbnail; in response to receiving a viewing instruction for the house type thumbnail in the display interface of the three-dimensional panoramic image, jumping to a display interface of a house type drawing of the target house, wherein the house type drawing comprises a 3D house type drawing and a 2D house type drawing, in the display interface of the house type drawing, the initial display orientation of the house type drawing is consistent with the display orientation of the three-dimensional panoramic image; obtaining a shooting point of the three-dimensional panoramic image currently displayed in the display interface of the three-dimensional panoramic image, and marking a real scene area included in the display interface of the three-dimensional panoramic image on the house type drawing in the display interface of the house type drawing of the target house according to the shooting point. The technical problem that the existing house display method is difficult to comprehensively and truly present the real scene of the house, which easily affects the house selection efficiency of the user and misleads the user in selecting a house is solved. The beneficial effects of improving the visual experience of the user and the online house viewing efficiency through the view angle linkage of the house type drawing and the three-dimensional real scene image are achieved.

[0079] The above description is only a summary of the technical solutions of the present application. In order to more clearly understand the technical means of the present application, the embodiments of the present application can be implemented according to the content of the specification, and in order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the following specific embodiments of the present application are described. BRIEF DESCRIPTION OF DRAWINGS

[0080] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the description of the embodiments of the present application. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can also be obtained by those skilled in the art without creating any creative labor.

[0081] Figure 1is one of the step flow charts of a house real scene picture display method in the embodiment of the present application;

[0082] Figure 1A is a system structure diagram of a house real scene picture display process in the embodiment of the present application;

[0083] Figure 1B is one of the display interface schematic diagrams of a three-dimensional panoramic image in the embodiment of the present application;

[0084] Figure 1C is one of the display interface schematic diagrams of a target house plan in the embodiment of the present application;

[0085] Figure 1D is the second display interface schematic diagram of a target house plan in the embodiment of the present application;

[0086] Figure 1E is the second display interface schematic diagram of a three-dimensional panoramic image in the embodiment of the present application;

[0087] Figure 1F is the third display interface schematic diagram of a three-dimensional panoramic image in the embodiment of the present application;

[0088] Figure 2 is the second step flow chart of a house real scene picture display method in the embodiment of the present application;

[0089] Figure 3 is the third step flow chart of a house real scene picture display method in the embodiment of the present application;

[0090] Figure 4 is the fourth step flow chart of a house real scene picture display method in the embodiment of the present application;

[0091] Figure 5 is one of the structure schematic diagrams of a house real scene picture display device in the embodiment of the present application;

[0092] Figure 6 is the second structure schematic diagram of a house real scene picture display device in the embodiment of the present application;

[0093] Figure 7 is the third structure schematic diagram of a house real scene picture display device in the embodiment of the present application;

[0094] Figure 8 is the fourth structure schematic diagram of a house real scene picture display device in the embodiment of the present application;

[0095] Figure 9 is the hardware structure schematic diagram of a terminal device in the embodiment of the present application. DETAILED DESCRIPTION

[0096] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative efforts belong to the scope of the present application.

[0097] Referring to Figure 1 , a step flow chart of a house real scene picture display method in an embodiment of the present application is shown.

[0098] In step 110, a viewing instruction for a target house is received, a three-dimensional panorama image in the target house is loaded and displayed, and a house type thumbnail of the target house is displayed in a thumbnail frame in a display interface of the three-dimensional panorama image, the house type thumbnail including a 3D house type thumbnail and / or a 2D house type thumbnail.

[0099] In the embodiments of the present application, in order to provide a comprehensive and close-to-real visual effect of a house for a user, avoid misleading the user in selecting a house, and improve the efficiency of the user in selecting a house, a viewing instruction for a target house can be received, a three-dimensional panorama image in the target house can be loaded and displayed, and a house type thumbnail of the target house can be displayed in a thumbnail frame in a display interface of the three-dimensional panorama image. In the embodiments of the present application, the viewing instruction for the target house can be received in any available manner, which is not limited in the embodiments of the present application.

[0100] The three-dimensional panorama image can specifically include a three-dimensional panorama image of each room in the target house, and the rooms can include a bedroom, a living room, a dining room, a kitchen, a corridor, a stairwell, a storage room, etc. In the embodiments of the present application, the three-dimensional panorama image of each room in the target house can be obtained in any available manner in advance, which is not limited in the embodiments of the present application. For example, a shooting viewpoint of each room can be created, a panorama picture of each room can be shot, and a three-dimensional panorama image of the corresponding room can be generated by projecting the panorama picture of each room; or a three-dimensional panorama camera can be directly used to shoot a three-dimensional panorama image of each room, etc.

[0101] In addition, in the embodiments of the present application, before the panorama picture of each room is projected to generate a three-dimensional panorama image of the corresponding room, the original panorama picture of the house can also be data-cleaned to eliminate invalid pictures, duplicate pictures, etc. The data cleaning manner can be set according to requirements, which is not limited in the embodiments of the present application.

[0102] In addition, in the embodiment of the present application, when receiving a viewing instruction for a target house, when loading and displaying the three-dimensional panoramic image in the target house, a three-dimensional panoramic image of a default room that is preferentially displayed can be preset, and a default orientation that is preferentially displayed, so that when the user does not select a specific room in the target house that needs to be viewed, the three-dimensional panoramic image of the default room can be preferentially displayed in the default orientation. If a viewing instruction for another room is received, the three-dimensional panoramic image of the corresponding other room can be displayed.

[0103] Furthermore, in the embodiment of the present application, in order to facilitate the user to understand the house type, overall structure and other information of the target house while browsing the three-dimensional panoramic image, the house type thumbnail of the target house can also be displayed in the thumbnail frame in the display interface of the three-dimensional panoramic image. The position and size of the thumbnail frame in the display interface of the three-dimensional panoramic image can be customized according to requirements.

[0104] The house type thumbnail is a thumbnail of the house type diagram of the target house, and in the embodiment of the present application, the house type diagram of the target house can be obtained by any available method, which is not limited in the embodiment of the present application. After obtaining the house type diagram of the target house, the house type thumbnail can be obtained based on the house type diagram. Furthermore, in the embodiment of the present application, the house type diagram can include but is not limited to a 3D (3 Dimensions) house type diagram, a 2D (2 Dimensions) house type diagram, and the like. Therefore, the house type thumbnail can include but is not limited to a 3D house type thumbnail and / or a 2D house type thumbnail. Specifically, the 3D house type thumbnail and the 2D house type thumbnail can be displayed in the thumbnail frame at the same time, or only one of the 3D house type thumbnail and the 2D house type thumbnail can be displayed, and when only one of the 3D house type thumbnail and the 2D house type thumbnail can be displayed, the content displayed in the thumbnail frame can be switched according to a received thumbnail switching instruction, so as to switch between the 3D house type thumbnail and the 2D house type thumbnail.

[0105] In the actual implementation process of user browsing and display, the basic framework can use React and import the ThreeJS library. It can mainly include the modules as shown in the following figure. Figure 1A

[0106] When the three-dimensional panoramic image is rendered and displayed, the main processing flow can be as follows:

[0107] ​If the three-dimensional panorama display is limited to the WebGL scene, first, it can be judged whether the running environment supports WebGL, and the model data of the target house is requested from the server; the model data is converted and processed. For example, due to the left / right hand coordinate system used by Unity and the browser respectively, the spatial data cannot be directly applied. Therefore, a spatial conversion algorithm needs to be applied on the display side to convert the spatial coordinates of the data, and so on.

[0108] As shown in Figure 1B The display interface of a three-dimensional panorama image is shown, wherein the 3D floor plan thumbnail of the target house is displayed in the thumbnail frame at the top left of the display interface of the three-dimensional panorama image.

[0109] In step 120, in response to receiving a viewing instruction for the floor plan thumbnail in the display interface of the three-dimensional panorama image, jump to the display interface of the floor plan of the target house, wherein the floor plan includes a 3D floor plan and a 2D floor plan, and the initial display orientation of the floor plan in the display interface of the floor plan is consistent with the display orientation of the three-dimensional panorama image.

[0110] As described above, the floor plan is displayed in the form of a thumbnail in the display interface of the three-dimensional panorama image. Due to the limitation of the display form, some details may not be clear enough, and if the user wants to view the complete and clear floor plan, a viewing instruction for the floor plan thumbnail can be input in the display interface of the three-dimensional panorama image. In response to receiving a viewing instruction for the floor plan thumbnail in the display interface of the three-dimensional panorama image, the display interface of the floor plan of the target house can be jumped to. The floor plan includes but is not limited to a 3D floor plan and a 2D floor plan.

[0111] Moreover, when the user views the house, he or she also pays more attention to the orientation of the room to understand the lighting and other conditions of each room. In actual application, when the user browses the three-dimensional panorama image, he or she can know the real orientation of the room being viewed according to the orientation information in the real environment and the display orientation of the three-dimensional panorama image. In order not to affect the real-time viewing orientation of the user in the three-dimensional panorama image before the interface is switched, in the display interface of the floor plan, the initial display orientation of the floor plan can be set to be consistent with the display orientation of the three-dimensional panorama image, thereby avoiding the problem that the user needs to adjust his or her real-time viewing orientation when jumping to the display interface of the floor plan.

[0112] For example, assuming that a viewing instruction for a house type thumbnail is received in the display interface of the three-dimensional panoramic image, and the display orientation of the three-dimensional panoramic image in the display interface of the three-dimensional panoramic image is from the TV wall of the living room to the sofa, then in the display interface of the house type diagram, the initial display orientation of the house type diagram needs to be ensured to be from the TV wall of the living room to the sofa, so as to realize the unity of the display interface of the three-dimensional panoramic image and the initial display orientation of the house type diagram in the display interface of the house type diagram, so that the user can know the orientation of the three-dimensional panoramic image in the display interface of the three-dimensional panoramic image relative to the house type diagram, and the like, and meanwhile, the visual interference caused by the non-unity of the display orientations when transitioning from the display interface of the three-dimensional panoramic image to the display interface of the house type diagram is avoided.

[0113] Moreover, in the display interface of the three-dimensional panoramic image and the display interface of the house type diagram, the orientation information in the real environment can be marked, for example, the orientation information in the real environment can be marked in the display interface of the three-dimensional panoramic image and the display interface of the house type diagram in the form of a compass or a north pointer. Moreover, since the target house is relatively fixed, its orientation is also relatively fixed, so when the display orientation of the three-dimensional panoramic image or the house type diagram in the display interface thereof changes, the marked orientation information in the real environment can also be adjusted accordingly, so as to accurately mark the current display orientation of the three-dimensional panoramic image or the house type diagram in the real environment.

[0114] As shown in FIG. 1, the display interface of the house type diagram of the target house is displayed, and the 3D house type diagram is displayed in the display interface of the house type diagram. Figure 1C As shown in FIG. 1, the display interface of the house type diagram of the target house is displayed, and the 3D house type diagram is displayed in the display interface of the house type diagram. Figure 1D As shown in FIG. 1, the display interface of the house type diagram of the target house is displayed, and the 3D house type diagram is displayed in the display interface of the house type diagram.

[0115] Moreover, assuming that the display orientation of the three-dimensional panoramic image before the interface switching is north orientation with a left deflection of 30 degrees, then the display interface of the house type diagram displayed after the switching, assuming that the 3D house type diagram is displayed at this time, then the initial display orientation of the 3D house type diagram is consistent with the display orientation of the three-dimensional panoramic image, that is, it is also north orientation with a left deflection of 30 degrees, as shown in FIG. 1. Figure 1C Moreover, assuming that the display orientation of the three-dimensional panoramic image before the interface switching is north orientation with a left deflection of 30 degrees, then the display interface of the house type diagram displayed after the switching, assuming that the 3D house type diagram is displayed at this time, then the initial display orientation of the 3D house type diagram is consistent with the display orientation of the three-dimensional panoramic image, that is, it is also north orientation with a left deflection of 30 degrees, as shown in FIG. 1.

[0116] In step 130, the shooting point of the three-dimensional panoramic image currently displayed in the display interface of the three-dimensional panoramic image is acquired, and the real scene area included in the display interface of the three-dimensional panoramic image is marked on the house type diagram in the display interface of the house type diagram of the target house according to the shooting point.

[0117] In addition, in the embodiment of the present application, after jumping from the display interface of the three-dimensional panoramic image to the display interface of the house type diagram, in order to facilitate the user to timely understand the position of the three-dimensional panoramic image displayed in the display interface of the three-dimensional panoramic image in the house type diagram, the shooting point of the three-dimensional panoramic image currently displayed in the display interface of the three-dimensional panoramic image can also be acquired, and the real scene area included in the display interface of the three-dimensional panoramic image is marked on the house type diagram in the display interface of the house type diagram of the target house according to the shooting point.

[0118] In the embodiment of the present application, the shooting point of the three-dimensional panoramic image can be acquired by any available manner, which is not limited in the embodiment of the present application. For example, when shooting the panoramic picture of each room, the camera can be fixed at a preset shooting point in the room, and then the shooting point of the camera in each room is recorded as the shooting point of the three-dimensional panoramic image of the corresponding room.

[0119] The specific manner of marking the real scene area in the house type diagram can also be preset according to the requirement, which is not limited in the embodiment of the present application. For example, after acquiring the shooting point of the three-dimensional panoramic image currently displayed in the display interface of the three-dimensional panoramic image, the room to which the real scene area included in the display interface of the three-dimensional panoramic image belongs can be acquired according to the shooting point, and then the room to which the real scene area belongs can be marked on the house type diagram in the display interface of the house type diagram; or, the shooting direction of the three-dimensional panoramic image currently displayed in the display interface of the three-dimensional panoramic image can also be acquired, and then the room to which the real scene area belongs can be marked on the house type diagram in the display interface of the house type diagram, and the current shooting direction can also be marked on the house type diagram in the display interface of the house type diagram; and the like.

[0120] In the embodiment of the present application, by receiving a viewing instruction for a target house, loading and displaying a three-dimensional panoramic image in the target house, and displaying a house type thumbnail of the target house in a thumbnail frame in the display interface of the three-dimensional panoramic image, the house type thumbnail includes a 3D house type thumbnail and / or a 2D house type thumbnail; in response to receiving a viewing instruction for the house type thumbnail in the display interface of the three-dimensional panoramic image, jumping to a display interface of a house type diagram of the target house, wherein the house type diagram includes a 3D house type diagram and a 2D house type diagram, and the initial display direction of the house type diagram in the display interface of the house type diagram is consistent with the display direction of the three-dimensional panoramic image; acquiring the shooting point of the three-dimensional panoramic image currently displayed in the display interface of the three-dimensional panoramic image, and marking the real scene area included in the display interface of the three-dimensional panoramic image on the house type diagram in the display interface of the house type diagram of the target house according to the shooting point. Thus, the comprehensiveness and accuracy of the house display process can be improved, and the visual effect in the user's house viewing process can be improved.

[0121] Assuming that the shooting point of the three-dimensional panoramic image currently displayed in the display interface of the three-dimensional panoramic image is in the living room, then in the display interface of the 3D floor plan shown in Figure 1C The label color of the living room can be set to be different from the label color of other rooms in the display interface of the 3D floor plan shown in the figure, so as to mark the real scene area included in the display interface of the three-dimensional panoramic image on the floor plan in the display interface of the target house; and in the display interface of the 2D floor plan shown in Figure 1D In the display interface of the 2D floor plan shown in the figure, a circular icon can be set in the area where the living room is located, to mark the real scene area included in the display interface of the three-dimensional panoramic image; and the like.

[0122] Referring to Figure 2 In the embodiment of the present application, the step 110 can further include:

[0123] Step 111, receiving a viewing instruction for a target house, loading model data of the target house, the model data including 3D floor plan data of the target house and three-dimensional panoramic images of each room.

[0124] In the embodiment of the present application, in order to timely and accurately display the three-dimensional panoramic image and the floor plan, the model data of the target house can be loaded when the viewing instruction for the target house is received. The model data can include but is not limited to 3D floor plan data of the target house and three-dimensional panoramic images of each room in the target house.

[0125] The 3D floor plan data can include all data required to construct the 3D floor plan, such as position data, relative position relationship data, connection relationship data of each component in the 3D floor plan, such as corners, doors, windows, sofas, beds, cabinets, etc. The three-dimensional panoramic image of each room can be a spherical panoramic image, a regular hexahedral panoramic image, etc. The specific data content and data form included in the 3D floor plan data and the specific type of the three-dimensional panoramic image can be customized according to requirements, which are not limited by the embodiment of the present application.

[0126] Step 112, generating a 3D floor plan of the target house and a 2D floor plan of the target house according to the 3D floor plan data of the target house.

[0127] After obtaining the 3D floor plan data of the target house, the 3D floor plan of the target house and the 2D floor plan of the target house can be generated according to the 3D floor plan data of the target house.

[0128] Wherein, according to the position data, relative position relationship data, connection relationship data and the like of the components contained in each room in the 3D floor plan data of the target house, each room can be rendered, and then each room can be rotated and displaced as a whole. The above operation is applied to all rooms to generate a complete 3D floor plan.

[0129] When generating the 2D floor plan of the target house according to the 3D floor plan data of the target house, the generated 3D floor plan can be dimensionally reduced to obtain a top view of the 3D floor plan as the 2D floor plan of the target house; or the 3D floor plan data can be dimensionally reduced to obtain the projection position data of each component in the direction perpendicular to the bottom surface of the house, and then the 2D floor plan of the target house can be obtained according to the projection position data, relative position relationship data, connection relationship data and the like of each component.

[0130] At this time, since there is a constraint condition when marking the wall surface: the wall surface must be perpendicular to the bottom surface, the 3D floor plan can be dimensionally reduced and projected onto a two-dimensional plane, that is, the 2D floor plan of the target house can be directly obtained.

[0131] Step 113, establishing a first association relationship between the 3D floor plan of each room in the 3D floor plan of the target house and the three-dimensional panoramic image in the model data;

[0132] In the embodiment of the application, in order to facilitate mutual switching between the floor plan and the three-dimensional panoramic image, a first association relationship can be established between the 3D floor plan of each room in the 3D floor plan of the target house and the three-dimensional panoramic image in the model data. Specifically, for each room in the target house, a first association relationship can be established between the 3D floor plan of the corresponding room and the three-dimensional panoramic image of the corresponding room in the model data; or only a first association relationship can be established between the 3D floor plan of each room and the three-dimensional panoramic image in the model data, without limiting the specific real scene area in the three-dimensional panoramic image that establishes a first association relationship with each room in the 3D floor plan.

[0133] For example, the target house includes room 1, room 2 and room 3, and then a first association relationship can be established between the 3D floor plan of room 1 and the three-dimensional panoramic image of room 1 in the model data, a first association relationship can be established between the 3D floor plan of room 2 and the three-dimensional panoramic image of room 2 in the model data, and a first association relationship can be established between the 3D floor plan of room 3 and the three-dimensional panoramic image of room 3 in the model data.

[0134] Of course, the first association relationship between the 3D floor plan of the room 1, the room 2 and the room 3 and the three-dimensional panoramic image in the model data can also be directly established without limiting whether the specific three-dimensional panoramic image in the three-dimensional panoramic image in the model data having the first association relationship with the 3D floor plan of the room 1, the room 2 and the room 3 is the same, for example, it can be set that the three-dimensional panoramic image having the first association relationship with the 3D floor plan of the room 1, the room 2 and the room 3 is the three-dimensional panoramic image of a preset default room, and the like. The preset default room can be preset according to requirements, for example, it can be set as the three-dimensional panoramic image of a living room, and the like.

[0135] Moreover, in the embodiment of the present application, the first association relationship between the 3D floor plan of each room and the three-dimensional panoramic image in the model data can be established by any available manner, which is not limited in the embodiment of the present application.

[0136] For example, according to the three-dimensional panoramic image data of each room, the mapping data of each room can be constructed, and then the association relationship between the mapping data and the 3D floor plan of the corresponding room can be established, for example, the mapping data of each room is overlaid on the 3D floor plan of the corresponding room in a transparent manner, and the like, so as to establish the first association relationship between the 3D floor plan and the three-dimensional panoramic image in the model data.

[0137] In step 114, the 3D floor plan and / or the 2D floor plan of the target house is scaled down to the thumbnail frame to generate the 3D floor plan thumbnail and / or the 2D floor plan thumbnail of the target house.

[0138] After obtaining the 3D floor plan and the 2D floor plan of the target house, the 3D floor plan and / or the 2D floor plan of the target house can be scaled down to the thumbnail frame to generate the 3D floor plan thumbnail and / or the 2D floor plan thumbnail of the target house.

[0139] The scaling ratio can be preset according to the size of the thumbnail frame and the size of the 3D floor plan and / or the 2D floor plan, so that the scaled 3D floor plan and / or the 2D floor plan can be completely displayed in the thumbnail frame. The scaling ratio of the 3D floor plan and the 2D floor plan can be the same or different, which is not limited in the embodiment of the present application.

[0140] Specifically, if only the 3D floor plan thumbnail is displayed in the thumbnail frame, then the 3D floor plan of the target house can be scaled down to the thumbnail frame to generate the 3D floor plan thumbnail of the target house; if only the 2D floor plan thumbnail is displayed in the thumbnail frame, then the 2D floor plan of the target house can be scaled down to the thumbnail frame to generate the 2D floor plan thumbnail of the target house; if both the 3D floor plan thumbnail and the 2D floor plan thumbnail are displayed in the thumbnail frame, then the 3D floor plan and the 2D floor plan of the target house can be scaled down to the thumbnail frame to generate the 3D floor plan thumbnail and the 2D floor plan thumbnail of the target house, respectively.

[0141] In addition, in the embodiment of the present application, if the floor plan thumbnail displayed in the thumbnail frame can be switched between the 3D floor plan thumbnail and the 2D floor plan thumbnail, then the 3D floor plan and the 2D floor plan of the target house can be scaled down to the thumbnail frame to generate the 3D floor plan thumbnail and the 2D floor plan thumbnail of the target house in advance, or the 3D floor plan thumbnail of the target house can be generated before the 3D floor plan thumbnail is displayed in the thumbnail frame for the first time, and the 2D floor plan thumbnail of the target house can be generated before the 2D floor plan thumbnail is displayed in the thumbnail frame for the first time; and the like.

[0142] In step 115, the three-dimensional panoramic image in the model data is displayed, and the 3D floor plan thumbnail and / or the 2D floor plan thumbnail of the target house is displayed in the thumbnail frame in the display interface of the three-dimensional panoramic image.

[0143] In step 115, the three-dimensional panoramic image in the model data is displayed, and the 3D floor plan thumbnail and / or the 2D floor plan thumbnail of the target house is displayed in the thumbnail frame in the display interface of the three-dimensional panoramic image.

[0144] In the embodiment of the present application, the accuracy of the three-dimensional panoramic image and the floor plan thumbnail that can be displayed in the display interface of the three-dimensional panoramic image can be further improved by the above steps 111-115, thereby improving the house display effect.

[0145] Optionally, in the embodiment of the present application, the step 112 can further include:

[0146] In step 1121, the 3D model of each room is rendered according to the 3D floor plan data of each room, and the 3D models of each room are spliced to obtain the 3D model of the target house.

[0147] In the generation of the 3D floor plan of the target house according to the 3D floor plan data of the target house, the 3D model of each room can be rendered according to the 3D floor plan data of each room according to the coordinate system of each room, and then the 3D models of each room can be spliced to obtain the 3D model of the target house.

[0148] For example, for each room in the target house, the 3D model of the corresponding room can be rendered according to the 3D floor plan data of the corresponding room according to the coordinate system of each room, and then the 3D models of each room can be spliced to obtain the 3D model of the target house.

[0149] In step 1122, the wall data in the 3D floor plan data is used to draw the 2D projection corresponding to the 3D model of the target house.

[0150] In addition, in order to establish the 2D floor plan and the correlation between the 2D floor plan and the 3D floor plan, the wall data in the 3D floor plan data can also be used to draw the 2D projection corresponding to the 3D model of the target house. At this time, since the wall data can be used to distinguish different rooms, the 2D projection drawn at this time can be one-to-one corresponding to the rooms of the 3D model of the target house.

[0151] In the embodiments of the present application, the 2D projection corresponding to the 3D model of the target house can be drawn by any available method, which is not limited in the embodiments of the present application.

[0152] For example, the wall data can be dimensionally reduced to obtain the projection wall data of the wall data on the two-dimensional plane of the ground of the house, and then the 2D projection corresponding to the 3D model of the target house can be drawn based on the projection wall data; or the 3D wall structure can also be drawn according to the wall data, and then the 3D wall structure can be dimensionally reduced to obtain the overhead view of the 3D wall structure, and the 2D projection corresponding to the 3D model of the target house can be obtained; and the like.

[0153] In step 1123, the 3D model of the target house and the 2D projection are associated to establish a second correlation, so that each room in the 2D projection and each room in the 3D model of the target house correspond to each other to establish the 3D floor plan of the target house.

[0154] After obtaining the 2D projection of the target house, the 3D model of the target house and the 2D projection can be associated to establish a second correlation, so that each room in the 2D floor plan and each room in the 3D model correspond to each other to establish the 3D floor plan of the target house.

[0155] For example, assuming that the target house includes room 1, room 2 and room 3, after the second association relationship between the 3D model of the target house and the planar 2D projection is established, room 1 in the planar 2D projection can correspond to room 1 in the 3D model of the target house, room 2 in the planar 2D projection can correspond to room 2 in the 3D model of the target house, and room 3 in the planar 2D projection can correspond to room 3 in the 3D model of the target house.

[0156] At this time, the 3D model of the target house in which each room corresponds to the corresponding room in the planar 2D projection can be used as the 3D floor plan of the target house. That is, the 3D floor plan includes the 3D model of the target house and the corresponding relationship between each room in the 3D model of the target house and each room in the planar 2D projection.

[0157] Step 1124: using the corresponding planar 2D projection that is associated with the 3D model of the target house as the 2D floor plan of the target house.

[0158] As described above, the planar 2D projection can be associated with each room in the 3D model of the target house, that is, the corresponding relationship, so in the embodiment of the present application, the planar 2D projection that is associated with the 3D model of the target house can be used as the 2D floor plan of the target house.

[0159] In the embodiment of the present application, the above steps 1121-1124 can further improve the generation effect and efficiency of the floor plan, and establish the association relationship between the 3D floor plan and the 2D floor plan, so as to facilitate the mutual synchronous switching between the floor plan and the three-dimensional panoramic image.

[0160] Optionally, in the embodiment of the present application, after the step 120, the method can further include:

[0161] Step 140: in response to receiving a viewing instruction for any room in the 2D floor plan in the display interface of the floor plan, determining the 3D floor plan of the any room associated with the 2D floor plan of the any room according to the second association relationship, and then jumping to the display interface of the three-dimensional panoramic image corresponding to the three-dimensional panoramic image of the any room according to the first association relationship through the 3D floor plan of the any room.

[0162] Step 150: in response to receiving a viewing instruction for any room in the 3D floor plan in the display interface of the floor plan, jumping to the display interface of the three-dimensional panoramic image corresponding to the three-dimensional panoramic image of the any room according to the first association relationship.

[0163] As aforementioned, after learning the second association relationship between the 2D floor plan and the 3D floor plan, and the first association relationship between the 3D floor plan and the three-dimensional panoramic image, if a viewing instruction for any room X in the 2D floor plan is received in the display interface of the floor plan, the corresponding 3D floor plan of the room X associated with the 2D floor plan of the room X currently desired to be viewed can be determined according to the second association relationship, and then the three-dimensional panoramic image corresponding to the display of the any room X can be displayed in the display interface of the three-dimensional panoramic image through the 3D floor plan of the any room X according to the first association relationship.

[0164] If a viewing instruction for any room X in the 3D floor plan is received in the display interface of the floor plan, the three-dimensional panoramic image corresponding to the display of the any room X can be directly displayed in the display interface of the three-dimensional panoramic image according to the first association relationship.

[0165] Thus, the quick switching from the 2D floor plan and the 3D floor plan to the three-dimensional panoramic image can be realized.

[0166] With reference to Figure 2 In the embodiment of the present application, the step 130 can further include:

[0167] Step 131, acquiring a shooting point of a real scene area currently displayed in the display interface of the three-dimensional panoramic image, and determining a target room to which the real scene area currently displayed in the display interface of the three-dimensional panoramic image belongs according to the shooting point.

[0168] Step 132, marking the target room in the display interface of the floor plan.

[0169] In the embodiment of the present application, in order to mark the real scene area included in the display interface of the three-dimensional panoramic image on the floor plan in the display interface of the floor plan, a shooting point of a real scene area currently displayed in the display interface of the three-dimensional panoramic image can be acquired, and a target room to which the real scene area currently displayed in the display interface of the three-dimensional panoramic image belongs can be determined according to the shooting point.

[0170] As aforementioned, when shooting the three-dimensional panoramic image of each room, a shooting point can be set, so that the three-dimensional panoramic image of each room can be shot based on the shooting point of each room. Therefore, in the embodiment of the present application, the three-dimensional panoramic image to which the real scene area currently displayed in the display interface of the three-dimensional panoramic image belongs can be determined, and then the shooting point of the real scene area currently displayed can be determined according to the three-dimensional panoramic image to which the real scene area currently displayed belongs, and then the target room to which the real scene area currently displayed in the display interface of the three-dimensional panoramic image belongs can be determined.

[0171] Thus, the target room can be marked in the display interface of the house type diagram. The marking manner of the target room can be pre-set according to requirements, but the current target room can be accurately known in the display interface of the house type diagram according to the marking manner.

[0172] For example, the marking manner can be set as adjusting the color of the target room to be different from the colors of other rooms in the display interface of the house type diagram, or setting a special mark symbol in the target room, and the like.

[0173] By marking the real scene area currently displayed in the display interface of the three-dimensional panoramic image in the house type diagram, the user can conveniently know the position of the currently viewed room in the house type diagram in real time, so as to improve the house viewing experience.

[0174] Optionally, in the embodiment of the present application, the step 132 can further include:

[0175] Step 1321: marking the target room with a specific symbol in the display interface of the house type diagram; and / or,

[0176] Step 1322: marking room information of the target room in the display interface of the house type diagram, the room information including at least one of room type, room size, and room area.

[0177] In the embodiment of the present application, in order to mark the target room in the display interface of the house type diagram, the target room can be marked with a specific symbol in the display interface of the house type diagram; and / or, room information of the target room can be marked in the display interface of the house type diagram, the room information can include but is not limited to at least one of room type, room size, and room area. In this way, the user can know the information of the currently viewed room in the house type diagram in time and accurately.

[0178] The specific symbol can be pre-set according to requirements. For example, the room type of each room can be marked in the display interface of the 3D house type diagram, at this time, the specific symbol of the target room can be set as a room type label with a specific shape and / or a specific color. In the display interface of the 2D house type diagram, since the 2D house type diagram is planar, at this time, the specific symbol can be set as a minimum circular area including the area where the target room is located; and the like.

[0179] If the room information of the target room is marked in the display interface of the house type diagram, the specific content contained in the room information can be pre-set according to requirements, and the specific display form and display position of the room information can be customized according to requirements. For example, in the display interface of the 3D house type diagram, the room information of the target room can be displayed directly above the target room; in the display interface of the 2D house type diagram, the room information of the target room can be displayed inside the area where the target room is located; and the like.

[0180] The room size can be the actual size of the target room, such as the length of each corner line, and the like; and the room area can be the actual area of the target room.

[0181] In addition, in the embodiment of the present application, the real scene area included in the display interface of the three-dimensional panoramic image can also be marked in the thumbnail frame in the display interface of the three-dimensional panoramic image according to the shooting point. The specific marking manner can also be customized according to requirements.

[0182] For example, the shooting point of the real scene area currently displayed in the display interface of the three-dimensional panoramic image can also be obtained, and after the target room to which the real scene area currently displayed in the display interface of the three-dimensional panoramic image belongs is determined according to the shooting point, the target room can be marked in the thumbnail frame in the display interface of the three-dimensional panoramic image.

[0183] At this time, since the house type thumbnail displayed in the thumbnail frame is relatively small, it is not convenient to mark the target room in the house type thumbnail, and therefore, the room information of the target room can be preferably marked in the thumbnail frame at this time, and the room information can include but is not limited to at least one of room type, room size, and room area.

[0184] Reference Figure 2 In the embodiment of the present application, the step 120 can further include:

[0185] In response to receiving a viewing instruction for the house type thumbnail in the display interface of the three-dimensional panoramic image, when jumping to the display interface of the house type diagram of the target house to display the 3D house type diagram, the initial height of the view point is obtained according to the field of view angle and the 3D model size of the target house.

[0186] The 3D house type diagram is rendered and displayed according to the initial height of the view point.

[0187] In addition, in the embodiment of the present application, the size of the initially generated 3D floor plan can be fixed, but since the 3D floor plan can be displayed in a display screen of different sizes, in order not to affect the visual effect of the user in the initial display, the complete 3D floor plan can be displayed when the 3D floor plan is initially displayed. Therefore, in the embodiment of the present application, when the viewing instruction for the house type thumbnail is received in the display interface of the three-dimensional panoramic image and the 3D floor plan is displayed in the display interface of the house type of the target house, the initial height of the field point that enables the 3D floor plan to be displayed completely and clearly can be obtained according to the field angle (fov) and the 3D model size of the target house.

[0188] For example, the longest diagonal line L in the display interface can be obtained according to the 3D model size of the target house, assuming that the field angle is fov, and then the initial height of the field point can be obtained as L / (2*tan(fov / 2)).

[0189] After the initial height of the field point is determined, the 3D floor plan can be rendered and displayed according to the initial height of the field point. At this time, the 3D floor plan can be completely displayed in the correct position in the field of view.

[0190] Reference Figure 3 In the embodiment of the present application, in order to improve the response speed of the viewing instruction for the target house, the three-dimensional panoramic image, 3D floor plan data, etc. of each room can be pre-processed to facilitate subsequent viewing and quick loading. Therefore, in another preferred embodiment of the present application, before the step 110, the following steps can also be included:

[0191] Step S1, obtaining panoramic image data of each room in the target house.

[0192] In the embodiment of the present application, the panoramic image data of each room in the target house can be obtained by any available means, which is not limited in the embodiment of the present application.

[0193] For example, the shooting point positions of each room including the bedroom, living room, dining room, kitchen, etc. in the target house can be pre-created, then the shooting App (Application) is connected to the camera for control through the communication protocol provided by the panoramic camera, and the real-time picture of the camera can be transmitted to the device such as a mobile phone for obtaining panoramic image data after the connection is established. Moreover, the data of the geomagnetic field, i.e. the shooting direction, can be obtained through the sensor of the mobile phone, and the parameters of the forward and backward and left and right deflection of the camera can be obtained based on the gyroscope parameters in the mobile phone. In addition, in the embodiment of the present application, the height of the shooting support can be intelligently judged, and the height of the support during shooting can be calculated according to the distance.

[0194] Step S2, for each room in the target house, projecting according to the panorama image data of the room to obtain a three-dimensional panorama image of the room.

[0195] For each room in the target house, projecting according to the panorama image data of the room to obtain a three-dimensional panorama image of the corresponding room. In an embodiment of the present application, the panorama image data of the room can be projected by any available projection method.

[0196] For example, the projection can be set as Equirectangular Projection (ERP) projection method, the principle of which is to map the meridian as a constant interval vertical line and the parallel as a constant interval horizontal line. The projection relationship can be summarized as follows: λ = x / cosφ1 + λ0, φ = y + φ1. Where, on the sphere: λ is the meridian, φ is the parallel, φ1 is the standard parallel, and λ0 is the central meridian; on the plane: x is the horizontal coordinate, and y is the vertical coordinate.

[0197] Step S3, according to the three-dimensional panorama image, marking the components contained in the room to obtain the marking point data of each room.

[0198] Based on the three-dimensional panorama image obtained by the above steps, the components (such as corners, doors, windows, etc.) in the room can be marked to obtain the marking point data of each room. The specific component marking method can be to establish basic house frame marking points in space by using perspective projection transformation, and mark the components by moving the corresponding marking points to the positions of the components. At the same time, the movement of the marking points is constrained, specifically, it must be ensured that the marked wall surface is perpendicular to the ground, and the wall surfaces are perpendicular or horizontal to each other. If the wall surfaces cannot be guaranteed to be perpendicular or horizontal, a free point component needs to be used for special processing.

[0199] For example, the marking points of different components can be established in space in advance, and then in the three-dimensional panorama image, the positions of different components can be obtained, and then the marking points of the corresponding components can be set at the corresponding positions to mark the components at the corresponding positions. If the shape of a balcony in the three-dimensional panorama image is a circular arc, the corresponding wall surface does not meet the condition of being perpendicular or horizontal, and at this time, the circular arc marking point in the free point component can be used to construct the shape of the balcony to mark the corresponding balcony.

[0200] Wherein, the marking points of different components, and the free point components can be pre-set according to the requirements. Moreover, in order to find the marking points according to the components, and restore the components according to the marking points later, the components and the marking points can be associated with each other, and the marking points of different components are different from each other.

[0201] In the embodiment of the present application, since the perspective projection feature is mainly used, the projection mode such as EquirectangularProjection cannot change the object proportion relationship in the image, and the perspective projection can also strictly ensure the correctness of the object proportion relationship in the picture, so that the proportional relationship of the distances of the mark points of each component in space can be ensured to be the same as the actual scene.

[0202] The mark point data of each room can specifically include the position information of each mark point contained in the corresponding room, the size parameter of the mark point itself, the connection relationship between the mark points, the relative position relationship, and the like.

[0203] Step S4, obtaining the 3D floor plan data of the target house according to the mark point data and the relative position relationship of each room in the target house.

[0204] The mark point data based on step S3 can generate a reduced model data in space that is proportional to the actual house. Therefore, in the embodiment of the present application, the 3D floor plan data of the target house can be obtained according to the mark point data and the relative position relationship of each room in the target house.

[0205] Since the mark point data is obtained in units of each room, the position information of the mark points contained in the mark point data is position information based on the coordinate system of each room, and at this time, in order to unify the coordinate system, the position information based on the coordinate system of the room where each mark point is located in the mark point data can be converted into position information under the coordinate system of the target house.

[0206] At this time, in order to realize the conversion of the coordinate system described above, the 3D model of each room can be generated based on the mark point data, and then the 3D model of each room can be combined according to the relative position relationship of each room in the target house to obtain the 3D model of the target house, so that the position information of each mark point in the target house under the coordinate system of the target house can be obtained based on the 3D model of the target house.

[0207] The specific content contained in the 3D floor plan data can be customized according to requirements, and the embodiment of the present application is not limited in this regard.

[0208] Optionally, in the embodiment of the present application, the step S4 can further include:

[0209] Step S41, obtaining the model data of each room according to the mark point data;

[0210] Step S42, according to the connection relationship of each room in the target house and the model data of each room, the 3D floor plan data of the target house is obtained by combination.

[0211] As described above, in the embodiment of the present application, according to the model data of each room, the model data of each room can be generated in the space in proportion to the scale.

[0212] Then, according to the connection relationship of each room in the target house and the model data of each room, the 3D floor plan data of the target house can be further obtained by combination. Wherein, the connection relationship of each room in the target house can be obtained by any available method. For example, when the panoramic image data is taken, the connection relationship between each room can be marked; or, the image content of the door, window and the like in the panoramic image data and / or three-dimensional panoramic image can be used to determine the other rooms connected with the current shooting position, through the cross comparison of multiple images, the connection relationship of the rooms represented by these images can be determined, for the images which cannot be determined by the door, window and the like, the exclusion method and the image content of other images with determined connection relationship can be used for determination; and the like.

[0213] At this time, the door or open space of the room with connection relationship must coincide, the room model can be rotated to make the door or open space direction of the two connected rooms consistent, and then the multiple room models can be spliced by taking the door or open space as the connection point to obtain the 3D floor plan data of the target house. Thus, the 3D floor plan data of the target house can be quickly and accurately obtained based on the model data of each room.

[0214] Optionally, in the embodiment of the present application, before the step S42, it can further include:

[0215] Step T1, according to the three-dimensional panoramic image of each room, the connection relationship of each room in the target house is obtained; and / or,

[0216] Step T2, according to the position information of the shooting point of each room, the connection relationship of each room in the target house is obtained.

[0217] As described above, in the embodiment of the present application, according to the three-dimensional panoramic image of each room, the connection relationship of each room in the target house can be obtained. For example, through the image content of the door, window and the like in the three-dimensional panoramic image, the other rooms connected with the current shooting position can be determined, through the cross comparison of multiple three-dimensional panoramic images, the connection relationship of the rooms represented by these three-dimensional panoramic images can be determined, for the three-dimensional panoramic images which cannot be determined by the door, window and the like, the exclusion method and the image content of other three-dimensional panoramic images with determined connection relationship can be used for determination.

[0218] In addition, if the positional relationship between the photographing points of different rooms is collected when the panoramic image data is photographed, the positional relationship between the rooms can be determined directly based on the collected positional relationship between the photographing points of different rooms, and the connection relationship between the rooms can be further determined. Thus, the connection relationship can be quickly obtained according to different situations, and the accuracy of the obtained connection relationship is improved.

[0219] With reference to Figure 3 In the embodiment of the present application, after the step S4, the method can further include:

[0220] In step S5, the photographing point of each room in the target house is projected into the 3D model of the room to obtain the height data of the photographing point in the 3D model.

[0221] In step S6, the conversion relationship between the model length and the real length of the target house is obtained according to the actual height of the photographing point and the height data of the photographing point in the 3D model.

[0222] In step S7, the actual area and the actual size of each room in the target house are obtained according to the conversion relationship.

[0223] As described above, the projection does not change the proportion relationship of objects in the image, and the perspective projection can strictly ensure the correctness of the proportion relationship of objects in the image. Therefore, in the embodiment of the present application, the conversion relationship between the model length and the real length of the current target house can be quickly and accurately obtained based on the projection height of the same photographing point in the 3D model and the actual height of the corresponding photographing point.

[0224] Specifically, the photographing point of each room in the target house can be projected into the 3D model of the room to obtain the height data of the photographing point in the 3D model, that is, the height data of the corresponding photographing point in the three-dimensional space. Then, the conversion relationship between the model length and the real length of the target house can be obtained according to the actual height of the photographing point and the height data of the photographing point in the 3D model.

[0225] In the embodiment of the present application, the actual height of the photographing point can be obtained by any available method, which is not limited in the embodiment of the present application. For example, the actual height of the photographing point can be obtained in advance when photographing, or the height of the support when photographing can be calculated according to the distance when the panoramic image data is photographed.

[0226] After the conversion relationship between the model length and the real length is obtained, the actual area and the actual size of each room in the target house can be further obtained according to the conversion relationship and the model size of each room in the 3D house type drawing data.

[0227] Optionally, in the embodiment of the present application, the step S2 can further include:

[0228] Step S21, for each room in the target house, projecting the panoramic image data of the room by an equivalent rectangular projection manner to obtain an initial three-dimensional panoramic image of the room.

[0229] Step S22, performing vertical correction on the initial three-dimensional panoramic image to correct the horizontal angle error in shooting to obtain a three-dimensional panoramic image of the room.

[0230] In actual application, when the panoramic image data is shot, the horizontal angle error can be introduced in shooting, thereby affecting the accuracy and visual effect of the subsequent obtained three-dimensional panoramic image. Therefore, in the embodiment of the present application, the vertical correction can be performed on the initial three-dimensional panoramic image obtained by projection to correct the horizontal angle error introduced in shooting.

[0231] Therefore, for each room in the target house, the panoramic image data of the room is projected by the equivalent rectangular projection manner to obtain an initial three-dimensional panoramic image of the room, and then the vertical correction can be performed on the initial three-dimensional panoramic image to correct the horizontal angle error in shooting to obtain a three-dimensional panoramic image of the corresponding room.

[0232] The vertical correction can be performed by any available manner, which is not limited in the embodiment of the present application. For example, the vertical correction of the panoramic picture can be performed by using the existing tool such as the vertical line tool.

[0233] Optionally, in the embodiment of the present application, the step S22 can further include:

[0234] Step S221, projecting the auxiliary correction line segment marked in the panoramic image data into the three-dimensional space by the equivalent rectangular projection manner to obtain a projection line segment, the auxiliary correction line segment including at least one line segment perpendicular to the bottom surface of the panoramic image data.

[0235] Step S222, for any one projection line segment, obtaining a plane containing the projection line segment and the center point of the initial three-dimensional panoramic image.

[0236] Step S223, adjusting the initial three-dimensional panoramic image so that the intersection lines of all the planes are vertical lines and the intersection lines pass through the center point of the initial three-dimensional panoramic image to obtain a three-dimensional panoramic image of the room.

[0237] As aforementioned, since the Equirectangular Projection projection mode does not change the vertical relationship of meridians, in the embodiment of the present application, the vertical correction can be performed through at least one auxiliary correction line segment marked in advance in the panoramic image data. Specifically, the auxiliary correction line segment marked in the panoramic image data can be projected into the three-dimensional space through the equivalent rectangular projection mode to obtain a projection line segment, and the auxiliary correction line segment includes at least one line segment perpendicular to the bottom surface of the panoramic image data. For each projection line segment, a plane containing the projection line segment and the center point of the initial three-dimensional panoramic image is obtained. Further, the vertical correction of the corresponding initial three-dimensional panoramic image can be completed by adjusting the initial three-dimensional panoramic image so that the intersection line of all the planes is a vertical line and the intersection line passes through the center point of the initial three-dimensional panoramic image, thereby obtaining the three-dimensional panoramic image of the corresponding room.

[0238] For example, an auxiliary correction line segment perpendicular to the bottom surface can be marked in advance on the initial panoramic image data, marked as a, b, c, …, and the above line segment is projected into the three-dimensional space using the ERP projection relationship, and the generated line segment is marked as A, B, C, …, then A, B, C, … and the plane α, β, γ, … determined by the center point of the initial three-dimensional panoramic image.

[0239] From the constraint condition that the Equirectangular Projection projection mode does not change the vertical relationship of meridians, a, b, c, … are line segments perpendicular to the bottom surface, and A, B, C, … intersect at the center point of the initial three-dimensional panoramic image, it can be proved that A, B, C, … have and only have one intersection line, and the intersection line should coincide with the Y-axis of the coordinate system, that is, the vertical line, and pass through the center point of the initial three-dimensional panoramic image. In summary, the vertical correction work can be completed by rotating the intersection line Y-axis of A, B, C, … to coincide.

[0240] It should be noted that the above steps S1-S7 can be preformed on the server side for supporting the display of the panoramic image of the house, and can be performed only once for each target room to obtain the three-dimensional panoramic image, the 3D floor plan data, the actual size and the actual area of each room, and other model data. Other steps can be performed on the client side for displaying the three-dimensional panoramic image and the floor plan according to the user's instruction. Of course, the above steps S1-S7 can also be performed on the client side, and can also be performed multiple times according to the requirements, which are not limited by the embodiment of the present application.

[0241] Reference Figure 3 In the embodiment of the present application, the following can also be included:

[0242] Step 160: During the display of the three-dimensional panoramic image, obtain the nearest visible wall base point to the current viewpoint;

[0243] Step 170: Obtain the actual size of the corner line associated with the visible wall base point, and mark the actual size of the corner line in the display interface of the three-dimensional panoramic image.

[0244] In practical applications, users can actively switch viewpoints by clicking or viewing 3D panoramic images. During the display of 3D panoramic images, users can also control the image to rotate in a certain way, automatically adjusting the viewpoint to fully showcase the real scene of each room. Furthermore, as the viewpoint changes, the 3D panoramic image is rendered and displayed based on the latest viewpoint. The viewpoint can be understood as a virtual shooting point, different from the shooting point used when capturing panoramic image data. The virtual shooting point is the reference point used when rendering and displaying the 3D panoramic image, equivalent to the user's viewpoint when browsing the 3D panoramic image.

[0245] In this embodiment of the invention, in order to facilitate users to understand the actual size of the currently viewed real-world area in a timely manner during the viewing process, the visible wall base point closest to the current viewpoint can be obtained during the display of the three-dimensional panoramic image, and then the actual size of the corner line associated with the current visible wall base point can be obtained, and the actual size of the corresponding corner line can be marked in the display interface of the three-dimensional panoramic image.

[0246] Specifically, the nearest visible wall base point to the current viewpoint can be obtained through any available method, and this embodiment of the invention is not limited in this regard. Moreover, as mentioned above, in this embodiment of the invention, the actual size of the corner line associated with the corresponding visible wall base point can be calculated based on the conversion relationship between the model length and the actual length of the target house and the model size of the corner line associated with the visible wall base point, and the actual size of the corner line can be marked in the display interface of the three-dimensional panoramic image.

[0247] The way the actual dimensions of the corner lines are labeled in the 3D panoramic image display interface can be customized according to requirements, and this embodiment of the invention does not limit this.

[0248] like Figure 1B The interface for displaying the 3D panoramic image shows that you can now trace the actual dimensions of the corner line, which is the closest visible wall base point to the current viewpoint, by marking the actual dimensions of the corner line along the wall corner line using line segments of actual size.

[0249] Optionally, in an embodiment of the present invention, step 160 may further include:

[0250] Step 161: Obtain the angle between the first line and the line of sight center of the current viewpoint of the three-dimensional panoramic image. The first line is the line connecting the current viewpoint and the bottom mark point in the start mark of each wall in the three-dimensional panoramic image.

[0251] Step 162: Based on the first connecting line and the included angle, obtain the bottom marker point that satisfies the first preset condition, as the visible wall foot point closest to the current viewpoint; wherein, the first preset condition includes that the included angle corresponding to the bottom marker point is less than or equal to a preset field of view angle, and the length of the first connecting line corresponding to the bottom marker point is the shortest.

[0252] In this embodiment of the invention, in order to quickly and easily obtain the nearest visible wall base point to the current viewpoint, each wall can be pre-set to consist of two vertical markers, namely a start marker and an end marker, and each vertical marker consists of two marker points, namely a top marker point and a bottom marker point.

[0253] When the panoramic scale is active, it iterates through the bottom markers of the start markers on all walls, obtains the line connecting the current viewpoint to the bottom marker of the start marker of each wall in the 3D panoramic image, and uses it as the first line. In other words, it connects each bottom marker to the virtual camera position (i.e., the current viewpoint) and calculates the angle between the first line and the line of sight of the current viewpoint.

[0254] Then, based on the first connecting line and the included angle, a bottom marker point that meets the first preset condition can be obtained as the visible wall foot point closest to the current viewpoint; wherein, the first preset condition includes that the included angle corresponding to the bottom marker point is less than or equal to a preset field of view angle, and the length of the first connecting line corresponding to the bottom marker point is the shortest.

[0255] At this point, if the angle between the first connecting line and the center line of the current field of view exceeds the preset field of view angle, the bottom marker point corresponding to the first connecting line can be skipped. After traversal, the nearest visible corner point to the center of the field of view can be obtained. That is, the bottom marker point that satisfies the first preset condition mentioned above is taken as the nearest visible corner point to the current field of view. Find the corner line related to this visible corner point, calculate the length, multiply it by the scaling ratio to obtain the actual length data, and then draw this set of corner lines and length data on the page. Thus, a panoramic ruler can be quickly implemented. Moreover, in this embodiment of the invention, the panoramic ruler can be controlled to be turned on and off, and the above steps 160-170 are performed when the panoramic ruler is turned on.

[0256] The preset field of view can be set in advance as needed, and this embodiment of the invention does not limit this. For example, the preset field of view can be set to any angle between 75 degrees and 90 degrees, etc.

[0257] Optionally, in the embodiment of the present application, the display interface of the three-dimensional panoramic image further comprises a room label of each room in the target house, referring to Figure 4 , the method can further comprise:

[0258] Step 180, in response to receiving a viewing instruction for any of the room labels in the display interface of the three-dimensional panoramic image, displaying the three-dimensional panoramic image of the room corresponding to the room label in the display interface of the three-dimensional panoramic image.

[0259] In the embodiment of the present application, in order to facilitate the user to switch the display of the three-dimensional panoramic image of different rooms in the display interface of the three-dimensional panoramic image according to the real-time viewing needs, the display interface of the three-dimensional panoramic image can further comprise a room label of each room in the target house, so that the user can select the room currently wanted to browse through the room label, and then control the switching to the three-dimensional panoramic image of the currently selected room in the display interface of the three-dimensional panoramic image.

[0260] Wherein, the form of the room label and the position in the display interface of the three-dimensional panoramic image can be defined and set according to the needs, which is not limited in the embodiment of the present application.

[0261] For example, the form of the room label can be set as an image label containing the room type and the direction relative to the room to which the currently displayed three-dimensional panoramic image belongs, and in the display interface of the three-dimensional panoramic image, the room label of the corresponding room can be displayed at the position leading to the corresponding room in the currently displayed three-dimensional panoramic image; or, the form of the room label can also be set as a room thumbnail containing the room type, and in the display interface of the three-dimensional panoramic image, the room labels of the rooms can be arranged and displayed in a certain order below or above the display interface of the three-dimensional panoramic image, etc.

[0262] As shown in the display interface of the three-dimensional panoramic image, Figure 1B At this time, the icon with an arrow is used as the room label, and the room type is marked in the room label, wherein the arrow can represent the direction of the corresponding room relative to the currently displayed room, and at this time, the three-dimensional panoramic image of the currently selected room label can be jumped to by clicking the room label. In addition, for the display interface of the three-dimensional panoramic image as shown in Figure 1E At this time, the room labels in the form of room thumbnails are displayed below the display interface of the three-dimensional panoramic image, and the room label corresponding to the currently displayed three-dimensional panoramic image can also be highlighted.

[0263] If a viewing instruction for any room label is received in the display interface of the three-dimensional panoramic image, the three-dimensional panoramic image of the room corresponding to the room label can be displayed in the display interface of the three-dimensional panoramic image.

[0264] For example, assuming that the three-dimensional panoramic image of the living room is currently displayed in the display interface of the three-dimensional panoramic image, if a viewing instruction for the room label of the dining room in the display interface of the three-dimensional panoramic image is received, the three-dimensional panoramic image of the dining room can be switched to be displayed in the display interface of the three-dimensional panoramic image.

[0265] Referring to Figure 4 In the embodiment of the present application, the following can also be included:

[0266] In step 190, during the display of the three-dimensional panoramic image and the 3D floor plan, in response to receiving a two-dimensional interactive operation input through the screen, the two-dimensional interactive operation is converted to the three-dimensional space to obtain a three-dimensional interactive operation.

[0267] In step 1110, according to the three-dimensional interactive operation, a target object corresponding to the three-dimensional interactive operation is obtained, and the target object is controlled to perform an action corresponding to the three-dimensional interactive operation.

[0268] In addition, in the embodiment of the present application, during the display of the three-dimensional panoramic image and the 3D floor plan, the three-dimensional panoramic image and the 3D floor plan are in the three-dimensional space, but the display interface is a two-dimensional plane. Moreover, the page rendered by WebGL does not have a DOM structure, and cannot use the traditional browser-side event binding and proxy method. Therefore, the interaction of the user on the two-dimensional screen needs to be converted to the three-dimensional space.

[0269] Specifically, during the display of the three-dimensional panoramic image and the 3D floor plan, in response to receiving a two-dimensional interactive operation input through the screen, the two-dimensional interactive operation is converted to the three-dimensional space to obtain a three-dimensional interactive operation. Thus, according to the three-dimensional interactive operation, a target object corresponding to the three-dimensional interactive operation can be obtained, and the target object can be controlled to perform an action corresponding to the three-dimensional interactive operation.

[0270] The two-dimensional interaction operation can be converted into a three-dimensional space by any available method to obtain a three-dimensional interaction operation, which is not limited by the embodiments of the present application. For example, the two-dimensional interaction operation can be converted into a three-dimensional space by the ERP projection method described above, etc. Specifically, a trigger point in the two-dimensional interaction operation can be projected into a three-dimensional space to obtain a projection point of the trigger point, and then a direction in which the trigger point points to the projection point of the trigger point in the three-dimensional space is used to convert the two-dimensional interaction operation into the three-dimensional space to obtain the three-dimensional interaction operation. At this time, an object that is penetrated by a ray in the direction in which the trigger point points to the projection point of the trigger point can be obtained, and data comparison can be performed. The object that can be triggered at present is selected from the object that is penetrated by the ray as the target object. Then, the target object can be controlled to perform an action corresponding to the three-dimensional interaction operation, for example, an event corresponding to the target object can be directly triggered.

[0271] With reference to Figure 4 In the embodiments of the present application, after the step 110, the following steps can also be included:

[0272] In step 1120, in response to receiving a panorama switching instruction in the display interface of the three-dimensional panorama image, the texture transparency of the sky box of the original three-dimensional panorama image before switching is decreased over time, the texture transparency of the sky box of the target three-dimensional panorama image to be switched is increased over time, and the sum of the texture transparency of the sky box of the original three-dimensional panorama image and the texture transparency of the sky box of the target three-dimensional panorama image is ensured to be a preset value.

[0273] In step 1130, the spatial position of the virtual camera used for rendering is moved from the original three-dimensional panorama image to the target three-dimensional panorama image, so that the three-dimensional panorama image displayed in the display interface of the three-dimensional panorama image is switched from the original three-dimensional panorama image to the target three-dimensional panorama image. The center of the sky box of each three-dimensional panorama image is consistent with the spatial camera position of the shooting point of the three-dimensional panorama image.

[0274] In addition, in the embodiment of the present application, in order to improve the switching effect of the three-dimensional panoramic images of different rooms, if a panoramic switching instruction is received in the display interface of the three-dimensional panoramic image, the texture transparency of the SkyBox of the original three-dimensional panoramic image before switching is decreased over time, the texture transparency of the SkyBox of the target three-dimensional panoramic image to be switched is increased over time, and the sum of the texture transparency of the SkyBox of the original three-dimensional panoramic image and the texture transparency of the SkyBox of the target three-dimensional panoramic image is ensured to be a preset value; and the spatial position of the virtual camera for rendering is moved from the original three-dimensional panoramic image to the target three-dimensional panoramic image, so as to switch the displayed three-dimensional panoramic image from the original three-dimensional panoramic image to the target three-dimensional panoramic image in the display interface of the three-dimensional panoramic image; wherein the center of the SkyBox of each three-dimensional panoramic image is consistent with the spatial camera position of the shooting point of the three-dimensional panoramic image.

[0275] The lower the value of the texture transparency, the higher the transparency program, that is, if the texture transparency is 0, it means that it is completely transparent, and vice versa, if the texture transparency is the highest value, it means that it is completely opaque. The decreasing speed of the texture transparency of the SkyBox of the original three-dimensional panoramic image and the increasing speed of the texture transparency of the SkyBox of the target three-dimensional panoramic image can be customized according to requirements, but it is necessary to ensure that the sum of the texture transparency of the SkyBox of the original three-dimensional panoramic image and the texture transparency of the SkyBox of the target three-dimensional panoramic image is a preset value during the switching process. The preset value can be customized according to requirements.

[0276] For example, assuming that the expression of the texture transparency is in percentage, the preset value can be set to 1, that is, 100%, or the preset value can be set to 80%, 90%, etc.

[0277] In addition, in the embodiment of the present application, the SkyBox can be obtained by any available way, which is not limited in the embodiment of the present application.

[0278] Further, in the embodiment of the present application, the panoramic switching instruction can be input by any available way, which is not limited in the embodiment of the present application. For example, the panoramic switching instruction can be input by triggering any room label of a room other than the currently displayed room in the display interface of the three-dimensional panoramic image, or by sliding or other ways to input the panoramic switching instruction, etc.

[0279] Optionally, in the embodiment of the present application, the coordinate system of the house type diagram is the same as that of the three-dimensional panoramic image, and the display orientation of the house type diagram thumbnail is consistent with the display orientation of the three-dimensional panoramic image in the display interface of the three-dimensional panoramic image.

[0280] In terms of animation of scene switching, if coordinate systems of different scenes are different, the problem of inconsistency of animation switching critical value frames before and after can easily occur. Therefore, in the embodiment of the application, the coordinate systems of associated objects can be adjusted to be consistent, that is, unified, so that the coordinate systems of the house type diagram and the three-dimensional panoramic image are the same, thereby the problem of inconsistency of animation switching critical value frames before and after can be solved, and smooth animation and roaming effects can be realized.

[0281] Referring to Figure 5 , a structural schematic diagram of a house real scene diagram display device in an embodiment of the application is shown.

[0282] The house real scene diagram display device in the embodiment of the application comprises a panoramic image display module 210, a house type diagram display module 220, and a real scene area marking module 230.

[0283] The functions of each module and the interaction relationship between the modules will be introduced in detail below.

[0284] The panoramic image display module 210 is configured to receive a viewing instruction for a target house, load and display a three-dimensional panoramic image in the target house, and display a house type thumbnail of the target house in a thumbnail frame in a display interface of the three-dimensional panoramic image, wherein the house type thumbnail comprises a 3D house type thumbnail and / or a 2D house type thumbnail.

[0285] The house type diagram display module 220 is configured to, in response to receiving a viewing instruction for the house type thumbnail in the display interface of the three-dimensional panoramic image, jump to a display interface of a house type diagram of the target house, wherein the house type diagram comprises a 3D house type diagram and a 2D house type diagram, and an initial display orientation of the house type diagram in the display interface of the house type diagram is consistent with a display orientation of the three-dimensional panoramic image.

[0286] The real scene area marking module 230 is configured to obtain a shooting point of a three-dimensional panoramic image currently displayed in a display interface of the three-dimensional panoramic image, and mark a real scene area included in the display interface of the three-dimensional panoramic image on the house type diagram in a display interface of a house type diagram of the target house according to the shooting point.

[0287] Referring to Figure 6 In the embodiment of the application, the panoramic image display module 210 can further comprise:

[0288] The model data loading submodule 211 is configured to receive a viewing instruction for a target house, load model data of the target house, wherein the model data comprises 3D house type diagram data of the target house and a three-dimensional panoramic image of each room, and the house type diagram data comprises 3D house type diagram data and / or a 2D house type diagram;

[0289] The house type diagram generation submodule 212 is configured to generate a 3D house type diagram of the target house and a 2D house type diagram of the target house according to the 3D house type diagram data of the target house.

[0290] The first association submodule 213 is configured to establish a first association relationship between each room in the 3D house type diagram of the target house and the three-dimensional panoramic image in the model data.

[0291] The house type thumbnail generation submodule 214 is configured to generate a 3D house type thumbnail and / or a 2D house type thumbnail of the target house by scaling down the 3D house type diagram and / or the 2D house type diagram of the target house to the thumbnail frame.

[0292] The panoramic image display module 215 is configured to display the three-dimensional panoramic image in the model data and display the 3D house type thumbnail and / or the 2D house type thumbnail of the target house in the thumbnail frame in the display interface of the three-dimensional panoramic image.

[0293] Optionally, in the embodiment of the present application, the house type diagram generation submodule 212 can further include:

[0294] The 3D model acquisition unit is configured to render a 3D model of each room according to the 3D house type diagram data of each room, splice the 3D models of the rooms, and obtain the 3D model of the target house.

[0295] The planar 2D projection drawing unit is configured to draw a planar 2D projection corresponding to the 3D model of the target house by using wall data in the 3D house type diagram data.

[0296] The second association unit is configured to establish a second association relationship between the 3D model of the target house and the planar 2D projection, so that each room in the planar 2D projection and each room in the 3D model of the target house correspond to each other according to the second association relationship to establish the 3D house type diagram of the target house.

[0297] The 2D house type diagram acquisition unit is configured to take the planar 2D projection corresponding to the 3D model of the target house as the 2D house type diagram of the target house.

[0298] Optionally, in the embodiment of the present application, the house type diagram generation submodule 212 can further include:

[0299] The first house type diagram panorama diagram jump module is configured to, in response to receiving a viewing instruction for any room in the 2D house type diagram in a display interface of the house type diagram, determine, according to the second association relationship, the any room 3D house type diagram associated with the 2D house type diagram of the any room, and then jump to a display interface of the three-dimensional panorama diagram to display the three-dimensional panorama diagram of the any room according to the first association relationship and through the any room 3D house type diagram.

[0300] The second house type diagram panorama diagram jump module is configured to, in response to receiving a viewing instruction for any room in the 3D house type diagram in a display interface of the house type diagram, jump to a display interface of the three-dimensional panorama diagram to display the three-dimensional panorama diagram of the any room according to the first association relationship.

[0301] Reference Figure 6 In the embodiment of the present application, the real scene area marking module 230 can further include:

[0302] The target room confirmation sub-module 231 is configured to acquire a shooting point of a real scene area currently displayed in a display interface of the three-dimensional panorama diagram, and determine a target room to which the real scene area currently displayed in the display interface of the three-dimensional panorama diagram belongs according to the shooting point.

[0303] The target room marking sub-module 232 is configured to mark the target room in the display interface of the house type diagram.

[0304] Optionally, in the embodiment of the present application, the target room marking sub-module 232 can further include:

[0305] The first marking unit is configured to mark the target room with a specific symbol in the display interface of the house type diagram; and / or,

[0306] The second marking unit is configured to mark room information of the target room in the display interface of the house type diagram, and the room information includes at least one of room type, room size and room area.

[0307] Reference Figure 6 In the embodiment of the present application, the house type diagram display module 220 can further include:

[0308] The view point initial height acquisition sub-module 221 is configured to, in response to receiving a viewing instruction for the house type thumbnail in a display interface of the three-dimensional panorama diagram, jump to a display interface of a house type diagram of the target house to display a 3D house type diagram, and acquire a view point initial height according to a field of view angle and a 3D model size of the target house.

[0309] The 3D house type diagram display submodule 222 is configured to render and display the 3D house type diagram according to the initial height of the view point.

[0310] With reference to Figure 7 In the embodiment of the present application, the device can further comprise:

[0311] The panoramic image data acquisition module A1 is configured to acquire panoramic image data of each room in the target house.

[0312] The three-dimensional panoramic image acquisition module A2 is configured to, for each room in the target house, project the panoramic image data of the room to obtain a three-dimensional panoramic image of the room.

[0313] The marker point data acquisition module A3 is configured to, according to the three-dimensional panoramic image, mark components contained in the room to obtain marker point data of each room.

[0314] The 3D house type diagram data acquisition module A4 is configured to acquire 3D house type diagram data of the target house according to the marker point data and relative position relationship of each room in the target house.

[0315] Optionally, in the embodiment of the present application, the 3D house type diagram data acquisition module A4 can further comprise:

[0316] The room model data acquisition submodule is configured to acquire model data of each room according to the marker point data.

[0317] The 3D house type diagram data acquisition submodule is configured to combine to obtain 3D house type diagram data of the target house according to the connection relationship of each room in the target house and the model data of each room.

[0318] Optionally, in the embodiment of the present application, the 3D house type diagram data acquisition module A4 can further comprise:

[0319] The connection relationship acquisition submodule is configured to acquire the connection relationship of each room in the target house according to the three-dimensional panoramic image of each room, and / or acquire the connection relationship of each room in the target house according to position information of the shooting point of each room.

[0320] Optionally, in the embodiment of the present application, the device can further comprise:

[0321] The shooting point actual height acquisition module A5 is configured to, for any one room in the target house, project the shooting point of the room into a 3D model of the room to acquire height data of the shooting point in the 3D model.

[0322] The length conversion relationship obtaining module A6 is configured to obtain a conversion relationship between a model length and an actual length of the target house according to the actual height of the shooting point and the height data of the shooting point in the 3D model.

[0323] The actual size area obtaining module A7 is configured to obtain actual areas and actual sizes of each room in the target house according to the conversion relationship.

[0324] Optionally, in the embodiment of the present application, the three-dimensional panoramic image obtaining module A2 can further include:

[0325] The equivalent rectangular projection submodule is configured to project panoramic image data of each room in the target house by an equivalent rectangular projection manner to obtain an initial three-dimensional panoramic image of the room.

[0326] The vertical correction submodule is configured to perform vertical correction on the initial three-dimensional panoramic image to correct horizontal angle errors in shooting, so as to obtain a three-dimensional panoramic image of the room.

[0327] Optionally, in the embodiment of the present application, the vertical correction submodule can further include:

[0328] The auxiliary correction line segment projection unit is configured to project an auxiliary correction line segment marked in the panoramic image data into a three-dimensional space by the equivalent rectangular projection manner to obtain a projection line segment, the auxiliary correction line segment including at least one line segment perpendicular to a bottom surface of the panoramic image data.

[0329] The plane construction submodule unit is configured to obtain a plane containing the projection line segment and a center point of the initial three-dimensional panoramic image for any one projection line segment.

[0330] The vertical correction unit is configured to adjust the initial three-dimensional panoramic image so that intersection lines of all the planes are vertical lines and the intersection lines pass through the center point of the initial three-dimensional panoramic image, so as to obtain a three-dimensional panoramic image of the room.

[0331] Reference Figure 7 In the embodiment of the present application, the three-dimensional panoramic image display method can further include:

[0332] The nearest visible wall foot point obtaining module 240 is configured to obtain a nearest visible wall foot point from a current view point in a display process of the three-dimensional panoramic image.

[0333] The panoramic ruler module 250 is configured to obtain actual sizes of wall corner lines associated with the visible wall foot point and mark the actual sizes of the wall corner lines in a display interface of the three-dimensional panoramic image.

[0334] Optionally, in the embodiment of the present application, the nearest visible wall foot point acquisition module 240 can further include:

[0335] An included angle acquisition submodule is configured to acquire an included angle between a first line and a line-of-sight center line of a current view point of the three-dimensional panoramic image, the first line being a line connecting the current view point and a bottom mark point in a start mark of each wall surface in the three-dimensional panoramic image;

[0336] A nearest visible wall foot point acquisition submodule is configured to acquire, according to the first line and the included angle, a bottom mark point satisfying a first preset condition as a nearest visible wall foot point from the current view point, wherein the first preset condition includes that an included angle corresponding to the bottom mark point is less than or equal to a preset field of view angle, and a first line length corresponding to the bottom mark point is the shortest.

[0337] Optionally, in the embodiment of the present application, the display interface of the three-dimensional panoramic image further includes a room label of each room in the target house, and correspondingly, refer to Figure 8 In the embodiment of the present application, the device can further include:

[0338] A three-dimensional panoramic image switching module 260 is configured to, in response to receiving a viewing instruction for any room label in the display interface of the three-dimensional panoramic image, display a three-dimensional panoramic image of a room corresponding to the room label in the display interface of the three-dimensional panoramic image.

[0339] In the embodiment of the present application, the device can further include:

[0340] A three-dimensional interactive operation acquisition module 270 is configured to, in the display process of the three-dimensional panoramic image and the 3D floor plan, in response to receiving a two-dimensional interactive operation input through a screen, convert the two-dimensional interactive operation to a three-dimensional space to obtain a three-dimensional interactive operation.

[0341] A target object event execution module 280 is configured to, according to the three-dimensional interactive operation, acquire a target object corresponding to the three-dimensional interactive operation, and control the target object to perform an action corresponding to the three-dimensional interactive operation.

[0342] In the embodiment of the present application, the device can further include:

[0343] A skybox transparency adjustment module 290 is configured to, in response to receiving a panoramic switching instruction in the display interface of the three-dimensional panoramic image, decrease a texture transparency of a skybox of an original three-dimensional panoramic image before switching over time, increase a texture transparency of a skybox of a target three-dimensional panoramic image to be switched over time, and ensure that a sum of the texture transparency of the skybox of the original three-dimensional panoramic image and the texture transparency of the skybox of the target three-dimensional panoramic image is a preset value.

[0344] The virtual camera space position adjustment module 2110 is configured to move the space position of the virtual camera for rendering from an original three-dimensional panoramic image to the target three-dimensional panoramic image, so as to switch the displayed three-dimensional panoramic image from the original three-dimensional panoramic image to the target three-dimensional panoramic image in the display interface of the three-dimensional panoramic image; wherein the center of the sky box of each three-dimensional panoramic image is consistent with the space camera position of the shooting point of the three-dimensional panoramic image.

[0345] Optionally, in the embodiment of the present application, the floor plan and the coordinate system of the three-dimensional panoramic image are the same, and in the display interface of the three-dimensional panoramic image, the display orientation of the floor plan thumbnail is consistent with the display orientation of the three-dimensional panoramic image.

[0346] In the embodiment of the present application, the coordinates in the scenes such as the floor plan and the three-dimensional panoramic image can also be converted correspondingly, so that they are consistent with the orientation in reality, thereby realizing the instant synchronization of the operation, the view angle, and the display orientation in each scene; and the current position in the 2D floor plan, the 3D floor plan, and the bottom panel thumbnail is consistent with the room in which the three-dimensional panoramic image is located.

[0347] At the same time, the house orientation information, that is, the current position in the 2D floor plan, the 3D floor plan, and the room thumbnail of the bottom of the target house is consistent with the room in which the currently displayed three-dimensional panoramic image is located.

[0348] Moreover, in the embodiment of the present application, the switching of the three-dimensional panoramic images of different rooms can be realized by clicking the room icon or the ground point in the three-dimensional panoramic image. The view angle change of the current room can also be realized by means such as single-finger rotation and double-finger zoom.

[0349] For example, the display interface of the three-dimensional panoramic image can be adjusted from Figure 1E to Figure 1F , and the like.

[0350] The apparatus provided in the embodiment of the present application can realize each process in the method embodiment, and thus the details are not repeated here. Figures 1 to 4

[0351] Figure 9 A hardware structure diagram of a terminal device for implementing each embodiment of the present application.

[0352] ​The terminal device 500 includes, but is not limited to, a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, a processor 510, and a power supply 511, and the like. Those skilled in the art can understand that Figure 9 The terminal device structure shown in the figure is not a limitation on the terminal device, and the terminal device can include more or less components than the figure, or combine certain components, or different component arrangements. In the embodiments of the present application, the terminal device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, and a pedometer, and the like.

[0353] It should be understood that in the embodiments of the present application, the radio frequency unit 501 can be used for receiving and transmitting signals in the process of information or call, specifically, receiving downlink data from the base station for the processor 510 to process, and transmitting uplink data to the base station. Generally, the radio frequency unit 501 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 501 can also communicate with the network and other devices through a wireless communication system.

[0354] The terminal device provides wireless broadband Internet access for users through the network module 502, such as helping users to send and receive emails, browse web pages, and access streaming media, and the like.

[0355] The audio output unit 503 can convert audio data received by the radio frequency unit 501 or the network module 502 or stored in the memory 509 into an audio signal and output as a sound. Moreover, the audio output unit 503 can also provide audio output related to a specific function performed by the terminal device 500 (for example, a call signal receiving sound, a message receiving sound, and the like). The audio output unit 503 includes a speaker, a buzzer, and a receiver, and the like.

[0356] The input unit 504 is configured to receive audio or video signals. The input unit 504 can include a graphics processor (GPU) 5041 and a microphone 5042. The graphics processor 5041 processes image data of a still picture or a video obtained by an image capture device (e.g., a camera) in a video capture mode or an image capture mode. Processed image frames can be displayed on the display unit 506. Processed image frames can be stored in the memory 509 (or other storage medium) or transmitted via the radio frequency unit 501 or the network module 502. The microphone 5042 can receive sound and can process such sound as audio data. Processed audio data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 501 in a telephone call mode.

[0357] The terminal device 500 further includes at least one sensor 505, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 5061 according to the brightness of ambient light, and the proximity sensor can turn off the display panel 5061 and / or the backlight when the terminal device 500 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), and when at rest, can detect the magnitude and direction of gravity, and can be used to identify the terminal device posture (such as screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, knock), etc. The sensor 505 can also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be described here.

[0358] The display unit 506 is configured to display information input by a user or information provided to the user. The display unit 506 can include a display panel 5061, which can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc.

[0359] The user input unit 507 can be used to receive inputted numerical or character information, and to generate key signal inputs related to user settings of the terminal device and function controls. Specifically, the user input unit 507 includes a touch panel 5071 and other input devices 5072. The touch panel 5071, also called a touch screen, can collect touch operations of a user thereon or adjacent thereto (such as operations of the user using a finger, a stylus, or any suitable object or accessory on or adjacent to the touch panel 5071). The touch panel 5071 can include two parts, a touch detection device and a touch controller. The touch detection device detects the touch position of the user and detects signals resulting from touch operations, and transmits the signals to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch coordinates, and sends it to the processor 510, receives commands from the processor 510 and executes them. In addition, the touch panel 5071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 5071, the user input unit 507 can also include other input devices 5072. Specifically, the other input devices 5072 can include, but are not limited to, a physical keyboard, function keys (such as volume control keys, on / off keys, etc.), trackballs, mice, joysticks, and the like, which will not be described here.

[0360] Further, the touch panel 5071 can be overlaid on the display panel 5061, and when the touch panel 5071 detects a touch operation thereon or adjacent thereto, it transmits to the processor 510 to determine the type of touch event, and then the processor 510 provides corresponding visual output on the display panel 5061 according to the type of touch event. Although in the above embodiment, the touch panel 5071 and the display panel 5061 are implemented as two independent components to realize the input and output functions of the terminal device, in some embodiments, the touch panel 5071 and the display panel 5061 can be integrated to realize the input and output functions of the terminal device, which is not limited here. Figure 9

[0361] The interface unit 508 is an interface for connecting external devices to the terminal device 500. For example, the external devices can include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input / output (I / O) port, a video I / O port, an earphone port, and the like. The interface unit 508 can be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the terminal device 500, or can be used to transmit data between the terminal device 500 and external devices.

[0362] ​The memory 509 can be used to store software programs and various data. The memory 509 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, application programs required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; and the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), and the like. In addition, the memory 509 can include a high-speed random access memory, and can also include a non-volatile memory, for example, at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device.

[0363] The processor 510 is a control center of the terminal device, connects all parts of the terminal device through various interfaces and lines, executes various functions of the terminal device and processes data by running or executing software programs and / or modules stored in the memory 509 and calling data stored in the memory 509, and thus monitors the terminal device as a whole. The processor 510 can include one or more processing units; preferably, the processor 510 can integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the like, and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 510.

[0364] The terminal device 500 can also include a power supply 511 (such as a battery) for supplying power to various components; preferably, the power supply 511 can be logically connected to the processor 510 through a power management system, so as to realize functions of managing charging, discharging, and power consumption management, and the like through the power management system.

[0365] In addition, the terminal device 500 includes some functional modules which are not shown and will not be described here.

[0366] Preferably, the embodiment of the present application also provides a terminal device, which includes a processor 510, a memory 509, and a computer program stored in the memory 509 and executable on the processor 510, wherein the computer program is executed by the processor 510 to realize each process of the above-mentioned house real scene display method embodiment and achieve the same technical effect, and details are not repeated here to avoid repetition.

[0367] The embodiment of the present application also provides a computer readable storage medium, and the computer readable storage medium stores a computer program, the computer program is executed by a processor to realize each process of the house real scene picture display method embodiment, and the same technical effects can be achieved, to avoid repetition, which will not be described here. The computer readable storage medium includes a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk or an optical disk, and the like.

[0368] It should be noted that in this paper, the term "including", "containing" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitations, the element defined by the statement "including a" does not exclude the presence of another identical element in the process, method, article or device including the element.

[0369] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment method can be realized by means of software and necessary general hardware platform, of course, it can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a plurality of instructions for making a terminal (which can be a mobile phone, computer, server, air conditioner or network equipment) execute the method described in each embodiment of the present application.

[0370] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the above-mentioned specific embodiments, the above-mentioned specific embodiments are only illustrative, not restrictive, and those skilled in the art can make many forms under the inspiration of the present application without departing from the scope of the present application and the scope protected by the claims.

[0371] Those skilled in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed in the embodiments of the present application can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solutions. Professional technicians can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0372] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

[0373] In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented by other manners. For example, the apparatus embodiments described above are only schematic, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms.

[0374] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0375] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit.

[0376] If the functions are realized in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application or the part of the present application that essentially contributes to the prior art or the part of the technical solutions can be embodied in the form of software products. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The foregoing storage medium includes: U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk and various program code storage media.

[0377] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical range disclosed in the present application, which should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A method of presenting a real estate property, characterized by, The method comprises the following steps: receiving a viewing instruction for a target house, loading and displaying a three-dimensional panoramic image in the target house, and displaying a house type thumbnail of the target house in a thumbnail box in a display interface of the three-dimensional panoramic image, wherein the house type thumbnail comprises a 3D house type thumbnail and / or a 2D house type thumbnail; in response to receiving a viewing instruction for the house type thumbnail in the display interface of the three-dimensional panoramic image, jumping to a display interface of a house type drawing of the target house, wherein the house type drawing comprises a 3D house type drawing and a 2D house type drawing, and an initial display orientation of the house type drawing in the display interface of the house type drawing is consistent with a display orientation of the three-dimensional panoramic image; obtaining a shooting point of a three-dimensional panoramic image currently displayed in the display interface of the three-dimensional panoramic image, and marking a real scene region included in the display interface of the three-dimensional panoramic image on the house type drawing in the display interface of the house type drawing of the target house according to the shooting point; in the display process of the three-dimensional panoramic image and the 3D house type drawing, in response to receiving a two-dimensional interaction operation input through a screen, converting the two-dimensional interaction operation into a three-dimensional space to obtain a three-dimensional interaction operation; according to the three-dimensional interaction operation, obtaining a target object corresponding to the three-dimensional interaction operation, and controlling the target object to perform an action corresponding to the three-dimensional interaction operation.

2. The method of claim 1, wherein, The step of receiving a viewing instruction for a target house, loading and displaying a three-dimensional panoramic image in the target house, and displaying a house type thumbnail of the target house in a thumbnail box in a display interface of the three-dimensional panoramic image comprises the following steps: receiving a viewing instruction for a target house, loading model data of the target house, wherein the model data comprises 3D house type drawing data of the target house and three-dimensional panoramic images of each room; generating a 3D house type drawing of the target house and a 2D house type drawing of the target house according to the 3D house type drawing data of the target house; establishing a first association relationship between a 3D house type drawing of each room in the 3D house type drawing of the target house and a three-dimensional panoramic image in the model data; scaling down the 3D house type drawing of the target house and / or the 2D house type drawing of the target house to the thumbnail box to generate a 3D house type thumbnail of the target house and / or a 2D house type thumbnail of the target house; displaying the three-dimensional panoramic images in the model data, and displaying the 3D house type thumbnail of the target house and / or the 2D house type thumbnail of the target house in the thumbnail box in the display interface of the three-dimensional panoramic image.

3. The method of claim 2, wherein, The step of generating a 3D house type drawing of the target house and a 2D house type drawing of the target house according to the house type drawing data of the target house comprises the following steps: rendering a 3D model of each room according to 3D house type drawing data of each room, and splicing the 3D models of each room to obtain a 3D model of the target house; drawing a plane 2D projection corresponding to the 3D model of the target house by using wall data in the 3D house type drawing data. establish a second correlation between the 3D model of the target house and the planar 2D projection, so as to correspond each room in the planar 2D projection to each room in the 3D model of the target house according to the second correlation to establish a 3D floor plan of the target house; use the planar 2D projection corresponding to the 3D model of the target house as a 2D floor plan of the target house.

4. The method of claim 3, wherein, After the step of jumping to the display interface of the floor plan of the target house in response to receiving a viewing instruction for the floor plan thumbnail in the display interface of the three-dimensional panoramic image, the method further comprises: in response to receiving a viewing instruction for any room in the 2D floor plan in the display interface of the floor plan, determining, according to the second correlation, a 3D floor plan of the any room corresponding to the 2D floor plan of the any room, and then jumping to the display interface of the three-dimensional panoramic image corresponding to the 3D floor plan of the any room according to the first correlation. in response to receiving a viewing instruction for any room in the 3D floor plan in the display interface of the floor plan, jumping to the display interface of the three-dimensional panoramic image corresponding to the three-dimensional panoramic image of the any room according to the first correlation.

5. The method of claim 1, wherein, The step of obtaining a shooting point of the three-dimensional panoramic image currently displayed in the display interface of the three-dimensional panoramic image, and marking a real scene region included in the display interface of the three-dimensional panoramic image on the floor plan according to the shooting point, comprises: obtaining a shooting point of a real scene region currently displayed in the display interface of the three-dimensional panoramic image, and determining a target room to which the real scene region currently displayed in the display interface of the three-dimensional panoramic image belongs according to the shooting point; marking the target room in the display interface of the floor plan.

6. The method of claim 5, wherein, The step of marking the target room in the display interface of the floor plan comprises: annotating the target room with a specific symbol in the display interface of the floor plan; and / or marking room information of the target room in the display interface of the floor plan, the room information comprising at least one of a room type, a room size, and a room area.

7. The method of claim 1, wherein, Before the step of receiving a viewing instruction for a target house, loading and displaying three-dimensional panoramic images in the target house, and displaying a floor plan thumbnail of the target house in a thumbnail frame in a display interface of the three-dimensional panoramic images, the method further comprises: obtaining panoramic image data of each room in the target house; for each room in the target house, projecting according to the panoramic image data of the room to obtain a three-dimensional panoramic image of the room; labeling components contained in the room according to the three-dimensional panoramic image to obtain labeling point data of each room; obtaining the 3D floor plan data of the target house according to the labeling point data and a relative positional relationship of each room in the target house.

8. The method of claim 7, wherein, The step of obtaining the 3D floor plan data of the target house according to the mark point data and the relative position relationship of each room in the target house comprises: obtaining model data of each room according to the mark point data; combining the 3D floor plan data of the target house according to the connection relationship of each room in the target house and the model data of each room.

9. The method of claim 8, wherein, Before the step of combining the 3D floor plan data of the target house according to the connection relationship of each room in the target house and the model data of each room, the method further comprises: obtaining the connection relationship of each room in the target house according to the three-dimensional panoramic image of each room; and / or, obtaining the connection relationship of each room in the target house according to the position information of the shooting point of each room.

10. The method of claim 7, wherein, After the step of obtaining the 3D floor plan data of the target house according to the mark point data and the relative position relationship of each room in the target house, the method further comprises: projecting the shooting point of any one room in the target house into the 3D model of the room to obtain the height data of the shooting point in the 3D model; obtaining the conversion relationship between the model length and the real length of the target house according to the actual height of the shooting point and the height data of the shooting point in the 3D model; obtaining the actual area and actual size of each room in the target house according to the conversion relationship.

11. The method according to any one of claims 7-10, characterized in that, The step of obtaining the three-dimensional panoramic image of each room in the target house according to the panoramic image data of the room comprises: projecting the panoramic image data of each room in the target house by an equivalent rectangular projection method to obtain an initial three-dimensional panoramic image of the room; performing vertical correction on the initial three-dimensional panoramic image to correct the horizontal angle error during shooting to obtain the three-dimensional panoramic image of the room.

12. The method of claim 11, wherein, The step of performing vertical correction on the initial three-dimensional panoramic image to correct the horizontal angle error during shooting to obtain the three-dimensional panoramic image of the room comprises: projecting an auxiliary correction line segment marked in the panoramic image data into a three-dimensional space by the equivalent rectangular projection method to obtain a projection line segment, the auxiliary correction line segment comprising at least one line segment perpendicular to the bottom surface of the panoramic image data; for any one projection line segment, obtaining a plane containing the projection line segment and the center point of the initial three-dimensional panoramic image; adjusting the initial three-dimensional panoramic image so that the intersection lines of all the planes are vertical lines and the intersection lines pass through the center point of the initial three-dimensional panoramic image to obtain the three-dimensional panoramic image of the room.

13. The method of claim 10, wherein, The method further comprises: during the display of the three-dimensional panoramic image, obtaining the closest visible wall foot point from the current view point; obtaining the actual size of the wall corner line associated with the visible wall foot point and marking the actual size of the wall corner line in the display interface of the three-dimensional panoramic image.

14. The method of claim 13, wherein, The step of acquiring the closest visible wall foot point from the current view point in the display process of the three-dimensional panoramic image comprises: acquiring an included angle between a first line and a sight line center line of the current view point of the three-dimensional panoramic image, the first line being a line connecting the current view point and a bottom mark point in a start mark of each wall surface in the three-dimensional panoramic image; acquiring a bottom mark point satisfying a first preset condition as the closest visible wall foot point from the current view point according to the first line and the included angle; The first preset condition comprises that the included angle corresponding to the bottom mark point is less than or equal to a preset field of view angle, and the first line length corresponding to the bottom mark point is the shortest.

15. The method of claim 1, wherein, The step of jumping to the display interface of the floor plan of the target house in response to receiving a viewing instruction for the house type thumbnail in the display interface of the three-dimensional panoramic image comprises: in response to receiving a viewing instruction for the house type thumbnail in the display interface of the three-dimensional panoramic image, jumping to the display interface of the floor plan of the target house, and displaying a 3D floor plan, acquiring an initial height of a view point according to a field of view angle and a 3D model size of the target house; rendering and displaying the 3D floor plan according to the initial height of the view point.

16. The method of claim 1, wherein, The display interface of the three-dimensional panoramic image further comprises room labels of each room in the target house, and the method further comprises: in response to receiving a viewing instruction for any room label in the display interface of the three-dimensional panoramic image, displaying a three-dimensional panoramic image of a room corresponding to the room label in the display interface of the three-dimensional panoramic image.

17. The method of claim 1, wherein, After the step of receiving a viewing instruction for a target house, loading and displaying a three-dimensional panoramic image in the target house, and displaying a house type thumbnail of the target house in a thumbnail frame in a display interface of the three-dimensional panoramic image, the method further comprises: in response to receiving a panoramic switching instruction in the display interface of the three-dimensional panoramic image, decreasing a texture transparency of a sky box of an original three-dimensional panoramic image before switching over time, increasing a texture transparency of a sky box of a target three-dimensional panoramic image to be switched over time, and ensuring that the sum of the texture transparency of the sky box of the original three-dimensional panoramic image and the texture transparency of the sky box of the target three-dimensional panoramic image is a preset value; moving a spatial position of a virtual camera for rendering from the original three-dimensional panoramic image to the target three-dimensional panoramic image, so as to switch the displayed three-dimensional panoramic image from the original three-dimensional panoramic image to the target three-dimensional panoramic image in the display interface of the three-dimensional panoramic image. The center of the sky box of each three-dimensional panoramic image is consistent with the spatial camera position of a shooting point of the three-dimensional panoramic image.

18. The method of claim 1, wherein, The floor plan and the three-dimensional panoramic image have the same coordinate system, and the display orientation of the floor plan thumbnail is consistent with the display orientation of the three-dimensional panoramic image in the display interface of the three-dimensional panoramic image.

19. A housing reality map presentation device, characterized by, comprises: The panorama display module is configured to receive a viewing instruction for a target house, load and display a three-dimensional panorama image in the target house, and display a house type thumbnail of the target house in a thumbnail frame in a display interface of the three-dimensional panorama image, the house type thumbnail including a 3D house type thumbnail and / or a 2D house type thumbnail. The house type display module is configured to, in response to receiving a viewing instruction for the house type thumbnail in the display interface of the three-dimensional panorama image, jump to a display interface of a house type diagram of the target house, wherein the house type diagram includes a 3D house type diagram and a 2D house type diagram, and an initial display orientation of the house type diagram in the display interface of the house type diagram is consistent with a display orientation of the three-dimensional panorama image. The real scene region marking module is configured to obtain a shooting point of a three-dimensional panorama image currently displayed in a display interface of the three-dimensional panorama image, and mark a real scene region included in the display interface of the three-dimensional panorama image on the house type diagram in the display interface of the house type diagram of the target house according to the shooting point. The three-dimensional interactive operation obtaining module is configured to, in a display process of the three-dimensional panorama image and the 3D house type diagram, convert a two-dimensional interactive operation input through a screen into a three-dimensional interactive operation in response to receiving the two-dimensional interactive operation. The target object event executing module is configured to obtain a target object corresponding to the three-dimensional interactive operation according to the three-dimensional interactive operation, and control the target object to perform an action corresponding to the three-dimensional interactive operation.

20. A terminal device, comprising: The computer program is stored on the computer readable storage medium and is executed by the processor to implement the steps of the house real scene diagram display method according to any one of claims 1 to 18. The computer program is stored on the computer readable storage medium and is executed by the processor to implement the steps of the house real scene diagram display method according to any one of claims 1 to 18.

21. A computer-readable storage medium, characterized in that, ​

Images