Indoor three-dimensional model generation method and device, equipment, medium and product
By generating a scene top view of 2D blocks and receiving user modifications, the problem of low efficiency in generating indoor 3D models in existing technologies is solved, and efficient 3D model generation and editing are achieved.
Patent Information
- Application Number
- CN202610049279.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-01-14
- Publication Date
- 2026-04-28
AI Technical Summary
Existing technologies require manual adjustment of the furniture's 3D model position when generating interior 3D models, which is inefficient and complex, especially when switching between different viewpoints for editing.
By acquiring indoor 3D scene data, a scene top view of 2D blocks is generated based on a preset projection direction. The user's modification operation on the depth information of the 2D blocks is received, a layered display control is generated, and an indoor 3D model is synthesized based on the updated depth information.
It improves the efficiency of indoor 3D model generation and editing clarity, enabling users to generate 3D models of complex scenes through simple 2D tile operations, thus simplifying the operation process.
Smart Images

Figure CN121937636A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the technical field of indoor model generation, and particularly relates to a method, apparatus, equipment, medium and product for generating indoor three-dimensional models. Background Technology
[0002] When conducting simulation tests on indoor robots, it is necessary to generate a simulated 3D model based on the actual indoor environment. Due to the complexity of the placement of different furniture pieces indoors, it is often necessary to manually adjust the positions of the 3D models of different furniture pieces within the simulated indoor environment. Existing technologies require switching between different perspectives to achieve correct furniture placement when manually adjusting the positions of the 3D furniture models, thus resulting in low efficiency in generating indoor simulated 3D models. Summary of the Invention
[0003] This application provides a method, apparatus, device, medium, and product for generating indoor 3D models, which can improve the efficiency of generating indoor 3D models.
[0004] In a first aspect, embodiments of this application provide a method for generating an indoor three-dimensional model, comprising: Acquire indoor 3D scene data, which includes multiple objects, each carrying corresponding identification information; Based on a preset projection direction, each object in the 3D scene data is projected onto the projection plane to generate a scene top view including multiple 2D tiles. Each 2D tile corresponds to an object, and each 2D tile carries corresponding orientation information, size information, position information, and depth information. The depth information is used to characterize the position of the 3D model corresponding to the 2D tile in the depth direction. Receive user modification operations for the scene top view, including modification operations on the depth information of the two-dimensional tiles in the scene top view; Based on the modification operation, the depth information of the target 2D tile is updated, and a new scene top view including a layered display control is generated based on the updated depth information. The layered display control includes a layer option, which is used to switch between displaying different layers of 2D tiles. The layer option is determined based on the updated depth information and the depth information of the 2D tiles other than the target 2D tile. Based on the identification information of the object corresponding to each two-dimensional tile in the new scene top view, the corresponding three-dimensional model is determined, and based on the orientation information, size information, position information and depth information carried by the two-dimensional tiles, multiple three-dimensional models are combined into an indoor three-dimensional model.
[0005] Secondly, embodiments of this application provide an apparatus for generating an indoor three-dimensional model, comprising: The acquisition module is used to acquire indoor 3D scene data, which includes multiple objects, each carrying corresponding identification information; The generation module is used to project each object in the 3D scene data onto the projection plane based on a preset projection direction, and generate a scene top view including multiple 2D tiles. Each 2D tile corresponds to an object, and each 2D tile carries corresponding orientation information, size information, position information and depth information. The depth information is used to characterize the position of the 3D model corresponding to the 2D tile in the depth direction. The receiving module is used to receive user modification operations on the scene top view, including modification operations on the depth information of the two-dimensional tiles in the scene top view. The generation module is also used to update the depth information of the target 2D tile based on the modification operation, and generate a new scene top view including a layered display control based on the updated depth information. The layered display control includes a layer option, which is used to switch between displaying different layers of 2D tiles. The layer option is determined based on the updated depth information and the depth information of the 2D tiles other than the target 2D tile. The generation module is also used to determine the corresponding 3D model based on the identification information of the object corresponding to each 2D tile in the new scene top view, and to synthesize multiple 3D models into an indoor 3D model based on the orientation information, size information, position information and depth information carried by the 2D tiles.
[0006] Thirdly, embodiments of this application provide an electronic device, the device comprising: Processor and memory storing computer program instructions; The method for generating an indoor 3D model described in the first aspect is used by the processor to execute computer program instructions.
[0007] Fourthly, embodiments of this application provide a computer storage medium storing computer program instructions, which, when executed by a processor, implement the method for generating an indoor 3D model as described in the first aspect.
[0008] Fifthly, embodiments of this application provide a computer program product, including a computer program that, when processed by a processor, implements the method for generating an indoor three-dimensional model as described in the first aspect.
[0009] The method, apparatus, device, medium, and product for generating indoor 3D models provided in this application acquire indoor 3D scene data, project each object in the 3D scene data onto a projection surface based on a preset projection direction, generate corresponding 2D blocks, and obtain a scene top view including multiple 2D blocks. Each 2D block includes depth information. By modifying the depth information of the target 2D block, a new scene top view including layered display controls can be generated, allowing users to clearly view and edit objects at specific height levels by switching layers, greatly improving the clarity and efficiency of editing in complex scenes. Based on the identification information, orientation information, size information, position information, and depth information of the object corresponding to each 2D block in the new scene top view, multiple 3D models are synthesized into an indoor 3D model, improving the generation efficiency of indoor 3D models. Attached Figure Description
[0010] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0011] Figure 1 This is a flowchart illustrating a method for generating an indoor 3D model, provided for some embodiments of this application.
[0012] Figure 2 This is a schematic diagram of an exemplary top view of a scene provided for some embodiments of this application.
[0013] Figure 3 This is a schematic diagram illustrating the selection of a projection surface for scene data, provided for some embodiments of this application.
[0014] Figure 4 This is a schematic diagram of another exemplary scene top view provided for some embodiments of this application.
[0015] Figure 5 This is a schematic diagram of another exemplary scene top view provided for some embodiments of this application.
[0016] Figure 6 This is a schematic diagram of a radiation detection method provided for some embodiments of this application.
[0017] Figure 7 This is a schematic diagram of another exemplary scene top view provided for some embodiments of this application.
[0018] Figure 8 This is a schematic diagram of an apparatus for generating an indoor three-dimensional model, provided for some embodiments of this application.
[0019] Figure 9 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0020] The features and exemplary embodiments of various aspects of this application will be described in detail below. To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain this application and not to limit it. For those skilled in the art, this application can be implemented without some of these specific details. The following description of the embodiments is merely to provide a better understanding of this application by illustrating examples.
[0021] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.
[0022] Before describing the technical solutions provided in the embodiments of this application, in order to facilitate understanding of the embodiments of this application, this application first specifically explains the problems existing in the related technologies: For robots in the home environment, a 3D simulation model of the home interior needs to be built in a computer system to test the robot. Because the arrangement of furniture in a home is complex, it often requires manual adjustment of the positions of different pieces of furniture within the 3D simulation model. Current manual editing methods generally fall into two categories: the first is direct editing within the 3D simulation model, and the second is editing in 2D space, such as in a 2D top view of the simulation model. However, the former requires frequent switching between different camera perspectives, while the latter cannot solve the problem of overlapping objects.
[0023] Based on this, embodiments of this application provide a method, apparatus, device, medium, and product for generating indoor 3D models, which can dynamically generate 3D simulation models by adjusting 2D spatial graphics, thereby solving the above-mentioned technical problems.
[0024] The following is a detailed description of a method for generating an indoor three-dimensional model provided in the embodiments of this application.
[0025] In some embodiments, such as Figure 1 As shown in the embodiment of this application, a method for generating an indoor 3D model is provided, which may include: S110: Acquire indoor 3D scene data, which includes multiple objects, each carrying corresponding identification information.
[0026] The aforementioned 3D scene data can be obtained from a URDF format scene file, and the identification information of each object can be obtained by traversing the tree structure of the scene file.
[0027] The aforementioned identification information can be generated based on the material and geometric information of each object.
[0028] In some examples, the material and geometry information of each object can be obtained from the scene file to generate identification information. For example, for one object, the file path for the geometry information is geometry_path and the file path for the material information is material_path. The two paths are combined, i.e., geometry_path + material_path, to get a string. A hash operation is performed on this string, such as an MD5 operation, to generate the identification information of the object.
[0029] S120: Based on the preset projection direction, project each object in the 3D scene data onto the projection surface to generate a scene top view including multiple 2D tiles. Each 2D tile corresponds to an object, and each 2D tile carries corresponding orientation information, size information, position information, and depth information. The depth information is used to characterize the position of the 3D model corresponding to the 2D tile in the depth direction.
[0030] Each object can be projected onto a preset projection surface to generate a corresponding two-dimensional tile for each object. This two-dimensional tile can carry orientation information, size information, position information, and depth information.
[0031] In some examples, such as generating data based on indoor 3D scene data, such as... Figure 2 The scene shown is a top view. Figure 2 The image includes three different two-dimensional blocks: a bed, a sofa, and a bookcase. The orientation, size, position, and depth information mentioned above represent the orientation, size, position, and depth information of the corresponding three-dimensional model of the object.
[0032] In some examples, users can select any face from the scene data as the projection plane for an object to generate a top-view of the scene. For example, if a user selects a target face as the projection plane, for any object, they can choose a plane perpendicular to the Z-axis, or a plane perpendicular to the X-axis or Y-axis; there are no restrictions on this.
[0033] For example, Figure 3 As shown, Figure 3 This is a schematic diagram illustrating the selection of the top view of an exemplary scene, where the user can... Figure 3 If the +x plane is selected as the top view plane in the scene data, all vertices in the scene data should be rotated 90 degrees counterclockwise around the rotation center, so that the top view plane of the model coincides with the +z plane in the figure. Then, all objects in the scene data are projected to generate a scene top view including the corresponding 2D tiles for each object.
[0034] S130: Receive user modification operations for the scene top view, including modification operations on the depth information of the two-dimensional tiles in the scene top view.
[0035] It is conceivable that users can modify the above scene top view, such as modifying the orientation, size, position, or depth information of the two-dimensional blocks in the scene top view.
[0036] Here, users can... Figure 2 The scene top view shown allows direct modification of the depth information of 2D tiles. For example, users can directly modify the numerical value of the depth information of a 2D tile to change its depth, or users can directly input the identifier information of another 2D tile to align the depth information of the target 2D tile with that of the first 2D tile.
[0037] S140: Based on the modification operation, update the depth information of the target 2D tile and generate a new scene top view including a layered display control based on the updated depth information. The layered display control includes a layer option, which is used to switch between displaying different layers of 2D tiles. The layer option is determined based on the updated depth information and the depth information of the 2D tiles other than the target 2D tile.
[0038] After receiving the above modification operation, the depth information of the target 2D tile can be updated. Then, based on the updated depth information and the depth information of other 2D tiles besides the target tile, the layer information of each 2D tile can be determined. For example, a user can modify... Figure 2 The system displays the depth information of the books in the bookshelf, with the updated books located at the top of the bookshelf.
[0039] It can generate and display such as Figure 4The scene top view shown includes a layered display control 101, which can include multiple layer options. When a user clicks on each layer option, a two-dimensional tile in that layer can be displayed.
[0040] For example, such as Figure 4 In the game, when a user clicks on level 1, the floor at the bottom is displayed; when they click on level 2, the bed, sofa, and bookshelf on the floor are displayed; and when they click on level 3, the books at the top of the bookshelf are displayed.
[0041] S150: Based on the identification information of the object corresponding to each two-dimensional tile in the new scene top view, determine the corresponding three-dimensional model, and synthesize multiple three-dimensional models into an indoor three-dimensional model based on the orientation information, size information, position information and depth information carried by the two-dimensional tiles.
[0042] The corresponding 3D model can be determined through the identification information of each object. Here, the 3D model corresponding to the identification information and the geometry of the 2D blocks can be detected in the preset storage space. By generating an indoor 3D model based on the above orientation information, size information, position information and depth information, the indoor 3D simulation model is obtained.
[0043] This application embodiment acquires 3D scene data, generates a scene top view, and modifies the depth information of the target 2D tile based on the user's modification operation of the depth information of the 2D tile in the scene top view. It also generates a layered display control, which allows different 2D tiles to be displayed in layers. This allows the user to clearly see the placement of objects corresponding to different 2D tiles, thereby generating an indoor 3D model. This allows the indoor 3D model to be generated based on simple user interaction with 2D tiles, simplifying user operation and improving the generation efficiency of indoor 3D models.
[0044] In some embodiments, each object in the 3D scene data is projected onto a projection plane based on a preset projection direction to generate a scene top view including multiple 2D tiles, including: Based on the preset projection direction, each object is projected onto the projection surface, and the geometry of each object on the projection surface is determined. Based on the identification information and geometry of each object, the corresponding two-dimensional tiles are determined, and a scene top view is generated based on multiple two-dimensional tiles.
[0045] For each user-selected projection surface, each object can be projected onto that surface, determining the geometry of each object after projection. Based on this geometry and the determined information, two-dimensional tiles can be defined. Here, the corresponding two-dimensional tiles can be defined in storage based on the geometry and identification information, or new two-dimensional tiles can be generated. A scene top view is then generated based on the acquired or generated two-dimensional tiles.
[0046] This application embodiment determines the corresponding two-dimensional blocks based on geometric shape and identification information, which enables the association of two-dimensional blocks with three-dimensional objects. This allows users to generate scene top views without manually drawing two-dimensional blocks, improving the efficiency of scene top view generation and thus improving the efficiency of generating indoor three-dimensional models.
[0047] In some embodiments, determining the corresponding two-dimensional tile based on the identification information and geometry of each object includes: For each object, check whether the preset storage space includes the object's identification information and the corresponding two-dimensional tile of its geometry to obtain the detection result; if the detection result includes the object's identification information and the corresponding two-dimensional tile of its geometry in the storage space, obtain the two-dimensional tile.
[0048] Information about associated 2D blocks in the storage space can be retrieved by using the object's identification information and geometry as an index. If a 2D block with the same identification information and geometry as the current object exists in the storage space, then the 2D block can be retrieved directly.
[0049] This application embodiment enables the reuse of two-dimensional tiles by directly obtaining the corresponding two-dimensional tiles from the storage space based on the identification information and geometry. This not only improves the efficiency of scene construction but also ensures the data consistency of two-dimensional tiles obtained with the same geometry and identification information, making the constructed indoor three-dimensional model truly reliable.
[0050] In some embodiments, the identification information carries material and geometric information for each object; based on the identification information and geometric shape of each object, the corresponding two-dimensional block is determined, including: Based on the material and geometric information of the object carried by the identification information, a three-dimensional model corresponding to the object is generated; the collision volume of the three-dimensional model is determined based on the bounding box algorithm, and a two-dimensional block with geometric shape is generated based on the collision volume and projection direction.
[0051] Here, the aforementioned identification information can carry the material and geometric information of each object. For example, each identification information is a hash value generated by a hash algorithm based on the storage paths of the material information file and the geometry information file. Based on this identification information, the material information file and geometry information file can be directly obtained, thereby acquiring the material and geometric information.
[0052] 3D models can be reconstructed based on geometric and material information. For example, mesh data in a geometry file can be parsed, and then surface properties defined by material information in a material file can be applied to render a realistic 3D model.
[0053] The collision volume of a 3D model can be determined based on the bounding box algorithm, that is, the minimum bounding box of the 3D model is constructed, the size and orientation of the bounding box are recorded, and a 2D block is generated through the 3D model and the projection direction.
[0054] This application embodiment generates a corresponding three-dimensional model through geometric and material information, and then generates two-dimensional tiles based on the collision volume of the three-dimensional model. This allows the depth information carried by the two-dimensional tiles to accurately represent the position information of the three-dimensional model in the depth direction, thus establishing a correspondence between object, three-dimensional model, and two-dimensional tiles. This enables the generation of a three-dimensional model based on the editing of the two-dimensional tiles.
[0055] In some embodiments, each 2D tile is associated with a depth positioning control, which includes at least two depth positioning options and receives user modifications to the scene's top view, including: Receives the user's selection of the target depth option in the depth positioning control associated with the target 2D tile in the scene top view.
[0056] Here, each 2D tile can be associated with a depth positioning control. This depth positioning control can generate collision points for each 2D tile by performing ray detection. For example, a ray can be emitted from the center point of the target 2D tile as the origin and then detected to collide with the 3D model. Multiple depth options are generated by sorting the depth information of the collision points.
[0057] In some examples, such as Figure 5 As shown, when modifying the depth information of a book, the user can browse multiple depth options in the depth positioning control of the bookshelf. The user can select the target depth option to place the book on different layers of the bookshelf. For example, selecting the top depth 1 option will place the book on the top of the bookshelf.
[0058] This application embodiment sets up a depth positioning control associated with each 2D tile. This depth positioning control includes multiple depth options, allowing users to select a target depth option to modify the depth information of the target 2D tile. This enables users to easily modify depth information by selecting depth options, simplifying the operation and improving the user experience.
[0059] In some embodiments, before receiving a user selection of a target depth option in a depth positioning control associated with a target 2D tile in a scene top view, the generation method further includes: For each 2D tile corresponding to a 3D model, the depth information of the intersection point between the 3D model and the preset ray is detected. Based on the depth information of the intersection point, a depth positioning control including at least two depth options is generated and displayed. The preset ray is a ray emitted along the depth direction starting from the midpoint of each 2D tile.
[0060] Starting from the center point of each 2D tile, a preset ray can be emitted in the depth direction. The depth information of the intersection point between the 3D model corresponding to the 2D tile and the preset ray can be detected based on the ray detection. For example... Figure 6 Taking a bookshelf as an example, with O as the origin, the ray intersects with multiple points on the bookshelf, and the depth information of each intersection point can be recorded. The recorded depth information of the intersection points is sorted in ascending order to generate a depth positioning control with multiple depth options.
[0061] Here, when determining multiple options, the distance between any two adjacent intersection points can be determined, and the depth values corresponding to two intersection points whose distance is greater than a preset value can be considered as one depth option. For example, as shown... Figure 6 Based on multiple intersection points a, b, c, and d, two depth options, Oa and bc, can be determined.
[0062] This application embodiment uses the above-described ray detection method to automatically identify all selectable positions of each two-dimensional tile in the depth direction and generate accurate depth options. This allows users to quickly locate two-dimensional tiles in the depth direction without switching perspectives, thus improving the editing efficiency of two-dimensional scenes.
[0063] In some embodiments, receiving user modifications to the scene top view includes: Receives a user's overlay operation to overlay a target 2D tile onto a first 2D tile; the first 2D tile is any one of the multiple 2D tiles excluding the target 2D tile.
[0064] Here, users can perform an overlay operation to superimpose any target 2D tile onto the first 2D tile. For example, users can drag the target 2D tile onto the first 2D tile. When the overlap area between the target 2D tile and the first 2D tile exceeds a threshold, the overlay operation is triggered.
[0065] In some examples, when a user drags a target 2D tile onto a first 2D tile, a depth positioning control associated with the first 2D tile can be displayed. The user can select the depth option in the depth positioning control to place the target 2D tile on top of or inside the first 2D tile, etc.
[0066] This application embodiment achieves automatic updating of the depth information of the target two-dimensional block by receiving the user's overlay operation of superimposing the target two-dimensional block onto the first two-dimensional block, which simplifies the user operation and improves the ease of use when editing two-dimensional blocks.
[0067] In some embodiments, each 3D model carries a collision volume. Based on the orientation, size, position, and depth information carried by multiple 2D tiles, multiple 3D models are synthesized into an indoor 3D model, including: Based on the collision volume and position information of each 3D model, the system detects whether any two 3D models intersect, and obtains the detection result. If the detection result indicates that no two 3D models intersect, the system synthesizes multiple 3D models into an indoor 3D model based on the orientation, size, position, and depth information carried by multiple 2D tiles. Alternatively, if the detection result indicates that at least two 3D models intersect, the system generates a prompt message to inform the user that at least two 3D models intersect.
[0068] During the synthesis of indoor 3D models, the used 3D models can be traversed. Based on the collision volume and position information of each 3D model, it is possible to detect whether any two 3D models intersect, and obtain the detection results. Here, the collision volume is the volume of the minimum bounding box of each 3D model, determined using a bounding box algorithm. Intersection tests can be performed on each pair of objects in all 3D models, calculating the projection overlap of the two bounding boxes along three axes. When overlap exists in all axes, it is determined that they intersect.
[0069] When the detection results show that no two 3D models intersect, the renderer renders the final interior 3D model based on the geometric and material information of each 3D model. Alternatively, when at least two 3D models are detected to intersect, a prompt message will be generated. The prompt message can include the corresponding identification information and position information of the 3D models, such as highlighting the intersecting 3D models.
[0070] This application embodiment performs collision detection on each 3D model when generating an indoor 3D model to detect whether at least two 3D models intersect each other, and generates a prompt message when intersects, so that the final constructed indoor 3D model conforms to physical laws and is realistic and reliable.
[0071] In some embodiments, each 2D tile is associated with an editing control. Based on the modification operation, the depth information of the target 2D tile is updated, and a new scene top view including a layered display control is generated based on the updated depth information, including: The system receives target operations performed by the user on the target 2D tile through the editing operation controls associated with the target 2D tile. The target operations include at least one of the following: deletion operation, translation operation, scaling operation, and rotation operation. Based on the target operations, the system updates at least one of the depth information, orientation information, size information, and position information of the target 2D tile. Based on the updated depth information, orientation information, size information, and position information, the system generates a new scene top view including a layered display control.
[0072] Here, each 2D tile can be associated with editing operation controls, allowing for actions such as deletion, translation, scaling, and rotation of the target 2D tile based on the operations performed on these controls. Based on these operations, at least one of the following can be updated: depth information, orientation information, size information, and position information of the 2D tile.
[0073] In some examples, users can also add new 2D tiles to the scene top view. For example, dragging other 2D tiles into the scene top view.
[0074] This application embodiment simplifies the user's operation steps and improves the efficiency of editing two-dimensional blocks by setting an editing operation control associated with the two-dimensional block, and modifying at least one of the depth information, orientation information, size information and position information of the two-dimensional block based on the user's operation of the editing operation control.
[0075] In some embodiments, such as Figure 7 As shown, the shape of the editing operation control is the smallest outer circle of the two-dimensional block, and it receives translation operations performed by the user on the target two-dimensional block, including: receiving the user's drag operation on the circular area of the editing operation control associated with the target two-dimensional block.
[0076] Receiving scaling operations from the user for the editing operation controls associated with the target 2D tile includes receiving radial drag operations from the user for the circular edge of the editing operation controls associated with the target 2D tile.
[0077] Receiving rotation operations from users for editing controls associated with the target 2D tile includes receiving tangential drag operations from users for the circular edges of the editing controls associated with the target 2D tile.
[0078] like Figure 7 As shown, users can click on the circular area of the editing control and drag the circular area to translate the two-dimensional tile.
[0079] Users can click on the radial area of the circular region and perform a radial drag operation to scale the 2D tile. It is conceivable that when the size of the 2D tile is changed by scaling the 2D tile, the size of the corresponding 3D model will be changed based on the same scaling ratio.
[0080] Users can click on the tangential area of the circular region and perform a tangential drag operation to rotate the 2D block. As can be expected, after rotating the 2D block, the orientation information of the corresponding 3D model will also change.
[0081] This application embodiment sets the shape of the editing operation control to the smallest outer circle of the two-dimensional block, which makes it easier for users to perform different operations, simplifies the editing difficulty in two-dimensional space, and improves the user experience.
[0082] Based on the same inventive concept, this application also provides an apparatus for generating an indoor three-dimensional model.
[0083] In some embodiments, such as Figure 8 As shown in the figure, this application embodiment provides an apparatus for generating an indoor three-dimensional model, including: The acquisition module 801 is used to acquire indoor three-dimensional scene data, wherein the three-dimensional scene data includes multiple objects, each carrying corresponding identification information; The generation module 802 is used to project each object in the 3D scene data onto the projection surface based on a preset projection direction, and generate a scene top view including multiple 2D tiles. Each 2D tile corresponds to an object, and each 2D tile carries corresponding orientation information, size information, position information and depth information. The depth information is used to characterize the position of the 3D model corresponding to the 2D tile in the depth direction. The receiving module 803 is used to receive user modification operations on the scene top view, including modification operations on the depth information of the two-dimensional tiles in the scene top view. The generation module 802 is also used to update the depth information of the modified target two-dimensional tile based on the modification operation, and generate a new scene top view including a layered display control based on the updated depth information. The layered display control includes a layer option, which is used to switch between displaying two-dimensional tiles at different layers. The layer option is determined based on the updated depth information and the depth information of the two-dimensional tiles other than the target two-dimensional tile. The generation module 802 is also used to determine the corresponding three-dimensional model based on the identification information of the object corresponding to each two-dimensional tile in the new scene top view, and to synthesize multiple three-dimensional models into an indoor three-dimensional model based on the orientation information, size information, position information and depth information carried by the two-dimensional tiles.
[0084] In some embodiments, the generation module may specifically be used for: Based on the preset projection direction, each object is projected onto the projection surface, and the geometry of each object on the projection surface is determined. Based on the identification information and geometry of each object, the corresponding two-dimensional tiles are determined, and a scene top view is generated based on multiple two-dimensional tiles.
[0085] In some embodiments, the generation module may specifically be used for: For each object, the system checks whether the preset storage space contains the object's identification information and the corresponding two-dimensional blocks of its geometry to obtain the detection result. If the detection results include object identification information and two-dimensional tiles corresponding to geometric shapes in the storage space, then obtain the two-dimensional tiles.
[0086] In some embodiments, the identification information carries material and geometric information for each object; the generation module may specifically be used for: Based on the material and geometric information of the object carried by the identification information, a three-dimensional model corresponding to the object is generated; The collision volume of the 3D model is determined based on the bounding box algorithm, and a 2D tile with geometric shape is generated based on the collision volume and projection direction.
[0087] In some embodiments, each 2D tile is associated with a depth positioning control, which includes at least two depth positioning options. The receiving module can be specifically used for: Receives the user's selection of the target depth option in the depth positioning control associated with the target 2D tile in the scene top view.
[0088] In some embodiments, the generation module can also be used for: For each 2D tile corresponding to a 3D model, the depth information of the intersection point between the 3D model and the preset ray is detected. Based on the depth information of the intersection point, a depth positioning control including at least two depth options is generated and displayed. The preset ray is a ray emitted along the depth direction starting from the midpoint of each 2D tile.
[0089] In some embodiments, the receiving module may be specifically used for: Receives a user's overlay operation to overlay a target 2D tile onto a first 2D tile; the first 2D tile is any one of the multiple 2D tiles excluding the target 2D tile.
[0090] In some embodiments, each 3D model carries a collision volume, and the generation module can be specifically used for: Based on the collision volume and position information of each 3D model, the system detects whether any two 3D models intersect and obtains the detection results. If the detection results show that no two 3D models overlap, the multiple 3D models are synthesized into an indoor 3D model based on the orientation, size, position, and depth information carried by multiple 2D tiles; or, If the detection results include at least two 3D models intersecting with each other, a prompt message is generated to inform the user that at least two 3D models intersect.
[0091] In some embodiments, each two-dimensional tile is associated with an editing control, and the receiving module can also be used for: The editing operation control associated with the target 2D tile receives the target operation performed by the user on the target 2D tile. The target operation includes at least one of the following: deletion operation, translation operation, scaling operation, and rotation operation. Based on the target operation, update at least one of the following: depth information, orientation information, size information, and position information of the target 2D tile; Generate a new scene top view that includes layered display controls based on at least one of the updated depth information, orientation information, size information, and position information.
[0092] In some embodiments, the shape of the editing operation control is the smallest outer circle of the two-dimensional block, and the receiving module can also be used for: Receives drag operations from the user on the circular area of the editing control associated with the target 2D tile; Receives radial drag operations from the user on the circular edge of the editing control associated with the target 2D tile; Receives tangential drag operations from the user on the circular edge of the editing control associated with the target 2D tile.
[0093] The apparatus described above is used to implement the corresponding indoor three-dimensional model generation method in any of the foregoing embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be repeated here.
[0094] Figure 9 A schematic diagram of the hardware structure of an electronic device is provided in the application embodiment.
[0095] The electronic device 900 may include a processor 901 and a memory 902 storing computer program instructions.
[0096] Specifically, the processor 901 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits that can be configured to implement the embodiments of this application.
[0097] Memory 902 may include mass storage for data or instructions. For example, and not limitingly, memory 902 may include a hard disk drive (HDD), floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or Universal Serial Bus (USB) drive, or a combination of two or more of these. Where appropriate, memory 902 may include removable or non-removable (or fixed) media. Where appropriate, memory 902 may be internal or external to the integrated gateway disaster recovery device. In a particular embodiment, memory 902 is non-volatile solid-state memory.
[0098] In a particular embodiment, memory 902 includes read-only memory (ROM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM), or flash memory, or a combination of two or more of these.
[0099] Memory may include read-only memory (ROM), random access memory (RAM), disk storage media devices, optical storage media devices, flash memory devices, and electrical, optical, or other physical / tangible memory storage devices. Therefore, typically, memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to the first aspect of this application.
[0100] The processor 901 reads and executes computer program instructions stored in the memory 902 to implement any of the indoor 3D model generation methods in the above embodiments.
[0101] In one example, the electronic device may also include a communication interface 903 and a bus 904. Wherein, for example... Figure 9 The processor 901, memory 902, and communication interface 903 are connected through bus 904 and complete communication with each other.
[0102] The communication interface 903 is mainly used to realize communication between various modules, devices, units and / or equipment in the embodiments of this application.
[0103] Bus 904 includes hardware, software, or both, that couples components of an online data traffic metering device together. For example, and not limitingly, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Low Pin Count (LPC) bus, a memory bus, a Microchannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable buses, or combinations of two or more of these. Where appropriate, bus 904 may include one or more buses. Although specific buses are described and illustrated in embodiments of this application, any suitable bus or interconnect is contemplated herein.
[0104] The electronic devices described above are used to implement the corresponding indoor three-dimensional model generation method in any of the foregoing embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.
[0105] Furthermore, in conjunction with the indoor 3D model generation method in the above embodiments, this application embodiment can provide a computer storage medium for implementation. This computer storage medium stores computer program instructions; when these computer program instructions are executed by a processor, they implement any of the indoor 3D model generation methods in the above embodiments.
[0106] Furthermore, in conjunction with the indoor 3D model generation method in the above embodiments, this application embodiment can provide a computer program product to implement it. When the instructions of this computer program product are executed by the processor of an electronic device, it implements any of the indoor 3D model generation methods in the above embodiments.
[0107] Those skilled in the art should understand that the discussion of any of the above embodiments is merely exemplary and is not intended to imply that the scope of this application (including the claims) is limited to these examples; within the framework of this application, the technical features of the above embodiments or different embodiments can also be combined, the steps can be implemented in any order, and there are many other variations of different aspects of the embodiments of this application as described above, which are not provided in the details for the sake of brevity.
[0108] The functional blocks shown in the above-described structural diagram can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, they can be, for example, electronic circuits, application-specific integrated circuits (ASICs), appropriate firmware, plug-ins, function cards, etc. When implemented in software, the elements of this application are programs or code segments used to perform the required tasks. Programs or code segments can be stored on a machine-readable medium or transmitted over a transmission medium or communication link via data signals carried on a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio frequency (RF) links, etc. Code segments can be downloaded via computer networks such as the Internet, intranets, etc.
[0109] It should also be noted that the exemplary embodiments mentioned in this application describe methods or apparatuses based on a series of steps or devices. However, this application is not limited to the order of the above steps; that is, the steps can be performed in the order mentioned in the embodiments, or in a different order, or several steps can be performed simultaneously.
[0110] The aspects of this application have been described above with reference to flowchart illustrations and / or block diagrams of methods, apparatus (devices), and computer program products according to embodiments of this application. It should be understood that each block in the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that these instructions, executable via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions / actions specified in one or more blocks of the flowchart illustrations and / or block diagrams. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field-programmable logic circuit. It is also understood that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can also be implemented by dedicated hardware performing the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.
[0111] The above description is merely a specific embodiment of this application. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the devices, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. It should be understood that the protection scope of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the protection scope of this application.
Claims
1. A method for generating an indoor 3D model, characterized in that, include; Acquire indoor 3D scene data, wherein the 3D scene data includes multiple objects, each carrying corresponding identification information; Based on a preset projection direction, each object in the 3D scene data is projected onto a projection surface to generate a scene top view including multiple 2D tiles. Each 2D tile corresponds to one object, and each 2D tile carries corresponding orientation information, size information, position information, and depth information. The depth information is used to characterize the position of the 3D model corresponding to the 2D tile in the depth direction. Receive user modification operations for the top view of the scene, the modification operations including modification operations on the depth information of two-dimensional tiles in the top view of the scene; Based on the modification operation, the depth information of the target 2D tile is updated, and a new scene top view including a layered display control is generated based on the updated depth information. The layered display control includes a layer option, which is used to switch between displaying different layers of 2D tiles. The layer option is determined based on the updated depth information and the depth information of the 2D tiles other than the target 2D tile. Based on the identification information of the object corresponding to each two-dimensional tile in the new scene top view, the corresponding three-dimensional model is determined, and based on the orientation information, size information, position information and depth information carried by the two-dimensional tile, multiple three-dimensional models are combined into an indoor three-dimensional model.
2. The method for generating an indoor three-dimensional model according to claim 1, characterized in that, The process of projecting each object in the 3D scene data onto a projection plane based on a preset projection direction to generate a scene top view including multiple 2D tiles includes: Based on the preset projection direction, each object is projected onto the projection surface, and the geometry of each object on the projection surface is determined. Based on the identification information and geometry of each object, a corresponding two-dimensional tile is determined, and a scene top view is generated based on multiple two-dimensional tiles.
3. The method for generating an indoor three-dimensional model according to claim 2, characterized in that, The step of determining the corresponding two-dimensional block based on the identification information and geometric shape of each object includes: For each object, the system checks whether the preset storage space includes the object's identification information and the two-dimensional block corresponding to the geometric shape, and obtains the detection result. If the detection result includes the object's identification information and the two-dimensional tile corresponding to the geometric shape in the storage space, the two-dimensional tile is obtained.
4. The method for generating an indoor three-dimensional model according to claim 2, characterized in that, The identification information carries the material and geometric information of each object; determining the corresponding two-dimensional block based on the identification information and geometric shape of each object includes: Based on the material information and geometric information of the object carried by the identification information, a three-dimensional model corresponding to the object is generated; The collision volume of the 3D model is determined based on the bounding box algorithm, and the 2D tile with the geometry is generated based on the collision volume and the projection direction.
5. The method for generating an indoor three-dimensional model according to claim 1, characterized in that, Each of the two-dimensional tiles is associated with a depth positioning control, which includes at least two depth positioning options. Receiving user modifications to the scene's top view includes: The system receives a user's selection of the target depth option in the depth positioning control associated with the target 2D tile in the top view of the scene.
6. The method for generating an indoor three-dimensional model according to claim 5, characterized in that, Before receiving the user's selection of the target depth option in the depth positioning control associated with the target 2D tile in the scene top view, the generation method further includes: For each two-dimensional tile corresponding to a three-dimensional model, the depth information of the intersection point of the three-dimensional model and a preset ray is detected. Based on the depth information of the intersection point, a depth positioning control including at least two depth options is generated and displayed. The preset ray is a ray emitted along the depth direction starting from the midpoint of each two-dimensional tile.
7. The method for generating an indoor three-dimensional model according to any one of claims 1-6, characterized in that, The receiving of user modifications to the scene top view includes: The system receives an operation from a user to overlay the target 2D tile onto a first 2D tile; the first 2D tile is any one of the multiple 2D tiles except the target 2D tile.
8. The method for generating an indoor three-dimensional model according to claim 1, characterized in that, Each of the three-dimensional models carries a collision volume. The synthesis of an indoor three-dimensional model from multiple three-dimensional models based on the orientation, size, position, and depth information carried by the multiple two-dimensional tiles includes: Based on the collision volume and position information of each of the three-dimensional models, detect whether any two of the three-dimensional models intersect each other, and obtain the detection result; If the detection results show that no two of the three-dimensional models intersect, the multiple three-dimensional models are synthesized into an indoor three-dimensional model based on the orientation information, size information, position information, and depth information carried by the multiple two-dimensional tiles; or, If the detection result includes at least two of the three-dimensional models intersecting with each other, a prompt message is generated to inform the user that at least two of the three-dimensional models intersect with each other.
9. The method for generating an indoor three-dimensional model according to claim 1, characterized in that, Each of the two-dimensional tiles is associated with an editing operation control. Based on the modification operation, the depth information of the target two-dimensional tile is updated, and a new scene top view including a layered display control is generated based on the updated depth information, including: The editing operation control associated with the target 2D tile receives the target operation performed by the user on the target 2D tile. The target operation includes at least one of the following: deletion operation, translation operation, scaling operation, and rotation operation. Based on the target operation, update at least one of the depth information, orientation information, size information, and position information of the target 2D map tile; Based on at least one of the updated depth information, orientation information, size information, and position information, a new scene top view including layered display controls is generated.
10. The method for generating an indoor three-dimensional model according to claim 9, characterized in that, The shape of the editing operation control is the smallest outer circle of the two-dimensional tile, and the receiving of the translation operation performed by the user on the target two-dimensional tile includes: Receives a drag operation from the user on the circular area of the editing control associated with the target 2D tile; The process of receiving zoom operations from the user on the editing control associated with the target 2D tile includes: Receives a radial drag operation from the user on the circular edge of the editing control associated with the target 2D tile; The process of receiving a user's rotation operation on the editing control associated with the target 2D tile includes: Receives a tangential drag operation from the user on the circular edge of the editing control associated with the target 2D tile.
11. A device for generating an indoor three-dimensional model, characterized in that, include; The acquisition module is used to acquire indoor three-dimensional scene data, wherein the three-dimensional scene data includes multiple objects, each carrying corresponding identification information; The generation module is used to project each object in the three-dimensional scene data onto a projection surface based on a preset projection direction, and generate a scene top view including multiple two-dimensional tiles, wherein each two-dimensional tile corresponds to one object, and each two-dimensional tile carries corresponding orientation information, size information, position information and depth information, and the depth information is used to characterize the position of the three-dimensional model corresponding to the two-dimensional tile in the depth direction; The receiving module is used to receive user modification operations on the scene top view, including modification operations on the depth information of two-dimensional tiles in the scene top view. The generation module is also used to update the depth information of the target 2D tile based on the modification operation, and generate a new scene top view including a layered display control based on the updated depth information. The layered display control includes a layer option, which is used to switch between displaying different layers of 2D tiles. The layer option is determined based on the updated depth information and the depth information of the 2D tiles other than the target 2D tile. The generation module is also used to determine the corresponding three-dimensional model based on the identification information of the object corresponding to each two-dimensional tile in the new scene top view, and to synthesize multiple three-dimensional models into an indoor three-dimensional model based on the orientation information, size information, position information and depth information carried by the two-dimensional tile.
12. An electronic device, characterized in that, The device includes: a processor, and a memory storing computer program instructions; The processor reads and executes the computer program instructions to implement the method for generating an indoor three-dimensional model as described in any one of claims 1 to 10.
13. A readable storage medium, characterized in that, The readable storage medium stores computer program instructions, which, when executed by a processor, implement the method for generating an indoor three-dimensional model as described in any one of claims 1 to 10.
14. A computer program product, comprising a computer program, characterized in that, When the computer program is processed by a processor, it implements the method for generating an indoor three-dimensional model as described in any one of claims 1 to 10.
