Three-dimensional scene construction method and device, storage medium and electronic device
By acquiring and parsing scene image data to generate a spatial coordinate system, identifying surface objects and displaying equipment models, the problem of long 3D modeling cycles, high costs, and difficulty in modification in existing technologies is solved, enabling the rapid response to customer needs in 3D scene construction.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- CHINA TELECOM GLOBAL LTD
- Filing Date
- 2021-12-08
- Publication Date
- 2026-04-10
AI Technical Summary
Existing technologies in 3D modeling suffer from long construction cycles, high costs, difficulty in modification, and an inability to flexibly and quickly respond to customer needs for scene demonstration.
By acquiring scene image data of the target entity scene, parsing sensor information to generate a spatial coordinate system, identifying surface objects to construct an initial 3D scene, obtaining actual distance parameter values to determine size information, and displaying the device model in the 3D scene according to the device construction instructions, augmented reality and virtual reality technologies are used to achieve rapid response to customer needs.
It enables the rapid construction of initial 3D models of target entity scenes, can flexibly respond to user device construction commands, generate corresponding scene effects, shorten the construction cycle, reduce costs, and improve modification efficiency.
Smart Images

Figure CN116310062B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the technical field of computer, and particularly relates to a three-dimensional scene construction method and device, a storage medium and an electronic device. BACKGROUND
[0002] When the project construction scheme effect is shown to the user, the three-dimensional scene / model can be used to show the environment, cabinet position, supporting facilities, etc. to the customer.
[0003] In the related art, before the display through the three-dimensional modeling / virtual reality (VR) technology, a large amount of time is often spent on modeling before the display, and there are disadvantages of long construction period, high cost, difficult modification, and inability to flexibly and quickly respond to the customer demand for scene display.
[0004] It should be noted that the information disclosed in the above background section is only used to strengthen the understanding of the background of the present disclosure, and therefore can include information that does not constitute prior art known to those of ordinary skill in the art. SUMMARY
[0005] The present disclosure aims to provide a three-dimensional scene construction method, device, electronic device and storage medium to solve the problems of long construction period, high cost, difficult modification, and inability to flexibly and quickly respond to the customer demand for scene display.
[0006] Other characteristics and advantages of the present disclosure will become apparent from the following detailed description, or will be learned by practice of the present disclosure.
[0007] According to one aspect of the present disclosure, a three-dimensional scene construction method is provided, comprising: acquiring scene image data of a target entity scene, and parsing sensing information in the scene image data to generate a space coordinate system corresponding to the scene image data; identifying a surface object in the scene image data, and constructing an initial three-dimensional scene of the target entity scene in the space coordinate system based on the surface object; acquiring an actual distance parameter value in the target entity scene, and determining size information of the initial three-dimensional scene according to the actual distance parameter value; acquiring a device construction instruction, and determining a device model applied to the initial three-dimensional scene and a corresponding placement position according to the device construction instruction; and displaying the device model in the initial three-dimensional scene according to the placement position, thereby generating a three-dimensional scene with a device construction effect.
[0008] In an embodiment of the present disclosure, the scene image data is obtained by image acquisition of a target entity scene using an image acquisition device with a sensing device; the scene image data includes a plurality of images; and the step of analyzing the sensing information in the scene image data to generate a spatial coordinate system corresponding to the scene image data includes: analyzing the sensing information in the scene image data to obtain relative position information of the images in the scene image data and three-dimensional direction information corresponding to the images; and generating the spatial coordinate system corresponding to the scene image data according to the relative position information and the three-dimensional direction information.
[0009] In an embodiment of the present disclosure, the step of identifying a surface object in the scene image data and constructing an initial three-dimensional scene of the target entity scene based on the surface object in the spatial coordinate system includes: determining feature points on each image in the scene image data by augmented reality (AR) technology, identifying the surface object in the scene image data according to the feature points; determining the position of the surface object in the spatial coordinate system based on the spatial coordinate system corresponding to the scene image data; constructing an initial surface model of the surface object according to the position of the surface object in the spatial coordinate system; and optimizing the initial surface model by a nonlinear fitting technology to obtain a target surface model, and then constructing the initial three-dimensional scene of the target entity scene according to the target surface model.
[0010] In an embodiment of the present disclosure, the step of optimizing the initial surface model by a nonlinear fitting technology to obtain a target surface model includes: creating a mesh object corresponding to the initial surface model in the initial three-dimensional scene; fitting the mesh object on the corresponding initial surface model to generate labeling information of the initial surface model; and splicing the initial surface model based on the labeling information by a nonlinear fitting technology to obtain the target surface model.
[0011] In an embodiment of the present disclosure, the step of obtaining an actual distance parameter value in the target entity scene includes: using an image acquisition device with a sensing device to measure the distance of the target entity scene to obtain the actual distance parameter value in the target entity scene; and / or obtaining architectural design data of the target entity scene to determine the actual distance parameter value in the target entity scene according to the architectural design data.
[0012] In an embodiment of the present disclosure, the step of determining the size information of the initial three-dimensional scene according to the actual distance parameter value includes: determining a virtual measurement distance on each coordinate axis in the spatial coordinate system according to the actual distance parameter value; and determining the size information of the initial three-dimensional scene according to the virtual measurement distance on each coordinate axis.
[0013] In an embodiment of the present disclosure, the step of obtaining the device construction instruction and determining the device model and the corresponding placement position applied to the initial three-dimensional scene according to the device construction instruction comprises: displaying a layout interface; generating the device construction instruction in response to a device construction operation performed by a user on the layout interface; and parsing the device construction instruction to obtain the device model and the corresponding placement position.
[0014] In an embodiment of the present disclosure, the step of displaying the device model in the initial three-dimensional scene according to the placement position comprises: obtaining an actual model size of the device model, obtaining a display size of the device model based on the size information of the initial three-dimensional scene and the actual model size, placing the device model with the display size in the initial three-dimensional scene according to the placement position by using an augmented reality (AR) technology, adjusting the coordinates and / or direction of the placement of the device model by using a non-linear fitting algorithm to determine a target placement position of the device model, and displaying the device model with the display size in the initial three-dimensional scene based on the target placement position by using a virtual reality (VR) technology.
[0015] According to another aspect of the present disclosure, a three-dimensional scene construction device is provided, which comprises: an obtaining module configured to obtain scene image data of a target entity scene, and parse sensing information in the scene image data to generate a spatial coordinate system corresponding to the scene image data; a construction module configured to identify a surface object in the scene image data, and construct an initial three-dimensional scene of the target entity scene in the spatial coordinate system based on the surface object; a determination module configured to obtain an actual distance parameter value in the target entity scene, and determine size information of the initial three-dimensional scene according to the actual distance parameter value; a placement module configured to obtain a device construction instruction, and determine a device model and a corresponding placement position applied to the initial three-dimensional scene according to the device construction instruction; and a display module configured to display the device model in the initial three-dimensional scene according to the placement position, thereby generating a three-dimensional scene with a device construction effect.
[0016] In an embodiment of the present disclosure, the scene image data is obtained by using an image acquisition device with a sensing device to perform image acquisition on the target entity scene; the scene image data comprises a plurality of images; and the step of parsing the sensing information in the scene image data to generate the spatial coordinate system corresponding to the scene image data comprises: parsing the sensing information in the scene image data to obtain relative position information of the images in the scene image data and three-dimensional direction information corresponding to the images; and generating the spatial coordinate system corresponding to the scene image data according to the relative position information and the three-dimensional direction information.
[0017] In an embodiment of the present disclosure, the step of the constructing module identifying a surface object in the scene image data and constructing an initial three-dimensional scene of the target entity scene in a spatial coordinate system based on the surface object comprises: determining feature points on each image in the scene image data by using an augmented reality (AR) technology, and identifying the surface object in the scene image data according to the feature points; determining a position of the surface object in the spatial coordinate system based on a spatial coordinate system corresponding to the scene image data; constructing an initial surface model of the surface object according to the position of the surface object in the spatial coordinate system; and optimizing the initial surface model by using a nonlinear fitting technology to obtain a target surface model, and then constructing the initial three-dimensional scene of the target entity scene according to the target surface model.
[0018] In an embodiment of the present disclosure, the step of the constructing module optimizing the initial surface model by using the nonlinear fitting technology to obtain the target surface model comprises: creating a mesh object corresponding to the initial surface model in the initial three-dimensional scene; fitting the mesh object on the corresponding initial surface model to generate annotation information of the initial surface model; and splicing the initial surface model based on the annotation information by using the nonlinear fitting technology to obtain the target surface model.
[0019] In an embodiment of the present disclosure, the step of the determining module obtaining an actual distance parameter value in the target entity scene comprises: using an image acquisition device with a sensing device to measure the distance of the target entity scene to obtain the actual distance parameter value in the target entity scene; and / or obtaining architectural design data of the target entity scene, and determining the actual distance parameter value in the target entity scene according to the architectural design data.
[0020] In an embodiment of the present disclosure, the step of the determining module determining the size information of the initial three-dimensional scene according to the actual distance parameter value comprises: determining a virtual measurement distance on each coordinate axis in the spatial coordinate system according to the actual distance parameter value; and determining the size information of the initial three-dimensional scene according to the virtual measurement distance on each coordinate axis.
[0021] In an embodiment of the present disclosure, the step of the placing module obtaining the device construction instruction and determining a device model applied to the initial three-dimensional scene and a corresponding placement position according to the device construction instruction comprises: displaying a layout interface; generating the device construction instruction in response to a device construction operation performed by a user on the layout interface; and parsing the device construction instruction to obtain the device model and the corresponding placement position.
[0022] In one embodiment of the present disclosure, the step of the display module displaying the device model in the initial three-dimensional scene according to the placement position comprises: obtaining an actual model size of the device model, obtaining a display size of the device model based on size information of the initial three-dimensional scene and the actual model size; placing the device model with the display size in the initial three-dimensional scene according to the placement position by using augmented reality (AR) technology; adjusting the coordinates and / or direction of the placement of the device model by using a non-linear fitting algorithm to determine a target placement position of the placement of the device model; and displaying the device model with the display size in the initial three-dimensional scene based on the target placement position by using virtual reality (VR) technology.
[0023] According to yet another aspect of the present disclosure, a computer readable storage medium is provided, which stores a computer program, and the computer program is executed by a processor to implement the three-dimensional scene construction method described above.
[0024] According to still another aspect of the present disclosure, an electronic device is provided, which comprises: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the three-dimensional scene construction method described above by executing the executable instructions.
[0025] The three-dimensional scene construction method provided by the embodiments of the present disclosure can construct an initial three-dimensional model of a target entity scene, and can quickly display a device model in the initial three-dimensional model in response to a device construction instruction of a user, so as to generate a corresponding scene effect and display.
[0026] Further, the three-dimensional scene construction method provided by the embodiments of the present disclosure can further display the scene effect by using virtual reality (VR) technology after the corresponding scene effect is generated in response to the device construction instruction.
[0027] It should be understood that the foregoing general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS
[0028] The accompanying drawings, which are incorporated into and form part of the specification, illustrate one embodiment consistent with the present disclosure and, together with the specification, serve to explain the principles of the present disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative labor on the basis of these drawings.
[0029] Figure 1 A schematic diagram of an exemplary system architecture to which the three-dimensional scene construction method according to the embodiments of the present disclosure can be applied is shown;
[0030] Figure 2 A flowchart of the three-dimensional scene construction method according to one embodiment of the present disclosure is shown.
[0031] Figure 3 A schematic diagram showing generation of a spatial coordinate system in a three-dimensional scene construction method of one embodiment of the present disclosure is shown;
[0032] Figure 4 A flowchart showing construction of an initial three-dimensional scene in a three-dimensional scene construction method of one embodiment of the present disclosure is shown;
[0033] Figure 5 A flowchart showing obtaining of a target surface model in a three-dimensional scene construction method of one embodiment of the present disclosure is shown;
[0034] Figure 6 A schematic diagram showing creation of a mesh object in a three-dimensional scene construction method of one embodiment of the present disclosure is shown;
[0035] Figure 7 A schematic diagram showing annotation of an initial surface model in a three-dimensional scene construction method of one embodiment of the present disclosure is shown;
[0036] Figure 8 A flowchart showing displaying of a device model in a three-dimensional scene in a three-dimensional scene construction method of one embodiment of the present disclosure is shown;
[0037] Figure 9 A schematic diagram showing displaying of a device model in a three-dimensional scene in a three-dimensional scene construction method of one embodiment of the present disclosure is shown;
[0038] Figure 10 A flowchart showing a three-dimensional scene construction method of one embodiment of the present disclosure is shown;
[0039] Figure 11 A block diagram showing a three-dimensional scene construction apparatus of one embodiment of the present disclosure is shown; and
[0040] Figure 12 A block diagram showing a structure of a three-dimensional scene construction computer device in an embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0041] Example implementations will now be described more fully with reference to the accompanying drawings. Example implementations can be implemented in any
[0042] In addition, the accompanying drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles of the present disclosure. In the drawings:
[0043] In addition, the terms "first", "second", etc. are used herein only to describe different instances, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the technical features indicated. Therefore, the features defined with "first", "second" can explicitly or implicitly include one or more of the features. In the description of the present disclosure, the meaning of "a plurality of" is at least two, for example, two, three, etc., unless otherwise explicitly and specifically limited.
[0044] To address the technical problems existing in the related art described above, the embodiments of the present disclosure provide a three-dimensional scene construction method for at least solving one or all of the above technical problems.
[0045] Figure 1 A schematic diagram of an exemplary system architecture to which the three-dimensional scene construction method of the embodiments of the present disclosure can be applied is shown; as Figure 1
[0046] The system architecture can include a server 101, a network 102 and a client 103. The network 102 is used as a medium to provide a communication link between the client 103 and the server 101. The network 102 can include various connection types, such as wired, wireless communication links or optical fiber cables, etc.
[0047] The server 101 can be a server that provides various services, such as a background management server that provides support for the operations of the user using the client 203. The background management server can construct an initial three-dimensional scene of the target entity scene according to the scene image data, and can also receive and process device construction instructions, display the corresponding device model in the initial three-dimensional scene displayed in the corresponding interface of the client 203 based on the device construction instructions, and further generate and display a three-dimensional scene with a device construction effect in the corresponding interface of the client 203.
[0048] In some optional embodiments, the server 101 can acquire scene image data of a target entity scene, parse sensing information in the scene image data to generate a spatial coordinate system corresponding to the scene image data; the server 101 can identify a surface object in the scene image data, construct an initial three-dimensional scene of the target entity scene in the spatial coordinate system based on the surface object; the server 101 can acquire an actual distance parameter value in the target entity scene, determine size information of the initial three-dimensional scene according to the actual distance parameter value; the server 101 can acquire a device construction instruction, determine a device model applied to the initial three-dimensional scene and a corresponding placement position according to the device construction instruction; and the server 101 can display the device model in the initial three-dimensional scene according to the placement position, thereby generating a three-dimensional scene with a device construction effect.
[0049] The client 103 can be a mobile terminal such as a mobile phone, a game console, a tablet computer, an e-book reader, smart glasses, a smart home device, an AR (Augmented Reality) device, a VR (Virtual Reality) device, or the like, or the client 103 can also be a personal computer such as a laptop computer and a desktop computer, and the like.
[0050] In some optional embodiments, the client 103 can display the initial three-dimensional scene of the target entity scene to an operator, and can also provide an interface for the operator to issue a device construction instruction, and can display the three-dimensional scene with the device construction effect to the operator.
[0051] It should be understood that Figure 1 The number of clients, networks and servers in the server 101 is only illustrative, and the server 101 can be a server of one entity, or can be a server cluster composed of multiple servers, or can be a cloud server, and can have any number of clients, networks and servers according to actual needs.
[0052] In the following, each step of the wiring method based on the three-dimensional scene in the example embodiments of the present disclosure will be described in more detail in combination with the accompanying drawings and embodiments.
[0053] Figure 2 A flowchart of a three-dimensional scene construction method of an embodiment of the present disclosure is shown. The method provided by the embodiment of the present disclosure can be executed by a server or a client as shown in Figure 1 but the present disclosure is not limited thereto.
[0054] In the following example illustration, the server cluster 101 is taken as an example to illustrate the execution subject.
[0055] As Figure 2As shown, the three-dimensional scene construction method provided by the embodiments of the disclosure can include the following steps:
[0056] In step S201, scene image data of a target entity scene is acquired, and sensing information in the scene image data is parsed to generate a spatial coordinate system corresponding to the scene image data.
[0057] In this embodiment, the target entity scene can be a specific machine room, a server storage room, a workspace, etc. The scene image data can be a multimedia file in the form of a video, an animated image, an image set, etc. The scene image data can be obtained by using an image acquisition device with a sensing device to perform image acquisition on the target entity scene, for example, a mobile phone camera can be used to take a picture of the scene to obtain a video, an animated image, an image set, etc. of the target entity scene.
[0058] In step S203, a surface object in the scene image data is identified, and an initial three-dimensional scene of the target entity scene is constructed in the spatial coordinate system based on the surface object. The surface object can be a wall, a top surface, etc. in the target entity scene. The initial three-dimensional scene can be a virtual scene embodiment of the target entity scene without device decoration, for example, the initial three-dimensional scene can be a virtual scene composed of four walls, a top surface, and a bottom surface.
[0059] In step S205, an actual distance parameter value in the target entity scene is acquired, and the size information of the initial three-dimensional scene is determined according to the actual distance parameter value. The actual distance parameter value can be information actually used to describe the size of the target entity scene, such as size information of each wall surface, height information in the scene, etc.
[0060] In step S207, a device construction instruction is acquired, and a device model applied to the initial three-dimensional scene and a corresponding placement position are determined according to the device construction instruction. The device construction instruction can be issued by a user in a corresponding operation interface displayed on the client 103. The device construction instruction can indicate the type or style of the device that the user wants to place, and can indicate the position in the initial three-dimensional scene where the user wants to place the device model.
[0061] In step S209, the device model is displayed in the initial three-dimensional scene according to the placement position, and a three-dimensional scene with a device construction effect is generated. In this embodiment, the device model specified by the user can be visualized and placed in the constructed initial three-dimensional scene in response to the device construction instruction, and the three-dimensional scene with the device construction effect is displayed to the user, so that the scene effect is intuitively presented.
[0062] The three-dimensional scene construction method provided by the embodiment of the present disclosure can construct an initial three-dimensional model of a target entity scene, and can quickly respond to a device construction instruction of a user to display a device model in the initial three-dimensional model, thereby generating a corresponding scene effect and display. The construction period is short, easy to modify, and can quickly respond to customer requirements for scene display.
[0063] In some embodiments, the scene image data includes a plurality of images; and the step of analyzing the sensing information in the scene image data to generate a space coordinate system corresponding to the scene image data includes: analyzing the sensing information in the scene image data to obtain relative position information of the images in the scene image data and three-dimensional direction information corresponding to the images; and generating the space coordinate system corresponding to the scene image data according to the relative position information and the three-dimensional direction information.
[0064] The scene image data can include sensing information, such as sensing information obtained by using an accelerometer and a gyroscope. For example, the relative positions of the images in the scene image data can be identified by using a mobile phone camera and a sensor, and then the X, Y, and Z three axes for the initial three-dimensional scene can be labeled.
[0065] Figure 3 FIG. 4 shows a schematic diagram of generating a space coordinate system in the three-dimensional scene construction method of one embodiment of the present disclosure, as shown in Figure 3 FIG. 5 shows a schematic diagram of a space coordinate system with three-dimensional directions generated in a scene image, which includes X, Y, and Z three axes.
[0066] Figure 4 FIG. 6 shows a flowchart of constructing an initial three-dimensional scene in the three-dimensional scene construction method of one embodiment of the present disclosure, as shown in Figure 4 Figure 2 The step S203 in the embodiment can further include the following steps:
[0067] In step S401, feature points on each image in the scene image data are determined by using augmented reality (AR) technology, and a surface object in the scene image data is identified according to the feature points. The surface object can be, for example, four wall surfaces (or a plurality of wall surfaces), one ground surface, one top surface, and a plurality of surfaces.
[0068] In step S403, the positions of the surface objects in the space coordinate system corresponding to the scene image data are determined based on the space coordinate system.
[0069] In step S405, an initial surface model of the surface object is constructed according to the position of the surface object in the space coordinate system. In step S405, the position of the surface object in the space coordinate system is determined based on the generated space coordinate system, the boundary of the target entity scene is labeled, and then the initial surface model of the surface object is created.
[0070] Step S407, the initial surface model is optimized by a nonlinear fitting technique to obtain a target surface model, and then an initial three-dimensional scene of the target entity scene is constructed according to the target surface model.
[0071] It can be seen that, by implementing the above steps, the surface recognition and recording in the target entity scene can be completed through feature point recognition in the scene image, and the virtual initial three-dimensional scene can be created. Figure 4 Specifically, the space recognition of the IDC machine room in reality can be realized by using a mobile phone camera, a sensor and the like in an AR mode, in combination with image recognition and a nonlinear fitting method, and then the above initial three-dimensional scene can be built.
[0072] Figure 5 A flowchart of obtaining a target surface model in a three-dimensional scene construction method of one embodiment of the present disclosure is shown in FIG. 4, which shows that Figure 5 the step S407 in the embodiment can further include the following steps: Figure 4
[0073] Step S501, a mesh object corresponding to the initial surface model is created in the initial three-dimensional scene. In some actual applications, a semi-transparent mesh can be created in the initial three-dimensional scene through an application program in a mobile device (such as a mobile phone).
[0074] Step S503, the mesh object is fitted on the corresponding initial surface model to generate labeling information of the initial surface model. In some actual applications, the created semi-transparent mesh can be fitted onto the ground or wall through the above-mentioned related application program to realize the labeling of the surface.
[0075] Step S505, the initial surface model is spliced based on the labeling information by a nonlinear fitting technique to obtain a target surface model. The nonlinear fitting function provided in the above-mentioned related application program (for example, the function provided by the Ceres library in the application program) can be used to realize the splicing of the surface, and a virtual surface more consistent with the actual scene is generated as the target surface model.
[0076] It can be seen that, by implementing the above steps, Figure 5 the semi-transparent mesh can be created in the initial three-dimensional scene and fitted onto the ground or wall, the nonlinear fitting and the splicing of the surface can be completed, and then the accuracy of the surface recognition and labeling in the initial three-dimensional scene can be improved.
[0077] Figure 6 A schematic diagram of creating a mesh object in a three-dimensional scene construction method of one embodiment of the present disclosure is shown in FIG. 5, which shows that Figure 6 the step S501 in the embodiment can further include the following steps: Figure 5 The schematic diagram of step S501 in the embodiment in an actual application includes: creating mesh objects 601, 602, 603, and 604 in an initial three-dimensional scene 600. The initial three-dimensional scene 600 and the mesh objects 601, 602, 603, and 604 can be presented by an application program on a mobile device (such as a mobile phone).
[0078] Figure 7 The schematic diagram of labeling the initial surface model in the three-dimensional scene construction method of one embodiment of the present disclosure is shown in FIG. 6B. As shown in FIG. 6B, the initial surface model is labeled as a wall surface 601, a floor surface 602, and an invalid surface 603. Figure 7 Figure 5 The schematic diagram of step S503 in the embodiment in an actual application includes: a mobile device 700, an operation interface 701 provided by an application program on the mobile device 700, an operation button 702 for labeling in the operation interface 701, and a mesh object 703 presented in the operation interface 701. By implementing Figure 7 The schematic diagram shown in FIG. 6D can present the initial three-dimensional scene and the mesh object 703 through the operation interface 701 provided by the application program in the mobile device 700 (such as a mobile phone), and can also provide the operation button 702 for labeling in the operation interface 701, so that the user can perform corresponding operations on the operation button 702 to label the mesh object 703. Further, in the present schematic diagram, the operation button 702 can include labeling operation buttons for a wall surface, a floor surface, and an invalid surface, as shown in FIG. 6D. The user can slide the mesh object 703 by holding the labeling operation button for the wall surface, and at this time, a prompt information “drag to label as a wall surface” can appear in the operation interface 701. Figure 7
[0079] In some actual applications, if there are devices (such as cabinets, computer desks, etc.) or decoration facilities in the target entity scene, the surfaces of the devices (such as cabinets, computer desks, etc.) or decoration facilities can be ignored in the process of labeling the initial surface model, and mesh objects are not created on these surfaces, and labeling operations are not performed on these surfaces.
[0080] In some embodiments, Figure 2 The step of acquiring the actual distance parameter value in the target entity scene in step S205 in the embodiment includes: using an image acquisition device with a sensing device to measure the distance in the target entity scene to obtain the actual distance parameter value in the target entity scene; and / or acquiring the architectural design data of the target entity scene, and determining the actual distance parameter value in the target entity scene according to the architectural design data.
[0081] Further, in some embodiments, Figure 2 The step of determining the size information of the initial three-dimensional scene according to the actual distance parameter value in step S205 in the embodiment can include: determining a virtual metric distance on each coordinate axis in the spatial coordinate system according to the actual distance parameter value; and determining the size information of the initial three-dimensional scene according to the virtual metric distance on each coordinate axis.
[0082] The sensing device can be a light sensor, a camera with a light sensor, or the like. In this embodiment, the ranging and calculation of the scene can be completed by the laser sensor and the camera to obtain accurate scene size values, and then the three-dimensional scene can be built. Alternatively, when there is design standard data (reference data) of the target entity scene, the measurer can manually modify the size data of the initial three-dimensional scene in the corresponding interface.
[0083] In some embodiments, the step of obtaining device construction instructions and determining a device model applied to the initial three-dimensional scene and a corresponding placement position according to the device construction instructions can include: displaying a layout interface; generating device construction instructions in response to a device construction operation performed by a user on the layout interface; and parsing the device construction instructions to obtain the device model and the corresponding placement position.
[0084] The user can first obtain a device procurement plan, and then determine the device information to be displayed in the current scene construction based on the device procurement plan. The device information can include device type, device model, device shape, and the like. The user can be shown a layout interface through an application program on a mobile device, and the user can perform selection or dragging operations on the displayed layout interface to generate device construction instructions, and then the mobile device parses the instructions to determine the device model specified by the user and the placement position of the device model. Specifically, the user can first obtain the requirements of an IDC (Internet Data Center) procurement plan, and determine the devices such as cabinets, bridges, cages, precision air conditioners, and cameras that need to be installed in the plan. The user can then complete the placement of the device model in the AR scene by dragging the device model from the device library provided by the app through the app on the mobile phone.
[0085] Figure 8 A flowchart of a method for constructing a three-dimensional scene according to an embodiment of the present disclosure is shown in FIG. 8. Figure 8 As shown in FIG. 8, Figure 2 The step of displaying the device model in the initial three-dimensional scene according to the placement position in step S209 in the embodiment can further include the following steps:
[0086] In step S801, the actual model size of the device model is obtained, and the display size of the device model is obtained based on the size information of the initial three-dimensional scene and the actual model size.
[0087] Step S803, placing the device model with the display size in the initial three-dimensional scene according to the placement position through the augmented reality AR technology.
[0088] Step S805, adjusting the coordinates and / or direction of the device model placement using a nonlinear fitting algorithm to determine the target placement position of the device model placement.
[0089] Step S807, displaying the device model with the display size in the initial three-dimensional scene based on the target placement position through the virtual reality VR technology.
[0090] In some practical applications, after the user selects the device model in the mobile phone app for placement, the user can also perform editing operations on the properties of the device model such as position, size, angle, transparency, and note information. After the device models are placed one by one, a target three-dimensional scene that meets the user's procurement scheme requirements can be generated, and the target three-dimensional scene can be displayed to the user.
[0091] Figure 9 A schematic diagram of displaying a device model in a three-dimensional scene in a three-dimensional scene construction method of one embodiment of the present disclosure is shown, as shown in Figure 9 As shown, it includes an initial three-dimensional scene 900 and a device model 901 placed in the initial three-dimensional scene 900. The schematic Figure 9 A scene effect containing a device model is displayed.
[0092] Figure 10 A flowchart of a three-dimensional scene construction method of one embodiment of the present disclosure is shown, as shown in Figure 10 As shown, it includes:
[0093] Step 1: First, use the mobile phone app to open the camera function in the mobile phone, and display the camera shooting content in real time in the application; 360-degree shooting can be completed by holding the mobile phone, and the image information of the room (i.e., the target entity scene) is analyzed by shooting, and the sensor information obtained by the accelerometer and gyroscope is used to calculate and initialize the X, Y, and Z coordinate axis information of the scene.
[0094] Step 2: After the coordinate axes of the scene are established, feature point recognition in the room image can be performed to complete surface recognition and recording in the scene / room, for example, four wall surfaces (or multiple wall surfaces), one floor surface, one ceiling surface, and a number of surfaces can be clearly distinguished. On this basis, the boundary of the room is labeled, and a virtual three-dimensional scene is preliminarily created.
[0095] Step 3: In the virtual scene of the previous step, a number of surface information has been recorded and identified. A semi-transparent mesh can be created in the virtual scene through the mobile app to mark the surface; if the equipment has been placed in the room, the surface of the cabinet and equipment can be ignored at this time, and the patch operation will not be performed on these surfaces. After the patch operation and surface marking are completed, the application on the mobile phone (such as the application can provide Ceres library) can be used to realize the splicing of the surface through nonlinear fitting, and the virtual surface conforming to the actual scene is generated to improve the accuracy of the three-dimensional virtual scene created in step two.
[0096] Step 4: The mobile LIDAR is called through the mobile app to complete the measurement and calculation of the distance (size) of each surface in the scene. The measured and calculated values can be used to generate coordinate axes X', Y', and Z'. After saving the values of X', Y', and Z' to the local storage of the mobile phone, these relatively accurate scene size values can be used as input data and transmitted to the system background through the network interface to complete the virtual three-dimensional scene building. In addition, if there is one or more design standard data (reference data) of the machine room, the measurer can manually modify the size data of the machine room scene in the mobile app interactive interface.
[0097] Through steps 1-4, the creation of a specified IDC machine room virtual three-dimensional scene can be quickly completed using the mobile app.
[0098] Step 5: The equipment such as cabinets, bridges, cages, precision air conditioners, and cameras that need to be installed in the scheme can be determined according to the customer's IDC procurement scheme requirements. The customer can be a mobile app user, and the customer can place the three-dimensional device model in the AR scene by dragging from the device library of the app. After selecting the device model, the customer can also edit the position, size, angle, transparency, and note information of the device model. After the devices are placed one by one, the target three-dimensional scene that meets the customer's procurement scheme requirements can be generated in the mobile app, and the target three-dimensional scene can be demonstrated or shown to the customer as a construction scheme layout.
[0099] Step 6: The virtual machine room procurement construction scheme layout obtained in step 5 can be further optimized, such as further optimizing the placement position and angle of the equipment. In this step, the mobile app can be used to complete the optimization of the placement position and angle of the virtual equipment in the AR scene through a nonlinear fitting algorithm to obtain the optimized virtual equipment placement position values.
[0100] Step 7: Based on the data generated in Step 6 and the virtual scene generated in Step 4, a more accurate construction plan layout can be generated. This construction plan layout is not limited to display in an AR environment. In some practical applications, this construction plan layout can also provide a basic data model for precise engineering management applications. It can be used as a digital twin construction plan model for use by IDC data center sellers, customers, construction companies, supervisors, and other parties.
[0101] The three-dimensional scene construction method provided in this disclosure can achieve the following functions and effects: 1) It can build a virtual three-dimensional scene of a real IDC data center using devices such as mobile phone cameras and sensors, combined with image recognition and nonlinear fitting methods; 2) It can use AR technology to place virtual devices in the three-dimensional scene, and through data fitting, complete a display example of a construction plan (i.e., the target three-dimensional scene) with relatively accurate size and position. After the construction plan is saved, it can be displayed in the three-dimensional virtual scene via VR, rather than being limited to displaying it via AR based on the real scene.
[0102] It should be noted that the above figures are merely illustrative of the processes included in the method according to exemplary embodiments of the present invention, and are not intended to be limiting. It is readily understood that the processes shown in the above figures do not indicate or limit the temporal order of these processes. Furthermore, it is readily understood that these processes may, for example, be executed synchronously or asynchronously in multiple modules.
[0103] Figure 11 This diagram shows a block diagram of a three-dimensional scene construction apparatus 1100 according to a fifth embodiment of this disclosure; as shown Figure 11 As shown, it includes: an acquisition module 1101, used to acquire scene image data of the target entity scene, and parse the sensing information in the scene image data to generate a spatial coordinate system corresponding to the scene image data; a construction module 1102, used to identify surface objects in the scene image data, and construct an initial three-dimensional scene of the target entity scene in the spatial coordinate system based on the surface objects; a determination module 1103, used to acquire actual distance parameter values in the target entity scene, and determine the size information of the initial three-dimensional scene based on the actual distance parameter values; a placement module 1104, used to acquire device construction instructions, and determine the device model applied to the initial three-dimensional scene and its corresponding placement position based on the device construction instructions; and a display module 1105, used to display the device model in the initial three-dimensional scene according to the placement position, thereby generating a three-dimensional scene with device construction effect.
[0104] In some embodiments, the scene image data is obtained by image acquisition of the target entity scene using an image acquisition device with a sensing device; the scene image data includes a plurality of images; and the step of obtaining module 1101 parsing the sensing information in the scene image data to generate a spatial coordinate system corresponding to the scene image data includes: parsing the sensing information in the scene image data to obtain relative position information of the images in the scene image data and three-dimensional direction information corresponding to the images; and generating a spatial coordinate system corresponding to the scene image data according to the relative position information and the three-dimensional direction information.
[0105] In some embodiments, the construction module 1102 identifies a surface object in the scene image data, and the step of constructing an initial three-dimensional scene of the target entity scene based on the surface object in the spatial coordinate system includes: determining feature points on each image in the scene image data by augmented reality (AR) technology, and identifying the surface object in the scene image data according to the feature points; determining the position of the surface object in the spatial coordinate system based on the spatial coordinate system corresponding to the scene image data; constructing an initial surface model of the surface object according to the position of the surface object in the spatial coordinate system; and optimizing the initial surface model by a nonlinear fitting technique to obtain a target surface model, and then constructing an initial three-dimensional scene of the target entity scene according to the target surface model.
[0106] In some embodiments, the step of the construction module 1102 optimizing the initial surface model by a nonlinear fitting technique to obtain a target surface model includes: creating a mesh object corresponding to the initial surface model in the initial three-dimensional scene; fitting the mesh object on the corresponding initial surface model to generate labeling information of the initial surface model; and splicing the initial surface model based on the labeling information by a nonlinear fitting technique to obtain the target surface model.
[0107] In some embodiments, the step of the determination module 1103 obtaining an actual distance parameter value in the target entity scene includes: using an image acquisition device with a sensing device to measure the distance of the target entity scene to obtain an actual distance parameter value in the target entity scene; and / or obtaining architectural design data of the target entity scene to determine the actual distance parameter value in the target entity scene according to the architectural design data.
[0108] In some embodiments, the step of the determination module 1103 determining the size information of the initial three-dimensional scene according to the actual distance parameter value includes: determining a virtual measurement distance on each coordinate axis in the spatial coordinate system according to the actual distance parameter value; and determining the size information of the initial three-dimensional scene according to the virtual measurement distance on each coordinate axis.
[0109] In some embodiments, the placing module 1104 acquires the device construction instruction, and determines the device model applied to the initial three-dimensional scene and the corresponding placement position according to the device construction instruction, including: displaying a layout interface; generating the device construction instruction in response to a device construction operation performed by a user on the layout interface; and parsing the device construction instruction to obtain the device model and the corresponding placement position.
[0110] In some embodiments, the displaying module 1105 displays the device model in the initial three-dimensional scene according to the placement position, including: acquiring an actual model size of the device model, obtaining a display size of the device model based on the size information of the initial three-dimensional scene and the actual model size; placing the device model with the display size in the initial three-dimensional scene according to the placement position through augmented reality (AR) technology; adjusting the coordinates and / or direction of the placement of the device model using a non-linear fitting algorithm to determine a target placement position of the placement of the device model; and displaying the device model with the display size in the initial three-dimensional scene based on the target placement position through virtual reality (VR) technology.
[0111] It can be seen that, by implementing the three-dimensional scene-based wiring device shown in Figure 11 , a wiring path can be generated in a virtual three-dimensional scene in combination with wiring requirements, and a corresponding wiring length can be calculated, thereby providing sufficient and accurate data support for a wiring scheme in an actual scene. In addition, the three-dimensional scene-based wiring device described above can also achieve virtual ranging based on a virtual three-dimensional scene in combination with AR technology and SLAM technology.
[0112] Those skilled in the art can understand that each aspect of the present application can be implemented as a system, a method or a program product. Therefore, each aspect of the present application can be specifically implemented as a complete hardware embodiment, a complete software embodiment (including firmware, microcode, etc.), or an embodiment combining hardware and software aspects, which can be collectively referred to as "circuitry", "module" or "system" here.
[0113] Figure 12 A structural block diagram of a three-dimensional scene-based wiring computer device in an embodiment of the present disclosure is shown. It should be noted that the electronic device shown is only an example and should not impose any limitation on the functions and use range of the embodiments of the present application.
[0114] The electronic device 1200 according to this embodiment of the present application will be described below with reference to Figure 12 . Figure 12 The electronic device 1200 shown is only an example and should not impose any limitation on the functions and use range of the embodiments of the present application.
[0115] As Figure 12As shown, the electronic device 1200 is in the form of a general computing device. Components of the electronic device 1200 can include, but are not limited to, the at least one processing unit 1210 described above, the at least one memory unit 1220 described above, and a bus 1230 that connects the different system components including the memory unit 1220 and the processing unit 1210.
[0116] The memory unit stores program codes which can be executed by the processing unit 1210, so that the processing unit 1210 performs the steps according to various exemplary embodiments of the present application described in the above "Exemplary Method" section of the present specification. For example, the processing unit 1210 can perform the steps shown in FIG. 2, i.e., step S201, obtaining scene image data of a target entity scene, and parsing sensing information in the scene image data to generate a spatial coordinate system corresponding to the scene image data; step S203, identifying surface objects in the scene image data, and constructing an initial three-dimensional scene of the target entity scene in the spatial coordinate system based on the surface objects; step S205, obtaining actual distance parameter values in the target entity scene, and determining size information of the initial three-dimensional scene according to the actual distance parameter values; step S207, obtaining a device construction instruction, and determining a device model applied to the initial three-dimensional scene and a corresponding placement position according to the device construction instruction; and step S209, displaying the device model in the initial three-dimensional scene according to the placement position, and further generating a three-dimensional scene with a device construction effect. Figure 2
[0117] The memory unit 1220 can include a readable medium in the form of a volatile memory unit, such as a random access memory (RAM) 12201 and / or a cache memory unit 12202, and can further include a read-only memory (ROM) 12203.
[0118] The memory unit 1220 can further include a program / utility 12204 having a set (at least one) of program modules 12205, such as an operating system, one or more application programs, other program modules, and program data, and each of these examples, or some combination thereof, can include implementation of a network environment.
[0119] The bus 1230 can represent one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of a variety of bus architectures.
[0120] The electronic device 1200 can also communicate with one or more external devices 1300 such as a keyboard, a pointing device, a Bluetooth device, etc.; and one or more devices that enable a user to interact with the electronic device 1200 and / or one or more devices that enable the electronic device 1200 to communicate with one or more other computing devices. Such communication can occur via an input / output (I / O) interface 1250. Still yet, the electronic device 1200 can communicate with one or more networks such as a local area network (LAN), a wide area network (WAN), and / or the Internet through a network adapter 1260. As depicted, the network adapter 1260 communicates with the other components of the electronic device 1200 via the bus 1230. It should be appreciated that the electronic device 1200 can be a part of a larger system, and that there can be additional devices
[0121] Those skilled in the art will readily understand that the example embodiments described herein can be implemented by software and / or by hardware coupled with software, as described above. Thus, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of a software product. The software product can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash disk, a mobile hard disk, or the like) or a network, and includes a number of instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to perform the methods according to the embodiments of the present disclosure.
[0122] In the example embodiments of the present disclosure, a computer readable storage medium is also provided, which stores a program product capable of implementing the above-mentioned method. In some possible embodiments, various aspects of the present disclosure can also be implemented in the form of a program product, which includes program codes for causing a terminal device to perform the steps according to various example embodiments of the present disclosure described in the above-mentioned “example method” section of the specification when the program product is run on the terminal device.
[0123] The program product for implementing the above-mentioned method according to the embodiments of the present disclosure can be in the form of a portable compact disc read-only memory (CD-ROM) and includes program codes, and can be run on a terminal device such as a personal computer. However, the program product of the present disclosure is not limited to this, and in this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in conjunction with an instruction execution system, device, or apparatus.
[0124] The program product can take any combination of one or more computer-readable media. The computer-readable media can be a computer-readable storage medium or a computer-readable signal medium. The computer-readable storage medium can be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium include an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0125] The computer-readable signal medium can include a computer-readable storage medium that is configured to store and deliver a computer-readable program code. The computer-readable storage medium can be accessed by a computer system. In one example, a computer system can access the computer-readable storage medium through an interface. In another example, the computer-readable storage medium can be integrated into the computer system. The computer-readable signal medium can also be a computer-readable storage medium that is configured to store and deliver a computer-readable program code.
[0126] The program code embodied on the computer-readable medium can be transmitted using any appropriate medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination of the foregoing.
[0127] The program code for carrying out operations of the present disclosure can be written in any combination of one or more programming languages, including an object-oriented programming language such as Java, C++, etc., or conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device or entirely on the remote computing device or server. In the latter scenario, the remote computing device can be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computing device, such as through the Internet using an Internet Service Provider.
[0128] It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, such a division is not mandatory. Indeed, according to embodiments of the present disclosure, features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, features and functions of one module or unit described above can be further divided into a plurality of modules or units.
[0129] Furthermore, although individual steps of the methods in the present disclosure are described in a particular order in the drawings, this is not required or implied as to the order in which the steps must be performed, or that all of the steps shown must be performed to achieve the desired result. Additionally or alternatively, certain steps can be omitted, combined into a single step, broken into multiple steps, and / or the like.
[0130] From the above description of the embodiments, those skilled in the art will readily perceive that the example embodiments described herein can be implemented by software and / or by software in combination with the necessary hardware. Thus, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash disk, a mobile hard disk, or the like) or a network, and includes a number of instructions to enable a computing device (which can be a personal computer, a server, a mobile terminal, or a network device, etc.) to perform the methods according to the embodiments of the present disclosure.
[0131] Other embodiments of the present disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure following the general principles thereof and including such departures from the present disclosure that come within known use or custom in the art. The specification and examples are to be regarded as illustrative only, and the true scope and spirit of the present disclosure are indicated by the appended claims.
Claims
1. A method for constructing a three-dimensional scene, characterized in that, include: The process involves acquiring scene image data of a target entity scene, parsing the sensor information in the scene image data to generate a spatial coordinate system corresponding to the scene image data; wherein, the scene image data is obtained by using a mobile device equipped with a sensing device to capture images of the target entity scene; the sensor information includes sensor information obtained by calling the accelerometer and gyroscope of the mobile device to capture images of the target entity scene during image acquisition; Identify surface objects in the scene image data, and construct an initial three-dimensional scene of the target entity scene in the spatial coordinate system based on the surface objects; wherein, the initial three-dimensional scene includes a target surface model, which is obtained by receiving boundary annotations and patch annotations of the surface in the scene by the user in the operation interface of the mobile device, and optimizing it using nonlinear fitting technology based on the annotation operation; Obtain the actual distance parameter value in the target entity scene, and determine the size information of the initial three-dimensional scene based on the actual distance parameter value; Obtain device construction instructions, and determine the device model and its corresponding placement position for the initial 3D scene based on the device construction instructions; The device model is displayed in the initial 3D scene according to the placement position, thereby generating a 3D scene with device construction effect.
2. The method according to claim 1, characterized in that, The scene image data includes multiple images; and, The step of parsing the sensor information in the scene image data to generate the spatial coordinate system corresponding to the scene image data includes: The sensor information in the scene image data is analyzed to obtain the relative position information of the image in the scene image data and the three-dimensional orientation information corresponding to the image; A spatial coordinate system corresponding to the scene image data is generated based on the relative position information and the three-dimensional direction information.
3. The method according to claim 1, characterized in that, The step of identifying surface objects in the scene image data and constructing an initial 3D scene of the target entity scene in the spatial coordinate system based on the surface objects includes: The feature points on each image in the scene image data are determined by augmented reality (AR) technology, and the surface objects in the scene image data are identified based on the feature points. Based on the spatial coordinate system corresponding to the scene image data, determine the position of the surface object in the spatial coordinate system; Construct an initial surface model of the surface object based on its position in the spatial coordinate system; The initial surface model is optimized using nonlinear fitting techniques to obtain the target surface model, and then the initial three-dimensional scene of the target entity scene is constructed based on the target surface model.
4. The method according to claim 3, characterized in that, The step of optimizing the initial surface model using nonlinear fitting techniques to obtain the target surface model includes: Create a mesh object corresponding to the initial surface model in the initial 3D scene; The mesh object is attached to the corresponding initial surface model, and the annotation information of the initial surface model is generated; The target surface model is obtained by stitching together the initial surface model based on the annotation information using nonlinear fitting technology.
5. The method according to claim 1, characterized in that, The step of obtaining the actual distance parameter value in the target entity scene includes: The target entity scene is measured using an image acquisition device equipped with sensors to obtain the actual distance parameter value of the target entity scene; and / or, Obtain the architectural design data of the target entity scene, and determine the actual distance parameter value in the target entity scene based on the architectural design data.
6. The method according to claim 1, characterized in that, The step of determining the size information of the initial three-dimensional scene based on the actual distance parameter value includes: The virtual metric distance on each coordinate axis of the spatial coordinate system is determined based on the actual distance parameter value; The size information of the initial 3D scene is determined based on the virtual metric distance on each coordinate axis.
7. The method according to claim 1, characterized in that, The step of obtaining device construction instructions and determining the device model and its corresponding placement position applied to the initial 3D scene based on the device construction instructions includes: Display layout interface; In response to a device building operation performed by the user on the layout interface, the device building instruction is generated; The device construction instructions are parsed to obtain the device model and its corresponding placement position.
8. The method according to claim 1, characterized in that, The step of displaying the device model in the initial 3D scene according to the placement position includes: Obtain the actual model size of the device model, and based on the size information of the initial 3D scene and the actual model size, obtain the display size of the device model; The device model with the specified display size is placed in the initial three-dimensional scene according to the specified placement position using augmented reality (AR) technology. The coordinates and / or orientation of the device model are adjusted using a nonlinear fitting algorithm to determine the target placement position of the device model. The device model with the specified display size is displayed in the initial three-dimensional scene based on the target placement position using virtual reality (VR) technology.
9. A three-dimensional scene construction device, characterized in that, include: An acquisition module is used to acquire scene image data of a target entity scene and parse the sensor information in the scene image data to generate a spatial coordinate system corresponding to the scene image data; wherein, the scene image data is obtained by using a mobile device with a sensing device to capture images of the target entity scene; the sensor information includes sensor information obtained by calling the accelerometer and gyroscope of the mobile device to capture images of the target entity scene. A construction module is used to identify surface objects in the scene image data and construct an initial three-dimensional scene of the target entity scene in the spatial coordinate system based on the surface objects; wherein, the initial three-dimensional scene includes a target surface model, which is obtained in the operation interface of the mobile device by receiving boundary annotations and patch annotations of the surface in the scene by the user, and optimizing it based on the annotation operation using nonlinear fitting technology; The determination module is used to obtain the actual distance parameter value in the target entity scene, and determine the size information of the initial three-dimensional scene based on the actual distance parameter value; The placement module is used to acquire device construction instructions and determine the device model and its corresponding placement position applied to the initial 3D scene based on the device construction instructions. The display module is used to display the device model in the initial 3D scene according to the placement position, thereby generating a 3D scene with device construction effect.
10. A computer-readable storage medium having a computer program stored thereon, the program being executed by a processor to implement the three-dimensional scene construction method as described in any one of claims 1 to 8.
11. An electronic device, characterized in that, include: One or more processors; A storage device for storing one or more programs, which, when executed by one or more processors, cause the one or more processors to implement the three-dimensional scene construction method as described in any one of claims 1 to 8.
Citation Information
Patent Citations
Electronic device and method using electronic device to design specified scenario
CN102542603A
Key areas of business personnel path security monitoring system and method
CN106791700A
Information providing method and device based on augmented reality, equipment and storage medium
CN110286773A