Mobile augmented reality based building modeling information generation method

Abstract

Embodiments of the present disclosure disclose a mobile augmented reality based building modeling information generation method. A specific implementation of the method comprises: obtaining a building information digital model of a target building selected; obtaining building model projection information corresponding to the building information digital model; performing display processing on the building model projection information; performing the following update steps: performing change processing on the building information digital model to obtain an updated building information digital model; and determining the updated building information digital model as building modeling information. The implementation can improve the accuracy of the reconstructed building information digital model in the scale dimension, reduce the time and computing resources required to generate the building modeling information, and reduce the difficulty and computing resources required for later modeling correction.

Description

Technical Field

[0001] The embodiments disclosed herein relate to the field of computer technology, and more specifically to a method for generating architectural modeling information based on mobile augmented reality. Background Technology

[0002] Generating architectural modeling information is a core process in architectural design and education for creating and refining digital architectural models. Currently, the common method for generating architectural modeling information is for users to reconstruct or create 3D models by operating desktop modeling software, relying on their spatial memory and scale perception.

[0003] However, in practice, it has been found that when generating architectural modeling information using the above method, the following technical problems often arise:

[0004] When users operate in a desktop environment detached from real-world spatial references, a cognitive bias exists between their subjective scale perception and the actual physical scale, resulting in low accuracy in the scale dimension of the reconstructed Building Information Digital Model (BIM). This necessitates further adjustments and verifications, wasting the time and computational resources required to generate the building model information. Furthermore, the lack of effective means to instantly and intuitively verify the scale of the BIM in real space means that users cannot use their physical senses to verify and correct scale deviations in real time during the modeling process. Consequently, scale errors are only discovered in the later stages of modeling, making it difficult to correct the created BIM and consuming significant computational resources.

[0005] The information disclosed in this background section is only intended to enhance the understanding of the background of the inventive concept, and therefore may contain information that does not form prior art known to those skilled in the art. Summary of the Invention

[0006] The summary portion of this disclosure is intended to provide a brief overview of the concepts, which will be described in detail in the detailed description portion. This summary portion is not intended to identify key or essential features of the claimed technical solutions, nor is it intended to limit the scope of the claimed technical solutions.

[0007] Some embodiments of this disclosure provide a method, apparatus, device, and computer-readable medium for generating building modeling information based on mobile augmented reality to address one or more of the technical problems mentioned in the background section above.

[0008] In a first aspect, some embodiments of this disclosure provide a method for generating building modeling information based on mobile augmented reality. The method includes: in response to detecting a selection operation of a first model generation button on a mobile augmented reality device, acquiring a digital model of the selected target building's building information; in response to detecting a scanning operation of the mobile augmented reality device on a set of identification marker information within a selected target test area, acquiring building model projection information corresponding to the digital building information model; displaying the building model projection information; and in response to not detecting a user's confirmation operation on the digital building information model, performing the following update steps based on the digital building information model: in response to detecting a user's drag operation on the mobile augmented reality device, modifying the digital building information model based on the drag operation information to obtain an updated digital building information model; in response to detecting a user's touch operation on the mobile augmented reality device, modifying the digital building information model based on predefined step size information and the touch operation information to obtain an updated digital building information model; and in response to detecting a user's confirmation operation on the updated digital building information model, determining the updated digital building information model as building modeling information.

[0009] Secondly, some embodiments of this disclosure provide a building modeling information generation device based on mobile augmented reality. The device includes: a first acquisition unit configured to acquire a digital model of building information of a selected target building in response to detecting a selection operation of a first model generation button on a mobile augmented reality device; a second acquisition unit configured to acquire building model projection information corresponding to the digital model of building information in response to detecting a scanning operation of a set of identification marker information within a selected target test area by the mobile augmented reality device; a display unit configured to display the building model projection information; and an execution unit configured to execute a function in response to not detecting a user's confirmation of the digital model of building information. The system performs the following update steps based on the building information digital model (BIM): In response to detecting a drag operation by a user on the mobile augmented reality device, the BIM is modified according to the drag operation information to obtain an updated BIM; in response to detecting a touch operation by a user on the mobile augmented reality device, the BIM is modified according to predefined step size information and the touch operation information to obtain an updated BIM; a determining unit is configured to determine the updated BIM as building modeling information in response to detecting a user's confirmation operation on the updated BIM.

[0010] Thirdly, some embodiments of this disclosure provide an electronic device, including: one or more processors; and a storage device having one or more programs stored thereon, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the method described in any implementation of the first aspect above.

[0011] Fourthly, some embodiments of this disclosure provide a computer-readable medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the method described in any of the implementations of the first aspect above.

[0012] The above embodiments of this disclosure have the following beneficial effects: the method for generating building modeling information based on mobile augmented reality in some embodiments of this disclosure can improve the accuracy of the reconstructed digital building information model in the scale dimension, reduce the time and computing resources required to generate building modeling information, and reduce the difficulty and computing resources required for correction in the later modeling. Specifically, the low accuracy of the reconstructed Building Information Digital Model (BIM) in terms of scale dimension, the wasted time and computational resources required to generate the building modeling information, and the fact that scale errors are only discovered in the later stages of modeling, making correction difficult and computationally expensive, are all due to the following reasons: Users operate in a desktop environment detached from real-world spatial references, leading to a persistent cognitive bias between their subjective scale perception and the actual physical scale. This results in low accuracy of the reconstructed BIM in terms of scale dimension, requiring further adjustments and verifications, thus wasting the time and computational resources needed to generate the building modeling information. Furthermore, there is a lack of effective means to instantly and intuitively verify the scale of the BIM in real-world space. Users cannot use their bodily senses to verify and correct scale deviations in real time during the modeling process, causing scale errors to be discovered only in the later stages of modeling. This makes correction of the created BIM difficult and computationally expensive. Based on this, some embodiments of the mobile augmented reality-based building modeling information generation method of this disclosure first, in response to detecting a selection operation of a first model generation button on a mobile augmented reality device, acquires the BIM of the selected target building. Thus, a BIM corresponding to the aforementioned target building can be obtained. Then, in response to the detection of a scanning operation by the mobile augmented reality device on the set of identification markers within the selected target test area, the building model projection information corresponding to the aforementioned building information digital model is obtained. Thus, the building model projection information corresponding to the aforementioned building information digital model and the aforementioned target test area can be obtained. Next, the aforementioned building model projection information is displayed. Thus, the building model projection information displayed on the aforementioned mobile augmented reality device can be obtained. Next, in response to the absence of a user confirmation operation on the aforementioned building information digital model, the following update steps are performed based on the building information digital model: in response to the detection of a user dragging operation on the aforementioned mobile augmented reality device, the building information digital model is modified according to the dragging operation information to obtain an updated building information digital model; in response to the detection of a user touch operation on the aforementioned mobile augmented reality device, the building information digital model is modified according to predefined step size information and the aforementioned touch operation information to obtain an updated building information digital model. Thus, the updated building information digital model can be obtained. Finally, in response to the detection of a user confirmation operation on the updated building information digital model, the updated building information digital model is determined as building modeling information.Thus, architectural modeling information can be obtained. Because the aforementioned digital building information model is not reconstructed in desktop modeling, but rather through a mobile augmented reality device, displaying the architectural model projection information on this device enhances the user's perception of scale and their understanding of the actual physical scale. This allows for real-time verification and correction of scale deviations during the modeling process through bodily awareness, thereby reducing scale errors and the costs of later corrections. Consequently, the accuracy of the reconstructed digital building information model in the scale dimension can be improved, reducing the time and computational resources required to generate architectural modeling information, and decreasing the difficulty and computational resources required for later modeling corrections. Attached Figure Description

[0013] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and elements are not necessarily drawn to scale.

[0014] Figure 1 This is a flowchart of some embodiments of the method for generating building modeling information based on mobile augmented reality according to the present disclosure;

[0015] Figure 2 This is a schematic diagram of the structure of some embodiments of the mobile augmented reality-based building modeling information generation apparatus according to the present disclosure;

[0016] Figure 3 This is a schematic diagram of the structure of an electronic device suitable for implementing some embodiments of the present disclosure. Detailed Implementation

[0017] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0018] It should also be noted that, for ease of description, only the parts relevant to the invention are shown in the accompanying drawings. Unless otherwise specified, the embodiments and features described in this disclosure can be combined with each other.

[0019] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0020] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0021] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0022] This disclosure will now be described in detail with reference to the accompanying drawings and embodiments.

[0023] Figure 1 A flow 100 of some embodiments of the mobile augmented reality-based building modeling information generation method according to this disclosure is shown. The mobile augmented reality-based building modeling information generation method includes the following steps:

[0024] Step 101: In response to detecting a selection operation of the first model generation button on the mobile augmented reality device, obtain the building information digital model of the selected target building.

[0025] In some embodiments, in response to detecting a selection operation on a first model generation button applied to a mobile augmented reality device, the executing entity (e.g., a computer device) of the mobile augmented reality-based architectural modeling information generation method can acquire a digital model of the selected target building's architectural information. The target building can represent a pre-selected building. For example, the target building can be a colonnade. The architectural information digital model can represent a parametric digital model obtained after processing the target building. The parametric digital model can represent a digital model whose form and attributes are defined and controlled by adjustable parameters. The architectural information digital model can include various preset architectural component information. The preset architectural component information is adjustable. The preset architectural component information can represent the components included in the target building. For example, the preset architectural component information can be a column or a doorway. The first model generation button can represent a button displayed on the mobile augmented reality device for users to generate architectural modeling information through drag-and-drop and touch operations. The selection operation of the first model generation button can represent a click operation on the first model generation button. In practice, the aforementioned executing entity can obtain the digital model of the target building's architectural information from a server equipped with a pre-defined parametric modeling tool. The server with the pre-defined parametric modeling tool and the executing entity can connect via a wireless network. The pre-defined parametric modeling tool can be Grasshopper. The wireless network can be WiFi.

[0026] Step 102: In response to detecting that the mobile augmented reality device scans the set of identification marker information within the selected target test area, obtain the building model projection information of the corresponding building information digital model.

[0027] In some embodiments, in response to detecting a scanning operation by a mobile augmented reality device on a set of identification marker information within a selected target test area, the executing entity can acquire building model projection information corresponding to the building information digital model. The mobile augmented reality device can be a device combining augmented reality technology and the characteristics of a mobile device. The mobile augmented reality device can be AR glasses, a tablet computer, or a mobile phone. The target test area can be a pre-selected site that meets preset selection conditions. The preset selection conditions can be that the size of the selected site is larger than the size of the target building, the site is flat, and the wireless network within the site is stable. For example, the target test area can be a sports field. The identification marker information in the set of identification marker information can be markers used to overlay the building information digital model onto the target test area. For example, the identification marker information can be a QR code printed on A3 paper. The scanning operation can be an operation by the mobile augmented reality device scanning the set of identification marker information. The building model projection information can be a projection after the building information digital model is overlaid on the target test area.

[0028] In some optional implementations of certain embodiments, in response to detecting a scanning operation of a mobile augmented reality device on a set of identification marker information within a selected target test area, the aforementioned execution entity may obtain the building model projection information corresponding to the aforementioned building information digital model through the following steps:

[0029] The first step involves determining the index information of the identification markers in the aforementioned set of identification marker information in response to the detected scanning operation. This index information represents the index corresponding to the identification marker information. Each identification marker in the aforementioned set of identification marker information stores a unique index. In practice, the executing entity can scan the identification marker information using a built-in camera to obtain the corresponding index information.

[0030] The second step is to obtain the spatial coordinate information of the building information digital model (BIM) based on the aforementioned index information. This spatial coordinate information represents the location (three-dimensional coordinates) where the BIM should be placed within the target test area. In practice, the executing entity first sends the index information to the server. Then, it retrieves the spatial coordinate information of the BIM corresponding to the index information from the server.

[0031] The third step involves fusing the aforementioned building information digital model (BIM) with the target test area based on the spatial coordinate information, thereby obtaining the corresponding building model projection information. In practice, the executing entity can use an orthogonal projection algorithm to map the BIM onto the target test area to obtain the corresponding building model projection information.

[0032] Step 103: Display the projection information of the building model.

[0033] In some embodiments, the aforementioned execution entity may perform display processing on the aforementioned architectural model projection information.

[0034] In some optional implementations of certain embodiments, the aforementioned execution entity may perform display processing on the aforementioned architectural model projection information through the following steps:

[0035] Based on the aforementioned architectural model projection information and device movement information, the view information in the mobile augmented reality device is determined, and the view information is displayed. The device movement information represents the distance and direction of movement of the mobile augmented reality device. The view information represents the view corresponding to the architectural model projection information that should be displayed at the current position. The current position represents the three-dimensional coordinates of the mobile augmented reality device after its movement. The view represents the plan view of the architectural model projection information displayed within the mobile augmented reality device at the current position. For example, the view can be a front view. In practice, firstly, the executing entity can determine the view transformation matrix between the mobile augmented reality device and the architectural model projection information using visual inertial odometry based on the device movement information. Then, the view information of the architectural model projection information at the current position is determined using the view transformation matrix. Finally, the view information is displayed in the mobile augmented reality device. It should be noted that when displaying the architectural model projection information corresponding to the digital architectural information model, the digital architectural information model is also displayed, which can be used by the user for subsequent operations on the displayed digital architectural information model.

[0036] Step 104: In response to the absence of detected user confirmation of the building information digital model, perform the following update steps based on the building information digital model:

[0037] Step 1041: In response to detecting drag operation information of the user on the mobile augmented reality device, the building information digital model is modified according to the drag operation information to obtain the updated building information digital model.

[0038] In some embodiments, in response to detecting drag operation information of a user on the mobile augmented reality device, the executing entity can modify the building information digital model according to the drag operation information to obtain an updated building information digital model. The drag operation information can represent a user's drag operation on controls displayed within the mobile augmented reality device. The controls used for dragging can be sliders used to adjust the position, size, and quantity of building component information included in the building information digital model. For example, the drag operation can be a user dragging controls included in the mobile augmented reality device. It should be noted that during the adjustment of the building component information, other building component information included in the building information digital model will be automatically aligned with the building component information. The user can be a user using the mobile augmented reality device to model the target building. It should be noted that before modeling the target building, the user needs to observe the target building for a duration ranging from 0 to 10 minutes. The confirmation operation of the building information digital model can represent the user clicking the "OK" button to confirm the currently displayed building information digital model as the building modeling information. The building information digital model displayed at the current moment can represent the original building information digital model or the updated building information digital model. The "OK" button represents the button used by the user to use the building information digital model displayed at the current moment as building modeling information.

[0039] In addressing the technical problems mentioned above, and specifically for the second application scenario—where users perform detailed modeling of historical artifacts through abstract and continuous operational intentions (e.g., blind operation without prompts)—the following technical issues often arise: real-time quantification and dynamic guidance are impossible; verification relies solely on isolated, final reconstruction results; and blindly adjusting parameters leads to scale distortion, increasing modeling steps and difficulty, resulting in longer modeling times and higher resource consumption. Considering the following requirements for this application scenario—adapting to high precision, high perception, and high visual feedback—we have decided to adopt the following solution:

[0040] Optionally, prior to step 1041, in response to detecting a user's interactive operation on the mobile augmented reality device, the executing entity may also display the building information digital model and a set of control information corresponding to the various building component information included in the building information digital model on the mobile augmented reality device. The interactive operation may represent a user clicking a display button to display the set of control information corresponding to the various building component information included in the building information digital model. The display button may represent a button used to display the set of control information. The control information in the set of control information may represent controls that can adjust the corresponding building component information. The control information may represent controls used for dragging operations, and may be sliders used to adjust the position, size, and quantity of the building component information included in the building information digital model. In practice, the executing entity may display the set of control information corresponding to the various building component information included in the building information digital model on the mobile augmented reality device. It should be noted that the control information in the set of control information and the building component information in the various building component information may correspond one-to-one.

[0041] In some optional implementations of certain embodiments, in response to detecting drag operation information of a user on the aforementioned mobile augmented reality device, the executing entity may perform modification processing on the aforementioned building information digital model according to the drag operation information through the following steps to obtain an updated building information digital model:

[0042] The first step is to determine the size error data between the actual size data and the corresponding actual size data in the aforementioned actual size data set, based on the drag operation information and the set of real-size data. The actual size data in the aforementioned actual size data set can represent the pre-set size of the building component information corresponding to each of the aforementioned building component information. The actual size data can represent the size of the building component information adjusted by the drag operation information. The size error data can represent the difference between the actual size data and the corresponding actual size data. It should be noted that there can be a one-to-one correspondence between the building component information in the aforementioned building component information and the actual size data in the aforementioned actual size data set. In practice, firstly, the executing entity can determine the target value by multiplying the screen displacement (pixels) generated by the drag operation information by the model units corresponding to the preset scale. Then, the ratio of the target value to the screen resolution reference value is determined as the actual size data of the corresponding building component information. The screen resolution reference value can represent the actual physical size (e.g., inches or millimeters) used to determine the screen resolution (number of pixels). For example, if the screen displacement is 50px, the screen resolution baseline is 100px / m, and the preset scale is 1:100, then the corresponding model unit can be 100mm = 0.1m. Therefore, the actual size of the wall can be 50px × 0.1m ÷ 100px / m = 50mm. Then, the difference between the above actual size data and the true size data of the corresponding building component information is determined as the size error data.

[0043] The second step is to determine the error change rate of the aforementioned dimensional error data based on the data. This error change rate characterizes the rate at which the dimensional error data changes over time. In practice, firstly, the executing entity can retrieve the previous dimensional error data from the buffer storing the data as historical dimensional error data. Then, the difference between the current dimensional error data and the historical dimensional error data is determined as the dimensional difference data. Next, the difference between the time corresponding to the current dimensional error data and the time corresponding to the historical dimensional error data is determined as the time difference. Finally, the ratio between the dimensional difference data and the time difference is determined as the error change rate of the dimensional error data.

[0044] The third step involves determining the fuzzy inference output based on the aforementioned dimensional error data, the aforementioned error change rate, and the aforementioned preset fuzzy rule base. The fuzzy inference output includes feedback strength information and feedback type information. The feedback strength information characterizes the intensity of feedback that the executing entity should provide. The feedback strength information can be either weak or strong. For example, if the dimensional error data is less than or equal to 100mm and the error change rate is less than or equal to -150mm / s, the feedback strength information is weak. If the dimensional error data is greater than 100mm and the error change rate is greater than or equal to 0mm / s, the feedback strength information is strong. The feedback type information characterizes the type of feedback that the executing entity should provide. The type can be text or an image. The preset fuzzy rules in the aforementioned preset fuzzy rule base characterize the correspondence between the target error data and the fuzzy inference output. The target error data can characterize the aforementioned dimensional error data and the aforementioned error change rate. The fuzzy inference output can characterize the output determined based on the aforementioned dimensional error data and the aforementioned error change rate. In practice, the aforementioned executing entity can obtain the fuzzy inference output results corresponding to the aforementioned dimensional error data and the aforementioned error change rate from a preset fuzzy rule base. For example, if the dimensional error data is +350mm and the error change rate is 0, the fuzzy inference output result will be: feedback intensity information is strong, feedback type information is "provide assistance," and the text "The doorway height you set may be too high for ordinary people. Please refer to the human figure icon to readjust it." If the dimensional error data is +60mm and the error change rate is -290mm / s, the fuzzy inference output result will be: feedback intensity information is weak, and feedback type information will display the text "Very good, correct direction."

[0045] Fourth, based on the feedback intensity information included in the fuzzy inference output, first display information corresponding to the feedback intensity information is displayed on the mobile augmented reality device. This first display information can represent the state that should be displayed on the mobile augmented reality device corresponding to the feedback intensity information. For example, the first display information can be a color bar. In practice, the executing entity can obtain the first display information corresponding to the feedback intensity information from a set of feedback intensity correspondences. The feedback intensity correspondences in the set of feedback intensity correspondences can represent the pre-set correspondence between feedback intensity information and the first display information. For example, if the feedback intensity information is strong, the first display information can be a color bar turning dark red and slowly flashing, while a human-shaped icon of standard height (178cm) appears on the side of the interface as a reference.

[0046] Fifth, based on the feedback type information included in the fuzzy inference output, display second display information corresponding to the feedback type information on the mobile augmented reality device. The second display information can represent the text displayed on the mobile augmented reality device corresponding to the feedback type information. In practice, the executing entity can obtain the second display information corresponding to the feedback type information included in the fuzzy inference output from a preset feedback type correspondence information set. The preset feedback type correspondence information in the preset feedback type correspondence information set can represent the correspondence between the feedback type information and the second display information. For example, if the preset feedback type correspondence information is text corresponding to the feedback type information, then the second display information could be "The doorway height you set may be too high for ordinary people; please refer to the human figure icon to readjust it."

[0047] Step 6: In response to determining that the aforementioned dimensional error data meets the preset calibration conditions, the system confirms that the building component information corresponding to the aforementioned control information has been successfully calibrated and displays a confirmation signal. The preset calibration conditions can be that the absolute value of the aforementioned dimensional error data is less than or equal to a preset threshold. The specific value of the preset threshold is not limited here; for example, the preset threshold can be 1 mm. The confirmation signal can represent a color bar displayed on the mobile augmented reality device after the aforementioned building component information has been successfully calibrated. For example, the confirmation signal can be that the color bar is green. The specific values ​​of the width and length of the color bar are not limited and can be adjusted according to actual needs.

[0048] The above-described technical solution, as an inventive point of this disclosure, solves technical problem two: "Increased modeling steps and modeling difficulty, resulting in longer modeling time and higher resource consumption." The reasons for the increased modeling steps and difficulty, leading to longer modeling time and higher resource consumption, are as follows: Real-time quantization and dynamic guidance are impossible; verification can only be performed through isolated, final reconstruction results, and blindly adjusting parameters leads to scale distortion, thus increasing modeling steps and difficulty, resulting in longer modeling time and higher resource consumption. To achieve this effect, the mobile augmented reality-based building modeling information generation method of this disclosure, in response to detecting user interaction with the mobile augmented reality device, modifies the building component information of the target building information digital model and displays first display information corresponding to feedback intensity information and second display information corresponding to feedback type information, providing guidance for the user's subsequent decision-making. Therefore, it can reduce modeling steps and lower modeling difficulty, thereby reducing modeling time and resource consumption.

[0049] Step 1042: In response to detecting the user's touch operation information on the mobile augmented reality device, the building information digital model is modified according to the predefined step size information and touch operation information to obtain the updated building information digital model.

[0050] In some embodiments, in response to detecting touch operation information from a user on the mobile augmented reality device, the executing entity can modify the building information digital model according to predefined step size information and the touch operation information to obtain an updated building information digital model. The touch operation information can characterize a touch operation on the mobile augmented reality device. For example, the touch operation can be a user touching a control included in the mobile augmented reality device. The control used for touch can be a button used to adjust the position, size, and quantity of building component information included in the building information digital model. The predefined step size information can characterize the pre-set unit by which the building component information corresponding to the touched control needs to be adjusted after the control included in the mobile augmented reality device is touched once via the touch operation information. Each control included in the mobile augmented reality device for performing a touch operation corresponds to predefined step size information. Here, the specific value of the unit is not limited. For example, the predefined step size information can be +10mm or -10mm. In practice, the aforementioned executing entity can modify the building component information included in the building information digital model based on the touched controls, thereby obtaining an updated building information digital model. It should be noted that during the adjustment of the building component information, the information of other building components included in the building information digital model will be automatically aligned with the aforementioned building component information.

[0051] Step 105: In response to detecting the user's confirmation operation on the updated building information digital model, the updated building information digital model is identified as building modeling information.

[0052] In some embodiments, in response to detecting a user's confirmation operation on the updated building information digital model, the aforementioned execution entity may determine the updated building information digital model as building modeling information.

[0053] Optionally, after step 105, in response to the absence of user confirmation of the updated building information digital model, the executing entity may use the updated building information digital model as the building information digital model and execute the update steps again.

[0054] In addressing the technical challenges of the aforementioned background technologies, and specifically for scenario three: the reconstruction of historical buildings or cultural relics, which requires highly accurate reproduction of their authentic details, often presents the following technical problems: the design environment is separate from the actual physical environment of the relic (e.g., lighting, spatial scale, existing structure), and the texture details of historical buildings or relics differ under different lighting conditions. This makes it impossible to intuitively and accurately determine the visual harmony between the restoration components, structural reinforcements, and the historical entity within the context of the real environment (especially dynamic lighting), leading to deviations in the design implementation on-site. This results in significant difficulty and computational resource consumption in subsequently correcting the created digital building information model. Considering the following requirements for this application scenario—adaptability to high requirements for size and spatial relationships, adaptability to complex structures, adaptability to multiple information layers, and adaptability to different lighting environments—we have decided to adopt the following solution:

[0055] Optionally, after step 105, firstly, in response to detecting a selection operation on the second model generation button of the mobile augmented reality device, an interactive building model corresponding to the target experimental building is obtained. The second model generation button can represent a button for users to generate building modeling information via touch operation and voice command. The selection operation of the second model generation button can represent a click operation on the second model generation button. The target experimental building can represent a pre-selected building. The interactive building model has interactive functions. The interactive functions can include a shell hiding function, a real-time cropping function, and a height layer switching function. The interactive building model can represent a parametric digital model corresponding to the target experimental building. The interactive building model can include various preset building component information. The preset building component information is adjustable. The shell hiding function can represent the function of hiding the shell of the interactive building model. The real-time cropping function can represent the function of cropping the interactive building model. The height layer switching function can represent the function of changing the height reference plane of the interactive building model displayed within the user's viewing angle. It should be noted that the method of obtaining the interactive building model corresponding to the above-mentioned target experimental building is the same as the method of obtaining the building model projection information corresponding to the above-mentioned building information digital model, and will not be repeated here. Please refer to step 101.

[0056] Next, based on the aforementioned interactive building model and target detection area, interactive model projection information corresponding to the interactive building model is obtained. This interactive model projection information represents the full-scale projection formed by overlaying the interactive building model onto the target detection area. The target detection area represents a pre-selected site that meets preset conditions. These preset conditions may include a site size larger than the target experimental building size, a flat site, and a stable wireless network connection at the site. It should be noted that obtaining the interactive model projection information based on the interactive building model and target detection area is done in the same way as obtaining the building model projection information corresponding to the digital building information model, and will not be repeated here; please refer to step 102.

[0057] Then, the interactive model projection information is displayed. In practice, the executing entity can display the interactive model projection information on the mobile augmented reality device. The view of the interactive model projection information displayed on the mobile augmented reality device changes as the mobile augmented reality device moves.

[0058] Secondly, in response to the absence of detected user confirmation action on the aforementioned mobile augmented reality device, the following change steps are performed based on the interactive building model:

[0059] The first step involves determining the modified interactive building model in response to a detected touch operation by the user on the mobile augmented reality device. In practice, the executing entity can adjust the building component information based on predefined step size information corresponding to the touch operation, thereby obtaining the modified interactive building model. For example, in response to a detected touch operation by the user on a button on the mobile augmented reality device, the height (building component information) of the column corresponding to the button is increased by 10mm. It should be noted that during the adjustment of the building component information, the information of other building components included in the interactive building model will be automatically aligned with the modified building component information.

[0060] The second step is to render the modified interactive building model to obtain merged view information for display processing.

[0061] Third, in response to the absence of a confirmed user action on the aforementioned mobile augmented reality device, the modified interactive building model is used as the interactive building model, and the above modification steps are executed again.

[0062] Fourth, in response to the detection of a user's confirmation operation on the aforementioned mobile augmented reality device, the modified interactive building model is identified as building modeling information.

[0063] Optionally, the above modification steps further include: adjusting the interactive building model in response to detecting user voice command information to obtain display status information of the interactive building model in the mobile augmented reality device. The voice command information can represent a user's voice command to view the interactive building model displayed in the mobile augmented reality device. The display status information can represent the display status of the interactive building model in the mobile augmented reality device. For example, the voice command information could be "Hide the exterior walls, look at the structure," and the corresponding display status information could be that the model's exterior walls are transparent, revealing the internal beam-column relationships. In practice, in response to detecting user voice command information, the executing entity can adjust the interactive building model by calling an API interface to obtain the display status information of the interactive building model in the mobile augmented reality device. The API interface can be a standardized interface for environmental perception, image processing, or user interaction. The confirmation operation performed on the mobile augmented reality device can represent the user clicking the "OK" button to confirm the currently displayed interactive building model as building modeling information. The currently displayed interactive building model can represent the original interactive building model or the modified interactive building model. The aforementioned "OK" button represents the user's decision to confirm the currently displayed interactive building model as architectural modeling information. It should be noted that the displayed status information can serve as a reference for the user when changes are made to the interactive building model via the aforementioned voice commands (e.g., providing the internal structure of the interactive building model for the user's reference).

[0064] The above-described technical solution, as an inventive point of this disclosure, solves technical problem three: "The inability to intuitively and accurately determine the visual coordination between repair components, structural reinforcements, and the historical entity in a real-world context leads to deviations in the design scheme during on-site implementation, making subsequent corrections to the created building information digital model more difficult and computationally resource-intensive." The reasons for this inability to intuitively and accurately determine the visual coordination between repair components, structural reinforcements, and the historical entity in a real-world context, leading to deviations in the design scheme during on-site implementation and subsequent corrections to the created building information digital model, are as follows: The design environment is separate from the real physical environment of the cultural relic (such as real lighting, spatial scale, and existing structure). Furthermore, the texture details of historical buildings or cultural relics differ under different lighting conditions. The inability to intuitively and accurately determine the visual coordination between repair components, structural reinforcements, and the historical entity in a real-world context (especially dynamic lighting and shadows) results in deviations in the design scheme during on-site implementation, making subsequent corrections to the created building information digital model more difficult and computationally resource-intensive. To achieve this effect, the disclosed method for generating architectural modeling information based on mobile augmented reality displays real-time status information on the mobile augmented reality device in response to the detection of user activation of interactive functions. Furthermore, after changes to the interactive architectural model, the lighting and shadows rendered on the mobile augmented reality device are adjusted accordingly. This improves the realism of the reconstruction process, increases the accuracy of reconstructing experimental buildings, reduces deviations in design implementation on-site, and decreases the difficulty and computational resources required for subsequent corrections to the created digital architectural information model.

[0065] In addressing the technical challenges of the aforementioned background technologies, and specifically for scenario four—the need to install concealed steel reinforcement systems (such as steel frames and carbon fiber fabric) within ancient buildings to withstand external forces like earthquakes—the following technical issues often arise: the system cannot reflect the structural safety of the building design in the physical world; users can only perceive the form, not the crucial performance, leading to a lack of critical performance data to support design decisions. This makes it difficult to correct structural defects later, and consumes significant computational resources. Furthermore, the separation of the analysis software running on the CPU from the rendering pipeline running on the GPU results in frequent large-scale data exchanges between the CPU and GPU, consuming substantial computational resources and increasing rendering time. Considering the following requirements for this application scenario—high structural safety requirements and the need for irreversible operations (difficult to modify after construction begins)—we have decided to adopt the following solution:

[0066] In some optional implementations of certain embodiments, the aforementioned execution entity can render the modified interactive building model using the following steps to obtain the merged view information:

[0067] The first step involves inputting the modified interactive building model into the target physics engine to obtain structural stress distribution data for the modified interactive building model. The target physics engine can represent a lightweight, GPU-accelerated physics engine. For example, the target physics engine could be the Genesis physics engine. The structural stress distribution data represents the stress values ​​of the corresponding interactive building model under stress. In practice, the executing entity can input the modified interactive building model and preset material properties into the target physics engine. The target physics engine can then perform the following steps to obtain the structural stress distribution data: First, the boundary conditions corresponding to the building structure type and stress scenario of the interactive building model from the preset boundary condition set are selected as the boundary conditions. The preset material properties represent the properties of the materials used in the target experimental building. For example, the preset material properties can be the elastic modulus and Poisson's ratio of the material. The preset boundary conditions in the preset boundary condition set represent the correspondence between the building structure type, stress scenario, and boundary conditions of the interactive building model. The aforementioned stress scenarios characterize the comprehensive situation of the types, magnitudes, directions, locations, and durations of forces that the components or structures of the interactive building model may experience throughout their entire lifecycle. For example, if the building structure type of the interactive building model is a wooden colonnade, the selected boundary conditions could be to set the column bases as fixed constraints and apply a uniformly distributed load to the roof to simulate self-weight (stress scenario). Next, the target physics engine discretizes the interactive building model by calling the graphics processing unit, obtaining a set of mesh elements. Then, the target physics engine, through the graphics processing unit, determines the stress value of each mesh element in the set of mesh elements based on the preset material properties and the selected boundary conditions. Finally, the target physics engine can determine the obtained stress values ​​as the structural stress distribution data of the modified interactive building model.

[0068] The second step is to determine the elevation and azimuth information of the target light source. The target light source can be the sun. The elevation angle information represents the elevation angle of the target light source at the current moment. The azimuth information represents the azimuth angle of the target light source at the current moment. In practice, the executing entity can determine the elevation and azimuth information of the target light source using a built-in simplified astronomical formula.

[0069] The third step involves rendering the modified interactive building model based on the aforementioned elevation and azimuth information to obtain lighting and shadow blending information. This lighting and shadow blending information represents the result of rendering the modified interactive building model with lighting and shadows. In practice, firstly, the executing entity can convert the elevation and azimuth information into the direction of sunlight using a standard spherical to Cartesian coordinate system conversion. Secondly, using standard graphics methods for constructing view and projection matrices, a virtual light source camera with the same position as the sun and the same direction of sunlight is created. Then, a graphics API is called to render the modified interactive building model, obtaining a depth texture map. This virtual light source camera represents a functional virtual camera object whose core function is not "capturing images," but rather simulating the illumination characteristics of real light sources, providing objects in the virtual scene with lighting effects consistent with real light sources (such as the sun or lamplight), thus achieving lighting blending between the virtual and real scenes. The depth texture map represents the nearest depth value of the segment seen from the sun's perspective. The graphics API can be OpenGL. Next, the modified interactive building model is rasterized using the graphics rendering pipeline to obtain a set of fragments. Each fragment in the set corresponds to a pixel ultimately displayed on the mobile augmented reality device. Then, a set of normal vectors corresponding to the fragment set is obtained from the geometric data of the modified interactive building model through vertex normal interpolation, and the surface roughness corresponding to each fragment in the set is also obtained from the geometric data of the modified interactive building model. The normal vectors in the set of normal vectors can be the normal vectors corresponding to the fragments included in the modified interactive building model. Then, based on the set of normal vectors and the direction of sunlight, the brightness value of each fragment included in the modified interactive building model is determined using Lambert's cosine law. Next, for each fragment included in the modified interactive building model, the specular brightness of the fragment is determined using the Blinn-Phong model, based on the viewing direction from the fragment's position to the camera, the surface roughness of the fragment, and the reflection direction calculated from the direction of sunlight and the normal vector of the fragment. Next, the fragment is transformed from world coordinates to the sun's clipping space using shadow coordinate transformation to obtain the target depth value for that fragment. Then, for the fragment, the fragment shader compares the target depth value with the depth value of the fragment sampled from the depth texture map. If the target depth value is greater than the sampled depth value, the brightness and highlight brightness of the corresponding fragment are multiplied by zero or a decay factor to obtain the brightness and highlight brightness after shadow processing. The specific value of the decay factor is not limited here.For example, the attenuation coefficient can be 0.2. Next, the sum of the luminance value after shadow processing and the luminance value after shadow processing is determined as the luminance information of the above segment. Finally, the obtained luminance information is determined as the light and shadow blending information.

[0070] The fourth step is to determine the distribution uniformity result based on the aforementioned structural stress distribution data. This distribution uniformity result can be a numerical value characterizing the uniformity of the structural stress distribution data. For example, the distribution uniformity result could be 0.5. The smaller the value characterized by the distribution uniformity result, the more uniform the stress values ​​included in the structural stress distribution data. In practice, firstly, the executing entity can determine the maximum stress value, the minimum stress value, and the average value of all included stress values ​​in the structural stress distribution data. Then, the difference between the maximum and minimum stress values ​​is determined as the first target difference. Finally, the ratio between the first target difference and the average value is determined as the distribution uniformity result.

[0071] Fifth, in response to determining that the above-mentioned uniformity of distribution meets a preset threshold condition, the modified interactive building model is rendered according to the above-mentioned structural stress distribution data, the first mapping method, and the target visual encoding table to obtain a dynamic stress color mapping map. The preset threshold condition can be that the above-mentioned uniformity of distribution is less than or equal to a preset value. Here, the specific value of the preset value is not limited. For example, the preset value can be 0.2. The first mapping method can characterize the way each stress value in the above-mentioned structural stress distribution data is mapped to a normalized index value when the above-mentioned uniformity of distribution meets the preset threshold condition. The target visual encoding table can characterize the correspondence between the index value and color corresponding to each stress value in the above-mentioned structural stress distribution data. The dynamic stress color mapping map can be a semi-transparent color image generated based on the structural stress distribution data corresponding to the above-mentioned interactive building model. In practice, firstly, for each stress value in the above-mentioned structural stress distribution data, the executing entity can perform the following steps: Firstly, through the above-mentioned first mapping method, the difference between the above-mentioned stress value and the above-mentioned minimum stress value is determined as the second target difference. The ratio of the second target difference to the first target difference is determined as the index value of the mesh cell corresponding to the stress value. Next, using a target visual encoding table, the color of the mesh cell corresponding to the stress value is determined based on the index value. For example, if the index value is 0.01, the corresponding color in the target visual encoding table can be dark blue. Then, using a graphics API, the modified interactive building model is rendered based on the obtained colors of each mesh cell to obtain a dynamic stress color map.

[0072] Step 6: In response to the determination that the above-mentioned uniformity of distribution does not meet the preset threshold condition, the modified interactive building model is rendered according to the above-mentioned structural stress distribution data, the second mapping method, and the target visual encoding table to obtain a dynamic stress color mapping map. The second mapping method characterizes the way each stress value in the above-mentioned structural stress distribution data is mapped to a normalized index value when the above-mentioned uniformity of distribution does not meet the preset threshold condition. In practice, firstly, for each stress value in the above-mentioned structural stress distribution data, the executing entity can perform the following steps: First, using the second mapping method, the sum of the second target difference and 1 is determined as the second sum value, and the sum of the first target difference and 1 is determined as the first sum value. The logarithms of the first and second sum values ​​are taken respectively to obtain the first logarithmic value and the second logarithmic value. The ratio of the second logarithmic value to the first logarithmic value is determined as the index value of the mesh cell corresponding to the stress value. Next, using the target visual encoding table, the color corresponding to the index value in the target visual encoding table is determined according to the index value. Then, using a graphics API, the modified interactive building model is rendered based on the colors of the obtained stress values ​​to obtain a dynamic stress color map.

[0073] Step 7: The aforementioned lighting and shadow blending information and the aforementioned dynamic stress color map are fused to obtain real-time fusion result information. This real-time fusion result information characterizes the result obtained after fusing the aforementioned lighting and shadow blending information and the aforementioned dynamic stress color map. In practice, the executing entity can fuse the aforementioned lighting and shadow blending information and the aforementioned dynamic stress color map through alpha blending in the fragment shader to obtain the real-time fusion result information.

[0074] Step 8: The real-time fusion result information and the target detection area are overlaid to obtain fused view information for displaying the modified interactive building model. In practice, the executing entity can use an augmented reality framework to overlay the real-time fusion result information and the target detection area to obtain fused view information. The augmented reality framework can be ARKit. The fused view information represents the view after overlaying the real-time fusion result information onto the target detection area, resulting in the overlaid view. Finally, the overlaid view is displayed.

[0075] The above-described technical solution, as an inventive point of this disclosure, solves technical problem four: "The difficulty and computational resource consumption of correcting the created building information digital model due to the discovery of structural defects in the later stages leads to a significant waste of computational resources and increased rendering time." The reasons for this difficulty and computational resource consumption in correcting the created building information digital model due to the discovery of structural defects in the later stages, leading to a significant waste of computational resources and increased rendering time, are as follows: The system cannot reflect the structural safety of the architectural design scheme in the physical world; users can only obtain morphological perception but cannot perform crucial performance perception, resulting in a lack of key performance data support for design decisions and a high risk of modification due to the discovery of structural defects in the later stages; furthermore, the separation of the independent analysis software running on the central processing unit (CPU) from the rendering pipeline running on the graphics processing unit (GPU) leads to frequent large-scale data exchanges between the CPU and GPU, resulting in a significant waste of computational resources and increased rendering time. If the above factors are addressed, the difficulty and computational resource consumption of correcting structural defects in the later stages of building information digital modeling can be reduced, thereby reducing computational resource consumption and rendering time. To achieve this, the mobile augmented reality-based building modeling information generation method disclosed herein seamlessly embeds physical simulation into the real-time rendering pipeline. The system can convert abstract computational data (stress values, brightness values, and specular brightness) into a dynamic stress color map overlaid on the model surface in real time, based on the uniformity of stress values ​​using a first or second mapping method. This reduces the high risk of modifying structural defects later, reduces computational resource consumption, and consequently reduces rendering time.

[0076] The above embodiments of this disclosure have the following beneficial effects: the method for generating building modeling information based on mobile augmented reality in some embodiments of this disclosure can improve the accuracy of the reconstructed digital building information model in the scale dimension, reduce the time and computing resources required to generate building modeling information, and reduce the difficulty and computing resources required for correction in the later modeling. Specifically, the low accuracy of the reconstructed Building Information Digital Model (BIM) in terms of scale dimension, the wasted time and computational resources required to generate the building modeling information, and the fact that scale errors are only discovered in the later stages of modeling, making correction difficult and computationally expensive, are all due to the following reasons: Users operate in a desktop environment detached from real-world spatial references, leading to a persistent cognitive bias between their subjective scale perception and the actual physical scale. This results in low accuracy of the reconstructed BIM in terms of scale dimension, requiring further adjustments and verifications, thus wasting the time and computational resources needed to generate the building modeling information. Furthermore, there is a lack of effective means to instantly and intuitively verify the scale of the BIM in real-world space. Users cannot use their bodily senses to verify and correct scale deviations in real time during the modeling process, causing scale errors to be discovered only in the later stages of modeling. This makes correction of the created BIM difficult and computationally expensive. Based on this, some embodiments of the mobile augmented reality-based building modeling information generation method of this disclosure first, in response to detecting a selection operation of a first model generation button on a mobile augmented reality device, acquires the BIM of the selected target building. Thus, a BIM corresponding to the aforementioned target building can be obtained. Then, in response to the detection of a scanning operation by the mobile augmented reality device on the set of identification markers within the selected target test area, the building model projection information corresponding to the aforementioned building information digital model is obtained. Thus, the building model projection information corresponding to the aforementioned building information digital model and the aforementioned target test area can be obtained. Next, the aforementioned building model projection information is displayed. Thus, the building model projection information displayed on the aforementioned mobile augmented reality device can be obtained. Next, in response to the absence of a user confirmation operation on the aforementioned building information digital model, the following update steps are performed based on the building information digital model: in response to the detection of a user dragging operation on the aforementioned mobile augmented reality device, the building information digital model is modified according to the dragging operation information to obtain an updated building information digital model; in response to the detection of a user touch operation on the aforementioned mobile augmented reality device, the building information digital model is modified according to predefined step size information and the aforementioned touch operation information to obtain an updated building information digital model. Thus, the updated building information digital model can be obtained. Finally, in response to the detection of a user confirmation operation on the updated building information digital model, the updated building information digital model is determined as building modeling information.Thus, architectural modeling information can be obtained. Because the aforementioned digital building information model is not reconstructed in desktop modeling, but rather through a mobile augmented reality device, displaying the architectural model projection information on this device enhances the user's perception of scale and their understanding of the actual physical scale. This allows for real-time verification and correction of scale deviations during the modeling process through bodily awareness, thereby reducing scale errors and the costs of later corrections. Consequently, the accuracy of the reconstructed digital building information model in the scale dimension can be improved, reducing the time and computational resources required to generate architectural modeling information, and decreasing the difficulty and computational resources required for later modeling corrections.

[0077] Further reference Figure 2 As an implementation of the methods shown in the above figures, this disclosure provides some embodiments of a method for generating building modeling information based on mobile augmented reality. These device embodiments are similar to... Figure 1 Corresponding to the method embodiments shown, the device can be specifically applied to various electronic devices.

[0078] like Figure 2 As shown, a mobile augmented reality-based building modeling information generation device 200 in some embodiments includes: a first acquisition unit 201, a second acquisition unit 202, a display unit 203, an execution unit 204, and a determination unit 205. The first acquisition unit 201 is configured to acquire a digital model of the selected target building's building information in response to detecting a selection operation of a first model generation button on the mobile augmented reality device; the second acquisition unit 202 is configured to acquire building model projection information corresponding to the digital building information model in response to detecting a scanning operation of the mobile augmented reality device on a set of identification marker information within the selected target test area; the display unit 203 is configured to display the building model projection information; and the execution unit 204 is configured to perform the following operations based on the digital building information model in response to a confirmation operation of the digital building information model: Update steps: In response to detecting drag operation information of the user on the mobile augmented reality device, the building information digital model is modified according to the drag operation information to obtain an updated building information digital model; In response to detecting touch operation information of the user on the mobile augmented reality device, the building information digital model is modified according to predefined step size information and the touch operation information to obtain an updated building information digital model; The determining unit 205 is configured to determine the updated building information digital model as building modeling information in response to detecting a user's confirmation operation on the updated building information digital model.

[0079] It is understandable that the units and references recorded in the mobile augmented reality-based building modeling information generation device 200 are... Figure 1 The steps in the described method correspond to each other. Therefore, the operations, features, and beneficial effects described above for the method also apply to the dome camera position information generation device 200 and the units contained therein, and will not be repeated here.

[0080] The following is for reference. Figure 3 It shows a schematic diagram of the structure of an electronic device (such as a computing device) 300 suitable for implementing some embodiments of the present disclosure. Figure 3 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments of this disclosure.

[0081] like Figure 3 As shown, the electronic device 300 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 301, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 302 or a program loaded from a storage device 308 into a random access memory (RAM) 303. The RAM 303 also stores various programs and data required for the operation of the electronic device 300. The processing unit 301, ROM 302, and RAM 303 are interconnected via a bus 304. An input / output (I / O) interface 305 is also connected to the bus 304.

[0082] Typically, the following devices can be connected to I / O interface 305: input devices 306 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 307 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 308 including, for example, magnetic tapes, hard disks, etc.; and communication devices 309. Communication device 309 allows electronic device 300 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 3 An electronic device 300 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively. Figure 3 Each box shown can represent a device or multiple devices as needed.

[0083] In particular, according to some embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, some embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 309, or installed from storage device 308, or installed from ROM 302. When the computer program is executed by processing device 301, it performs the functions defined in the methods of some embodiments of this disclosure.

[0084] It should be noted that, in some embodiments of this disclosure, the computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In some embodiments of this disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In some embodiments of this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0085] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0086] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device. The aforementioned computer-readable medium carries one or more programs. When the electronic device executes the aforementioned one or more programs, the electronic device causes the following actions: In response to detecting a selection operation on a first model generation button of a mobile augmented reality device, it acquires a digital model of the selected target building's architectural information; In response to detecting a scanning operation of the mobile augmented reality device on a set of identification marker information within the selected target test area, it acquires architectural model projection information corresponding to the aforementioned digital model of architectural information; It displays the aforementioned architectural model projection information; In response to not detecting a user's confirmation operation on the aforementioned digital model of architectural information, it performs the following update steps based on the digital model of architectural information: In response to detecting a user's drag operation on the mobile augmented reality device, it modifies the aforementioned digital model of architectural information based on the drag operation information to obtain an updated digital model of architectural information; In response to detecting a user's touch operation on the mobile augmented reality device, it modifies the aforementioned digital model of architectural information based on predefined step size information and the aforementioned touch operation information to obtain an updated digital model of architectural information; In response to detecting a user's confirmation operation on the updated digital model of architectural information, it identifies the updated digital model of architectural information as architectural modeling information.

[0087] Computer program code for performing operations of some embodiments of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0088] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0089] The units described in some embodiments of this disclosure can be implemented in software or hardware. The described units can also be housed in a processor; for example, a processor may be described as including a first acquisition unit, a second acquisition unit, a display unit, an execution unit, and a determination unit. The names of these units do not necessarily limit the specific unit itself; for example, the first acquisition unit may also be described as "acquiring a digital model of the building information of the selected target building in response to detecting a selection operation on a first model generation button of a mobile augmented reality device."

[0090] The functions described above in this document can be performed at least in part by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.

[0091] The above description is merely a selection of preferred embodiments of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of the invention involved in the embodiments of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described inventive concept. For example, technical solutions formed by substituting the above-described features with (but not limited to) technical features with similar functions disclosed in the embodiments of this disclosure.

Claims

1. A method for generating architectural modeling information based on mobile augmented reality, comprising: in response to detecting a selection operation of a first model generation button of a mobile augmented reality device, obtaining an architectural information digital model of a target building selected; in response to detecting a scanning operation of the mobile augmented reality device on a set of identification marker information in a target test area selected, obtaining architectural model projection information corresponding to the architectural information digital model, wherein the obtaining of the architectural model projection information corresponding to the architectural information digital model in response to the detecting of the scanning operation of the mobile augmented reality device on the set of identification marker information in the target test area selected comprises: in response to detecting a scanning operation on identification marker information in the set of identification marker information, determining index information of the identification marker information; based on the index information, obtaining spatial coordinate information of the architectural information digital model; based on the spatial coordinate information, performing fusion processing on the architectural information digital model and the target test area to obtain the architectural model projection information corresponding to the architectural information digital model, wherein the target test area is a site preselected to meet a preset selection condition; performing display processing on the architectural model projection information; in response to not detecting a confirmation operation of a user on the architectural information digital model, performing the following updating steps based on the architectural information digital model: in response to detecting a drag operation information of the user on the mobile augmented reality device, performing change processing on the architectural information digital model based on the drag operation information to obtain an updated architectural information digital model; in response to detecting a touch operation information of the user on the mobile augmented reality device, performing change processing on the architectural information digital model based on predefined step information and the touch operation information to obtain an updated architectural information digital model; in response to detecting a confirmation operation of the user on the updated architectural information digital model, determining the updated architectural information digital model as the architectural modeling information.

2. The method of claim 1, wherein, The method further comprises: in response to not detecting a confirmation operation of the user on the updated architectural information digital model, performing the updating steps again with the updated architectural information digital model as the architectural information digital model.

3. The method of claim 1, wherein, The architectural information digital model comprises various preset architectural component information.

4. The method of claim 1, wherein, The display processing on the architectural model projection information comprises: determining view information in the mobile augmented reality device based on the architectural model projection information and device movement information, and performing display processing on the view information.

5. The method of claim 1, wherein, The method further comprises: in response to detecting a selection operation of a second model generation button of the mobile augmented reality device, obtaining an interactive architectural model corresponding to a target experimental building; based on the interactive architectural model and a target test area, obtaining interactive model projection information corresponding to the interactive architectural model; performing display processing on the interactive model projection information; in response to not detecting a confirmation operation of the user on the mobile augmented reality device, performing the following change steps based on the interactive architectural model: In response to detecting a touch operation of the user on the mobile augmented reality device, determine a changed interactive building model; Render the changed interactive building model to obtain fusion view information for display processing of the changed interactive building model; In response to detecting a confirmation operation of the user on the mobile augmented reality device, determine the changed interactive building model as the building modeling information.

6. The method of claim 5, wherein, The changing step further comprises: In response to detecting voice instruction information of the user, adjust the interactive building model to obtain display state information of the interactive building model in the mobile augmented reality device.

7. An apparatus for generating building modeling information based on mobile augmented reality, comprising: A first obtaining unit configured to, in response to detecting a selection operation of a first model generation button on a mobile augmented reality device, obtain a building information digital model of a selected target building; A second obtaining unit configured to, in response to detecting a scanning operation of the mobile augmented reality device on a set of identification marker information in a selected target test area, obtain building model projection information corresponding to the building information digital model, wherein the second obtaining unit is configured to, in response to detecting a scanning operation on identification marker information in the set of identification marker information, determine index information of the identification marker information; based on the index information, obtain spatial coordinate information of the building information digital model; and according to the spatial coordinate information, perform fusion processing on the building information digital model and the target test area to obtain the building model projection information corresponding to the building information digital model, wherein the target test area is a preselected site that meets a pre-set selection condition; A display unit configured to perform display processing on the building model projection information; An execution unit configured to, in response to not detecting a confirmation operation of the user on the building information digital model, perform the following updating steps according to the building information digital model: in response to detecting a drag operation information of the user on the mobile augmented reality device, perform changing processing on the building information digital model according to the drag operation information to obtain an updated building information digital model; and in response to detecting a touch operation information of the user on the mobile augmented reality device, perform changing processing on the building information digital model according to pre-defined step information and the touch operation information to obtain an updated building information digital model; A determination unit configured to, in response to detecting a confirmation operation of the user on the updated building information digital model, determine the updated building information digital model as the building modeling information.

8. An electronic device, comprising: one or more processors; storage having one or more programs stored thereon; When the one or more programs are executed by the one or more processors, the one or more processors implement a method as claimed in any of claims 1 to 6.

9. A computer readable medium having stored thereon a computer program, wherein, The computer program, which when executed by a processor, implements a method as claimed in any of claims 1 to 6.

Images