A model construction method and device, a storage medium, and an electronic device

Abstract

The present disclosure relates to a model construction method and device, a storage medium and an electronic device, and relates to the technical field of computers. The method comprises: obtaining basic geographic information data from a target data source and performing stereoscopic processing to obtain an initial model; preprocessing the initial model to obtain a first-stage model; performing non-business logic binding on the first-stage model, and performing business logic binding on the first-stage model to generate a target model corresponding to a modeling object; and performing streaming media binding on the target model to push streaming media data corresponding to the target model to a corresponding preset terminal. The present scheme can effectively improve the performance of the model and reduce the modeling cost, and realize data simulation based on digital twinning.

Description

TECHNICAL FIELD

[0001] Embodiments of the present disclosure relate to the technical field of computer, in particular to a model construction method, a model construction device, a storage medium, and an electronic device. BACKGROUND

[0002] The existing modeling methods include modeling based on real images and modeling based on art drawings. The modeling based on real images is a restoration modeling method mainly based on aerial photography and oblique photography. This modeling method can restore the instantaneous scene state and has high quality, but it is limited to the fact that the model itself is composed of pictures. Therefore, in the process of secondary development based on the model or use in various business scenarios, the model itself is not friendly to changes in lighting, material, and additional artistic effects. The modeling method based on art drawings requires modelers to refer to CAD or Revit drawings to manually model in various modeling tools. The model produced by this modeling method can perfectly compatible with secondary development and the corresponding rendering engine, but the modeling period is relatively long due to manual modeling. In addition, due to the uneven technical level and artistic attainments of different modelers, a large amount of time is required for model optimization and improvement. In addition, the above modeling methods have high costs. Moreover, in order to apply the model to a digital twin system, higher performance requirements are put forward for the model.

[0003] It should be noted that the information disclosed in the above background section is only used to strengthen the understanding of the background of the present disclosure, and therefore can include information that does not constitute prior art known to those of ordinary skill in the art. SUMMARY

[0004] According to one aspect of the present disclosure, a model construction method is provided, which comprises:

[0005] acquiring basic geographic information data from a target data source and performing stereoscopic processing to obtain an initial model; and preprocessing the initial model to obtain a first-stage model;

[0006] performing non-business logic binding on the first-stage model, and performing business logic binding on the first-stage model to generate a target model corresponding to the modeling object;

[0007] performing stream media binding on the target model to push stream media data corresponding to the target model to a corresponding preset terminal.

[0008] In an exemplary embodiment of the present disclosure, the acquiring basic geographic information data from a target data source and performing stereoscopic processing to obtain an initial model comprises:

[0009] Obtain basic geographic information data from the target data source, and filter the basic geographic information data according to preset rules to obtain hierarchical data;

[0010] A set of modeling rules is applied to the hierarchical data to obtain the initial model.

[0011] In one exemplary embodiment of this disclosure, the non-business logic includes model light-emitting logic;

[0012] The non-business logic binding of the first-stage model includes:

[0013] In the first stage of the model, the object to be processed is determined based on the model's texture and material;

[0014] Calculate the diffuse reflection illumination coefficient, specular reflection illumination coefficient, and distance field parameters for the object to be processed;

[0015] The corresponding illumination mixing coefficient is determined based on the diffuse reflection illumination coefficient, the specular reflection illumination coefficient, and the distance field parameters.

[0016] The illumination mixing coefficient is configured as the basic luminescence parameter of the object to be processed, and the corresponding actual luminescence coefficient is configured according to the position of the object to be processed according to the basic luminescence parameter and a preset ratio.

[0017] In one exemplary embodiment of this disclosure, calculating the diffuse illumination coefficient corresponding to the object to be processed includes:

[0018] By combining the ambient light intensity and the material's reflectance to ambient light, the first light intensity parameter of the interactive reflection between the diffuse reflector and the ambient light is determined.

[0019] The intensity of the point light source, the material's reflectivity to ambient light, and the angle between the incident light direction and the vertex normal are used to determine the second light intensity parameter of the interactive reflection between the diffuse reflector and the directional light.

[0020] The diffuse reflection illumination coefficient is determined based on the first light intensity parameter and the second light intensity parameter.

[0021] In one exemplary embodiment of this disclosure, calculating the specular reflection illumination coefficient corresponding to the object to be processed includes:

[0022] The initial specular coefficient is determined by combining the specular reflection coefficient, point light source intensity, specular index, and first ray direction parameters.

[0023] The initial specular coefficient is corrected using the second ray direction parameter to obtain the specular reflection illumination coefficient.

[0024] In an example embodiment of the present disclosure, the determining the corresponding light mixing coefficient according to the diffuse reflection light coefficient, the specular reflection light coefficient, and the distance field parameter comprises:

[0025] Based on the included angle corresponding to any two sample points in the to-be-processed object, a mixing angle parameter corresponding to the to-be-processed object is calculated;

[0026] The mixing angle parameter is used to determine the corresponding light mixing coefficient in combination with the diffuse reflection light coefficient, the specular reflection light coefficient, and the distance field parameter.

[0027] In an example embodiment of the present disclosure, the method further comprises:

[0028] The normal vector included angle between the world coordinates and the screen coordinates corresponding to the to-be-processed coordinate point in the target model is configured as a first standard angle;

[0029] The approximate three-dimensional coordinates of the to-be-processed coordinate point in the screen coordinate system are configured according to the first standard angle;

[0030] The approximate three-dimensional coordinates are subjected to coordinate vector splitting, and a target interest point is selected for dynamic binding with the to-be-processed coordinate point according to the coordinate vector splitting result.

[0031] In an example embodiment of the present disclosure, the method further comprises:

[0032] In response to a display control operation on the target model, a current field of view range of a virtual camera is acquired in real time;

[0033] The interest point followed by the current focus is subjected to concurrent control of binding in the x time axis, the y time axis, and the z time axis, so as to maintain the display position of the target interest point.

[0034] In an example embodiment of the present disclosure, the method further comprises:

[0035] A dimension time axis is switched by using an angle controller.

[0036] In an example embodiment of the present disclosure, the method further comprises:

[0037] The interest point sets are divided according to the types corresponding to the interest points in the target model;

[0038] Each of the interest point sets is configured as a sub-level of the main scene of the target model, so as to be loaded through level streaming according to the display control on the target model.

[0039] In an example embodiment of the present disclosure, the method further comprises:

[0040] obtain a spline line configuration parameter through a preset parameter interface, and perform animation path planning according to the spline line configuration parameter; and

[0041] bind a skeleton array of a virtual object to the spline line, so as to move the virtual object according to the planned path.

[0042] In an exemplary embodiment of the present disclosure, the method further comprises:

[0043] In response to a display control operation on the target model, a device type of an input device is identified;

[0044] When the input device is determined to be a first type device, a normal vector parameter of a direction between an axis of a virtual camera at present and a relative offset parameter of the input device is determined; or,

[0045] When the input device is determined to be a second type device, a speed-up / speed-down parameter corresponding to the display control operation is determined; and an offset parameter is determined in combination with an execution time length of the speed-up / speed-down parameter and a preset step length;

[0046] The display effect of the target model is corrected according to the offset parameter.

[0047] In an exemplary embodiment of the present disclosure, the method further comprises:

[0048] A service request of a terminal device is received through a signaling server; wherein the service request comprises identification information of a target point of interest, task information and a terminal device identification;

[0049] The service request is processed to obtain stream media data corresponding to the target point of interest, and the stream media data corresponding to the target point of interest is pushed to the terminal device through the signaling server.

[0050] According to an aspect of the present disclosure, a model construction device is provided, comprising:

[0051] A first-stage model calculation module is configured to obtain basic geographic information data from a target data source and perform stereoscopic processing to obtain an initial model; and to preprocess the initial model to obtain a first-stage model;

[0052] A target model calculation module is configured to perform non-business logic binding on the first-stage model, and perform business logic binding on the first-stage model to generate a target model corresponding to a modeling object;

[0053] A stream media data processing module is configured to perform stream media binding on the target model to push stream media data corresponding to the target model to a corresponding preset terminal.

[0054] According to an aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the model construction method of any one of the preceding aspects.

[0055] According to an aspect of the present disclosure, there is provided an electronic device comprising:

[0056] a processor; and

[0057] a memory for storing executable instructions of the processor;

[0058] wherein the processor is configured to implement the model construction method of any one of the preceding aspects via execution of the executable instructions.

[0059] It should be understood that the general description above and the following detailed description are only exemplary and explanatory, and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0060] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and serve to explain the principles of the present disclosure. It is readily apparent to one of ordinary skill in the art that the accompanying drawings only demonstrate some embodiments of the present disclosure, and other drawings can be obtained by one of ordinary skill in the art without any creative effort, based on the accompanying drawings. In the drawings:

[0061] Figure 1 a schematic diagram illustrating a model construction method according to an example embodiment of the present disclosure;

[0062] Figure 2 a schematic diagram illustrating a method of constructing an initial model according to an example embodiment of the present disclosure;

[0063] Figure 3 a schematic diagram illustrating a method of executing a modeling rule sequence according to an example embodiment of the present disclosure;

[0064] Figure 4 a schematic diagram illustrating a standard convex polygon according to an example embodiment of the present disclosure;

[0065] Figure 5 a schematic diagram illustrating a base convex polygon with an elevation according to an example embodiment of the present disclosure;

[0066] Figure 6 a schematic diagram illustrating a convex polygon after cutting according to an example embodiment of the present disclosure;

[0067] Figure 7 a schematic diagram illustrating a model iteration result according to an example embodiment of the present disclosure;

[0068] Figure 8 A schematic diagram illustrating a method for lighting logic binding of a model in an exemplary embodiment of the present disclosure is shown;

[0069] Figure 9 A schematic diagram illustrating a method for calculating a mixed lighting coefficient in an exemplary embodiment of the present disclosure is shown;

[0070] Figure 10 A schematic diagram illustrating a method for animation path planning using Spline in an exemplary embodiment of the present disclosure is shown;

[0071] Figure 11 A schematic diagram illustrating a Spline key point planning effect in an exemplary embodiment of the present disclosure is shown;

[0072] Figure 12 A schematic diagram illustrating a method for dynamic compensation of a point of interest coordinate in an exemplary embodiment of the present disclosure is shown;

[0073] Figure 13 A schematic diagram illustrating a point of interest display control method in an exemplary embodiment of the present disclosure is shown;

[0074] Figure 14 A schematic diagram illustrating a point of interest keeping screen outward orthogonal projection effect in an exemplary embodiment of the present disclosure is shown;

[0075] Figure 15 A schematic diagram illustrating a point of interest display effect in an exemplary embodiment of the present disclosure is shown;

[0076] Figure 16 A schematic diagram illustrating a point of interest display effect in an exemplary embodiment of the present disclosure is shown;

[0077] Figure 17 A schematic diagram illustrating a method for display control of a model in an exemplary embodiment of the present disclosure is shown;

[0078] Figure 18 A schematic diagram illustrating a display effect of a translation zoom-out in an exemplary embodiment of the present disclosure is shown;

[0079] Figure 19 A schematic diagram illustrating a display effect of a rotation in an exemplary embodiment of the present disclosure is shown;

[0080] Figure 20 A schematic diagram illustrating a display effect of a scaling in an exemplary embodiment of the present disclosure is shown;

[0081] Figure 21A schematic diagram of a service request processing method in an exemplary embodiment of the present disclosure is shown;

[0082] Figure 22 A schematic diagram of a system architecture in an exemplary embodiment of the present disclosure is shown;

[0083] Figure 23 A schematic diagram of a model construction device in an exemplary embodiment of the present disclosure is shown;

[0084] Figure 24 A schematic diagram of an electronic device for implementing the above-mentioned model construction method in an exemplary embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0085] Example implementations will now be described more fully with reference to the accompanying drawings. Example implementations can be implemented in any

[0086] In addition, the accompanying drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the present disclosure and serve to explain the principles of the present disclosure. The same reference numbers in different drawings represent the same or similar elements.

[0087] To overcome the disadvantages and deficiencies of the prior art, a model construction method is provided in the example implementation, which can be applied to model construction in application scenarios such as smart parks and smart cities.

[0088] Reference Figure 1 The model construction method described above can include:

[0089] In step S11, the target data source acquires basic geographic information data and performs stereoscopic processing to obtain an initial model; and the initial model is preprocessed to obtain a first-stage model;

[0090] In step S12, the first-stage model is subjected to non-business logic binding, and the first-stage model is subjected to business logic binding to generate a target model corresponding to the modeling object;

[0091] In step S13, the target model is subjected to streaming media binding, so as to push the streaming media data corresponding to the target model to a corresponding preset terminal.

[0092] The model construction method provided by the example embodiment can obtain a first-stage model through stereoscopic processing and material mapping of the basic geographic information data obtained from the target data source, and can bind the first-stage model with non-business logic and business logic, so that the obtained target model has higher model performance and can reduce modeling cost. Through streaming media binding of the target model, the streaming media data of the model can be pushed to a preset terminal device, so that a user can view real-time model changes on different terminal devices, and data simulation based on digital twinning is realized.

[0093] Next, each step of the model construction method in the example embodiment will be described in more detail in combination with the accompanying drawings and examples.

[0094] In step S11, the basic geographic information data is obtained from a target data source and subjected to stereoscopic processing to obtain an initial model, and the initial model is preprocessed to obtain a first-stage model.

[0095] In the example embodiment, a production layer can be provided on the server side to perform step S11 described above. For example, the target data source described above can be an open source official data platform such as Open Street Map (public map), Tian Di Tu (Tiandi map, i.e., national geographic information public service platform), etc. Specifically, when obtaining basic geographic data, a GIS (Geographic Information System) engine can be used to pull data from the open source official data platform described above to obtain basic geographic information. For example, the GIS engine can use a Cesium open source map engine. In addition, the obtained basic geographic information data can also be electronic drawing data in various formats. The obtained basic geographic information data can include the longitude and latitude, layer height, terrain Dem, FloorHeight (floor height), POI (Point of Interest) location information, etc. of buildings and real environment and virtual environment, etc. In addition, the data of the virtual environment described above can also be obtained from the electronic drawing data; for example, it can be data of some planned and unconstructed buildings or environment.

[0096] According to the obtained basic geographic information data, data stereoscopic processing can be performed by using a CE platform, a Blender platform, a Twin Motion platform, and other three-dimensional graphics image software to form an L1 white film, i.e., an initial model.

[0097] Specifically, the preprocessing described above can be a material mapping process for the model. After obtaining the initial model, material mapping can be added to the initial model, such as adding stair material, light effects, and the like, to obtain an L2 level model, generate a model body file in FBX / obj / 3ds format, and thus obtain a first stage model. In addition, the developer can also update and repair the model data of the L2 level model, replace the old data with the new data obtained, and identify and delete redundant data in the model.

[0098] In the example embodiment, referring to the flowchart shown in FIG. 1, the step S11 described above can include: Figure 2

[0099] Step S21, obtaining basic geographic information data from a target data source, and filtering the basic geographic information data according to a preset rule to obtain hierarchical data;

[0100] Step S22, executing a set of modeling rules on the hierarchical data to obtain the initial model.

[0101] Specifically, after obtaining the basic geographic information data from the target data source, the basic data corresponding to different regions can be filtered from the basic data according to a preset weight ratio; for example, the core region, the transition region, and the edge region can be configured to use different proportions of basic data; or different proportions of basic data can be selected according to buildings and surrounding environment; and used as hierarchical data, so that basic data of a preset density and level can be selected from the basic geographic information data for modeling, reducing useless data. After obtaining the hierarchical data, a set of preset modeling rules can be executed for modeling.

[0102] In the example embodiment, the set of modeling rules includes Lot rules, Floor rules, Side Facade rules and Groundfloor rules, Front rules and Front Facade rules, Building rules, Window, Door, and Wall rules, and texture processing rules executed in a preset order.

[0103] Referring to the flowchart shown in FIG. 1, after filtering to obtain the hierarchical data, the Lot rules can be executed first; then the Floor rules are executed; then the Side Facade rules and the Groundfloor rules, and the Front rules and the Front Facade rules can be executed synchronously; then the Building rules can be executed; then the Window, Door, and Wall rules can be executed. Figure 3

[0104] ​​The Lot rule can be a rule for indicating an actual building construction starting point, i.e., indicating a first rule set in a window. The Floor rule can be used to perform a typical splitting operation so that each tile width after splitting approaches a preset value. In addition, in order to make the floor more consistent with the display, the application scenario of digital twinning can also be segmented into a wall element with a width of a preset value. The Side Facade rule can be used to split several sides of the building into multiple floors. The code of the splitting process is the same as that of the front, so that the height of each floor of the front and side can be kept completely consistent. The Groundfloor rule can be a splitting operation for the first floor, and there can be a door entrance on the right side. The Front rule can be used to define the front of the building. The Front Facade rule can be used to split the front facade of the building into a first floor with a height of 4, and then split the remaining part above into multiple floors with a height of 3.5. In addition, the appearance of the first floor and the above floors can be different, such as the front door, different height, door and window, color, and other configurations. The Building rule can be used to split into multiple faces by component segmentation. For example, the shape named Building is split according to 3 different parts. The first part is front (i.e., the front of the building), the second part is side (i.e., multiple sides of the building), and the third part is Root (i.e., the roof part). The Window, Door, and Wall rules can be used to replace the shape objects of windows, doors, and walls with corresponding model resources and assign them with textures. In addition, the modeling rule set can also include a Tile rule for configuring tiles and elements of the tiles. For example, the tiles can be segmented by nesting in a tile, and the segmentation can be performed along the x-axis and y-axis directions.

[0105] Specifically, the above modeling rule set can be implemented in the form of a rule file. During modeling, the rule file is called to a preset storage address, and the corresponding specific rules are executed in the preset order. Through a reasonable layout rule execution order, the modeling cycle can be effectively shortened. Through the above modeling method, L1-L2 level modeling of a 50 square kilometer area can be completed within 10-30 minutes, effectively shortening the initial modeling cycle by more than 80%. In addition, the rule modeling rule set is easy to iterate and maintain, and engineers can refine and adjust the rule content at any time according to business needs to complete the model level upgrade. From a theoretical point of view, the highest L5 level modeling capability can be achieved.

[0106] For example, for the above Lot rule, a standard convex polyhedron is formed based on the formula Zf(x)*Center(x,y,z) as a standard convex polygon to be cut, such as Figure 4Zf(x) represents the outer bounding box point set, and Center(x, y, z) represents the target shape center point. Since Zf(x) exists, Center(x, y, z) can be used as a unit height vector for preliminary stretching or stacking; a base convex polygon with an elevation is formed, as shown in Figure 5 For the stairs in the model, the outer bounding box must be a convex polygon (even a rectangular body can be understood); therefore, excluding the invisible bottom surface and the top surface that needs special processing, the convex polygon is cut using the other four rules, and the cutting result is as shown in Figure 6 When listing the convex polygon, the following formula is generally used for preliminary angle fitting calculation: sin*sqrt(X2+Y2); where X and Y are the coordinate values of the point on the x-axis and y-axis, respectively, used to calculate the directional deviation angle of the z-axis. Of course, other mathematical methods can also be selected according to the target graph, such as equal ratio scaling listing. Specifically, different mathematical algorithms can be selected according to the regular relationship of the target result value. After completing the base convex polygon listing, the model body itself can be subjected to the Radom function down rounding method to deal with the window, fall, and door functions in the CE platform for middle part excavation, and interpolation formula is used for recursion; the obtained iterative model is as shown in Figure 7 The recursive formula can include:

[0107] yi = interp1(x, Y, xi), used to calculate the X-axis interpolation, from x to xi with Y size for interpolation;

[0108] yi = interp1(Y, xi), used to calculate the Y-axis interpolation, from Y to xi with automatic interpolation in the form of arithmetic progression;

[0109] yi = interp1(x, Y, xi, method), used to calculate the X-axis interpolation, from x to xi with Y size for interpolation in the method already interpolated area;

[0110] yi = interp1(x, Y, xi, method, 'extrap'), used to indicate that the interpolation result of the previous formula retains the index 'extrap';

[0111] yi = interp1(x, Y, xi, method, extrapval), used to indicate that the interpolation result of the previous formula retains the index extrapval;

[0112] pp = interp1(x, Y, method, 'pp'), used to indicate that the interpolation result of the previous formula retains the index 'pp'.

[0113] In addition, the fixed value method, interpolation method, nearest neighbor interpolation, regression method and the like can be used for the difference operation of the various stairs.

[0114] After the model is established, a texture map can be applied to obtain an initial model. For example, a path of the texture map can be specified, and the texture map can be applied in the CE platform.

[0115] In step S12, the first-stage model is subjected to non-business logic binding, and the first-stage model is subjected to business logic binding to generate a target model corresponding to the modeling object.

[0116] In the example embodiment, a processing layer can be provided on the server side to receive the first-stage model output by the production layer and process the first-stage model. Specifically, the first-stage model generated by the generation layer can be multiple; for example, a corresponding first-stage model can be constructed for each building in the smart park. The model body file of each first-stage model generated by the production layer can be pushed to the processing layer respectively. The processing layer can combine each first-stage model using a virtual engine to complete the creation of a three-dimensional scene.

[0117] At the same time, the first-stage model can also be subjected to business logic and non-business logic binding. For example, non-business logic can include lighting effects in a three-dimensional scene, display effects of day and night alternation, weather systems, and the like. Business logic can include data pushing business logic of monitoring cameras, point of interest control business logic, model viewing business logic, and the like.

[0118] In step S13, the target model is subjected to streaming media binding for pushing streaming media data corresponding to the target model to a corresponding preset terminal.

[0119] In the example embodiment, for the target model, after encapsulation, the target model can be bound to a plurality of terminal devices so that different terminal devices can receive streaming media data corresponding to the target model. Specifically, the addresses of different terminal devices can be bound in advance on the server side, and the content of the streaming media can be configured. The terminal devices can be smart terminal devices of staff, IOC data dashboards, and the like, to realize model and data visualization and interaction on the terminal devices.

[0120] In the example embodiment, the non-business logic includes model light emitting logic; referring to Figure 8 The non-business logic binding of the first-stage model includes:

[0121] In step S31, a to-be-processed object is determined according to the texture and material of the model in the first-stage model.

[0122] Step S32, calculating corresponding diffuse reflection light coefficient, specular reflection light coefficient and distance field parameter for the object to be processed;

[0123] Step S33, determining corresponding light mixing coefficient according to the diffuse reflection light coefficient, specular reflection light coefficient and distance field parameter;

[0124] Step S34, configuring the light mixing coefficient as the basic light emitting parameter of the object to be processed, and configuring corresponding actual light emitting coefficient according to the position corresponding to the object to be processed according to a preset proportion based on the basic light emitting parameter.

[0125] Specifically, in the existing scheme, for the model night scene, the mainstream low-light rendering technology is used, a large number of array negative axial point light sources are laid in the whole scene, light source scattering is performed on the outer facade, and the power equipment state of the stairs is simulated. The advantage of this is that all light source effects of all stairs, models and rooms can be customized; the disadvantage is that when the point array negative axial point light source is laid too much, due to the bottleneck of GPU performance, it will cause frame drop and lag of the whole scene, which is particularly obvious in the case of cloud deployment. In another scheme, a post-processing box is used to set the minimum light source coefficient in the range (usually this coefficient is 0.1-0.5). The advantage of this is that it can radiate the whole range scene, and the disadvantage is that it will reduce the rendering effect of the point light source in the scene. Due to the constant exposure coefficient, multiple post-processing boxes need to be used for superposition for local detail processing of the model. In the process of level flow, the control coefficient linkage will cause memory waste and great performance overhead. Using separate materials for processing, for each grid body that needs to be processed, two sets of texture materials and texture maps are prepared, and dynamic loading and unloading are performed according to the corresponding light threshold. The advantage of this is that all materials can be specially customized, and the disadvantage is that once the corresponding materials and textures need to be replaced frequently during iteration and repair, the model will be heavy (the number of all texture maps and materials is doubled).

[0126] In the example embodiment, specifically, the corresponding non-business logic can be added to the first-stage models respectively; or the non-business logic can be added to the three-dimensional scene model after the first-stage models are combined.

[0127] Specifically, taking the addition of non-business logic to the three-dimensional scene model as an example, the sub-models in the three-dimensional scene model can be classified, and the same non-business logic can be bound for sub-models of the same type. For example, for each type of sub-model of building facade, signboard, staircase, etc., the same non-business logic can be used. As described in the method of steps S31-S34 above, the same light emission coefficient can be used for sub-models of the same type. For example, the UE5 engine can be used to bind a light-emitting material to the model, and the light-emission effect under night scene conditions can be configured for the model by calling an interface to meet the night scene rendering mode.

[0128] Specifically, a sub-model of the same type can be selected as a processing object according to the texture and material of the model, and the calculation of the diffuse reflection light coefficient, the specular reflection light coefficient, and the distance field parameter of the sub-model can be performed.

[0129] In the example embodiment, the diffuse reflection light coefficient corresponding to the processing object can be calculated, which can specifically include: determining a first light intensity parameter of the diffuse reflection body interacting with the ambient light in combination with the ambient light intensity and the reflection coefficient of the material to the ambient light; determining a second light intensity parameter of the diffuse reflection body interacting with the directional light in combination with the point light source intensity, the reflection coefficient of the material to the ambient light, and the included angle between the incident light direction and the vertex normal; and determining the diffuse reflection light coefficient according to the first light intensity parameter and the second light intensity parameter.

[0130] Specifically, the diffuse reflection model can use the Lambert model, and the formula can include:

[0131] Iambdiff=Kd*Ia

[0132] wherein Ia represents the ambient light intensity; Kd represents the diffuse reflection coefficient of the material to the ambient light, and 0 < Kd < 1; and Iambdiff represents the light intensity of the diffuse reflection body interacting with the ambient light.

[0133] The formula of the directional light can include: Ildiff=Kd*Il*Cos(θ)

[0134] wherein Il represents the point light source intensity; θ represents the included angle between the incident light direction and the vertex normal, referred to as the incident angle, and 0 ≤ θ ≤ 90°; and Ildiff represents the light intensity of the diffuse reflection body interacting with the directional light.

[0135] If N is the vertex unit normal vector, and L represents the unit vector from the vertex to the light source (note that the vertex points to the light source), then Cos(θ) is equivalent to dot(N, L).

[0136] Based on this, we have: Ildiff=Kd*Il*dot(N,L)

[0137] The Lambert lighting model can include:

[0138] Idiff = Iambdiff + Ildiff = Kd * Ia + Kd * Il * dot(N, L)

[0139] In the example embodiment, the specular reflection lighting coefficient corresponding to the object to be processed can be calculated, which can specifically include: determining an initial specular coefficient in combination with the specular reflection coefficient, the point light source intensity, the highlight index, and the first light direction parameter; and correcting the initial specular coefficient by using the second light direction parameter to obtain the specular reflection lighting coefficient.

[0140] Specifically, the specular reflection model can use the Phong model. The Phong model considers that the light intensity of the specular reflection is related to the angle between the reflected light and the view line, and the formula can include:

[0141] Ispec = Ks * Il * (dot(V, R))^Ns

[0142] wherein Ks represents the specular reflection coefficient; Ns represents the highlight index; V represents the observation direction from the vertex to the view point; and R represents the reflected light direction.

[0143] Since the direction R of the reflected light can be obtained by the incident light direction L (pointing from the vertex to the light source) and the normal vector of the object, then R + L = 2 * dot(N, L) * N; that is, R = 2 * dot(N, L) * N - L. Based on the above formula, it can be obtained that:

[0144] Ispec = Ks * Il * (dot(V, (2 * dot(N, L) * N - L))^Ns

[0145] The corrected specular light can use the Blinn-Phong lighting model. The Blinn-Phong is a model based on the correction of the Phong model, and the formula can include:

[0146] Ispec = Ks * Il * (dot(N, H))^Ns

[0147] wherein N represents the unit normal vector of the incident point; and H represents the intermediate vector of the light incident direction L and the view direction V, which is also commonly referred to as the half-angle vector. The formula of the half-angle vector can include: H = (L + V) / |L + V|.

[0148] In this example implementation, determining the corresponding illumination mixing coefficient based on the diffuse reflection illumination coefficient, specular reflection illumination coefficient, and distance field parameter may specifically include: calculating the mixing angle parameter corresponding to the object to be processed based on the included angle between any two sample points in the object to be processed; and using the mixing angle parameter, combined with the diffuse reflection illumination coefficient, specular reflection illumination coefficient, and distance field parameter, to determine the corresponding illumination mixing coefficient.

[0149] Specifically, after obtaining the illumination coefficient, the effects of the illumination range and the cosine distance field can be calculated. Specifically, the formula for the cosine of the angle between vectors A(x1,y1) and B(x2,y2) in two-dimensional space can include:

[0150]

[0151] The cosine of the angle between any two n-dimensional sample points a(x11,x12,…,x1n) and b(x21,x22,…,x2n) can include:

[0152]

[0153] The cosine of the included angle ranges from -1 to 1. A larger cosine indicates a smaller angle between the two vectors, and a smaller cosine indicates a larger angle. The cosine reaches its maximum value of 1 when the directions of the two vectors coincide, and its minimum value of -1 when the directions of the two vectors are completely opposite. Based on the above, the formula can be simplified to:

[0154]

[0155] The mixing angle A can be determined using the formula above.

[0156] After correcting the distance field, the square root of (Iambdiff*cosA)² + (Ildiff*sinA)² + (Ispec*tanA)² can be used as the illumination mixing coefficient Q. Then, the illumination coefficients exposed in the corresponding blueprint can be assigned the value Q. This illumination mixing coefficient Q can be used as the basic luminescence parameter. For other areas of different types, such as light boxes / billboards, this basic luminescence coefficient can be multiplied to increase the illumination in specific areas. Generally, a constant coefficient of 10.65 can be used as the multiplier.

[0157] For example, taking a staircase as an example, firstly, the target staircase is selected in the 3D model, and the materials and textures of each staircase sub-model are filtered; if it is an L1 level white film, no processing is performed. For staircase sub-models with the same texture and material, diffuse reflection processing can be performed simultaneously to calculate the diffuse reflection illumination coefficient, and specular reflection processing can be performed to obtain the initial specular coefficient, and specular reflection illumination coefficient can be corrected to obtain the specular reflection illumination coefficient; and distance field calculation can be performed simultaneously; the distance field calculation can be achieved using conventional methods, and will not be elaborated on in this disclosure. Using the mixing angle parameter, combined with the diffuse reflection illumination coefficient, specular reflection illumination coefficient, and distance field parameter, the above formula is used to calculate and obtain the corresponding illumination mixing coefficient. This illumination mixing coefficient is then configured as the illumination coefficient of the model. Using the mixed luminescence coefficient and the square root of the distance field influence as the material luminescence coefficient, the coefficient is dynamically calculated to accurately configure the luminescence state; effectively solving the luminescence effect of L1 to L2 level models under night scene conditions without natural lighting, closely resembling night scene lighting, to meet the night scene rendering mode. Furthermore, the existing texture maps can be used to create the glowing material, without the need for additional texture maps, thus reducing the complexity of the model.

[0158] In this example implementation, refer to Figure 10 As shown, the above method may further include:

[0159] Step S101: Obtain spline configuration parameters through a preset parameter interface, and perform animation path planning based on the spline configuration parameters; and

[0160] Step S102: Bind the skeleton array of the virtual object to the spline to move the virtual object according to the planned path.

[0161] Specifically, in digital twin applications, 3D models can include numerous animated virtual objects, such as pedestrians, vehicles, aircraft, and animals in a smart park, as well as water bodies and animals within them. Existing animation techniques using software like Maya and Honidi can overload the GPU. To overcome this issue, splines can be used to plan the virtual objects within the 3D model when binding non-business logic elements.

[0162] Specifically, when binding business logic to a 3D model, the configuration parameters of the spline can be obtained through the blueprint communication interface corresponding to the model. These spline configuration parameters can include: the type of virtual object, time information, the coordinates of key points on the spline, etc. When modeling using the UE5 platform, the planned paths of virtual objects can be marked using spline key points in the model; each spline key point can correspond to coordinates in the world coordinate system. Furthermore, an array of skeletons of virtual objects can be bound to the corresponding spline to identify the travel paths of virtual objects such as pedestrians, bicycles, vehicles, and airplanes in the digital twin scene. For different virtual objects, the speed can be configured by configuring the path and time in the spline configuration parameters. Different speeds can be configured for the skeletons corresponding to different types of virtual objects. (Reference) Figure 11 As shown, when planning the key points of the spline, the rotation value of the skeleton can be configured according to the actual business needs at different key points of the spline to achieve the animation effect of the spline bending.

[0163] By binding corresponding skeletons with Spline, multi-dimensional dynamic effects of the skeletons can be achieved. Through path planning of the skeletons using Spline, intermittent displacement can be used to complete corresponding position changes and animation effects. In digital twin scenarios, such as pedestrian and vehicular traffic, the animation can be achieved by arbitrarily replacing mesh content, and it can match the animation capabilities of complex road networks and non-standard mesh lines to complete the rendering and scene display of corresponding traffic sections. This business logic can be encapsulated as a plugin. During model construction, the plugin can be executed through Blueprint API calls to achieve the corresponding functionality.

[0164] In this example implementation, refer to Figure 12 As shown, the above method may further include:

[0165] Step S121: Configure the angle between the normal vectors of the world coordinates and screen coordinates corresponding to the coordinate points to be processed in the target model as the first standard angle.

[0166] Step S122: Configure the approximate three-dimensional coordinates of the coordinate point to be processed in the screen coordinate system according to the first standard angle;

[0167] Step S123: Perform coordinate vector splitting on the approximate three-dimensional coordinates, and dynamically bind the target interest point and the coordinate point to be processed according to the coordinate vector splitting result.

[0168] Specifically, in digital twin applications, the location and number of Points of Interest (POIs) in a 3D model generally depend on data from the real-world scene. Therefore, during model movement and viewing, issues arise such as POI occlusion and scattered locations. Furthermore, due to height differences within the model and the limitations of human vision, some POIs may alternately appear and disappear depending on the viewpoint and movement. Using traditional POI traversal methods to control visibility and angle, especially with a large number and variety of POIs, can lead to model overload and frame rate drops. Conversely, using traditional model insertion methods for POI handling results in poor reusability and iterative capabilities.

[0169] For example, Points of Interest (POIs) in the model can include surveillance cameras, access control systems, water and electricity meters, time clocks, and other points of interest set according to actual business needs. When binding business logic, dynamic compensation logic for POI coordinates can be configured to ensure that when users view and move the model on their terminal devices, the absolute position of the POIs on the screen matches the world coordinates, ensuring that the model maintains orthogonal projection and a fixed outward angle facing the screen as the user manipulates it.

[0170] Specifically, steps S111-S113 can be implemented during non-business logic binding. The coordinate points to be processed can be points of interest (POIs) in the model. When the model is displayed on the terminal device, the world coordinates and screen coordinates of each POI can be converted. Since the screen coordinate system does not have a height parameter for the Z-axis, the method to obtain the height can include using the angle between the normal vector of the world coordinates and the normal vector of the screen coordinates as the standard angle for taking arcsin, thereby obtaining an approximate Z-axis range. Then, automatic compensation is implemented, dividing the approximate (X, Y, Z) coordinates into eight equal vectors, taking the POI with the smallest absolute value for dynamic binding, and binding the latitude and longitude with the world coordinates after screen arccross mapping, thereby achieving dynamic snapping of the POI coordinates.

[0171] In this example embodiment, the above method may further include: dividing the interest point set according to the type corresponding to each interest point in the target model; configuring each interest point set as a sub-level corresponding to the main scene of the target model, so as to load each interest point set through level streaming according to the display control of the target model.

[0172] Specifically, each point of interest (POI) in the model can be categorized, and corresponding POI sets can be constructed for each type. These various POI sets are processed as sub-levels of the main scene, ensuring that fixed levels are streamed at a consistent pace to complete the loading of the corresponding POIs. The implementation logic for categorizing and loading POIs through level streaming is described.

[0173] In this example implementation, refer to Figure 13 As shown, in step S131, in response to the display control operation of the target model, the current field of view of the virtual camera is obtained in real time;

[0174] Step S132: Concurrent control is performed on the x-time axis, y-time axis, and z-time axis to bind the currently focused point of interest, so as to maintain the display position of the target point of interest.

[0175] Specifically, when a user moves or rotates the model and views points of interest (POIs) within the user interface of a terminal device, the model can respond to the user's display control operations by moving and rotating accordingly. At this time, the field of view of the virtual camera corresponding to the model can be obtained in real time. For focus handling, multi-dimensional timeline control and concurrent control are used, meaning the X, Y, and Z timelines are bound to the POIs that the focus follows, thereby controlling the display and hiding of the POIs and ensuring that there are no missing or obstructed positive correspondences.

[0176] In this example implementation, the method may further include: using an angle controller to control the switching of time axes in each dimension.

[0177] Specifically, since Points of Interest (POIs) are typically accompanied by virtual camera movement and transitions, the spring arm exists to stabilize the camera and prevent lens shakiness, blurring, and frame drops caused by switching and concurrent operations across multiple timelines. This embodiment uses a native Arrow controller from the UE platform as the angle controller, which ensures stable animation transitions.

[0178] This non-business logic enables coordinate calibration of the model using native blueprint low-code methods, reducing coding workload. By classifying points of interest (POIs) in the model and grouping them into sets according to multi-fusion nesting in level flow, both world coordinate consistency and performance optimization are ensured. The above method achieves automatic compensation of POI coordinates, mapping screen coordinates arccrossically to the world scene to represent the elevation differences of POIs. (Reference) Figure 14 The POI in the model shown maintains the outward orthogonal projection effect of the screen. When a single position changes relative to the screen, the effect relative to world coordinates remains fixed, as shown below. Figure 15 As shown. Figure 16As shown, clicking any POI and triggering the secondary display logic will not result in POI occlusion or misalignment. Furthermore, by using a virtual camera and a spring arm to achieve base class focus mapping, and binding all POIs with focus derivation, the different display content of different POIs can be effectively distinguished.

[0179] In this example implementation, refer to Figure 17 As shown, the above method may further include:

[0180] Step S171: In response to the display control operation of the target model, identify the device type of the input device;

[0181] Step S172, when the input device is determined to be a first type of device, the orthogonal vector parameter of the angle between the current centerline of the virtual camera and the relative offset parameter of the input device is used; or,

[0182] Step S173: When the input device is determined to be a second type of device, the acceleration / deceleration parameter corresponding to the display control operation is determined; and the offset parameter is determined by combining the execution duration of the acceleration / deceleration parameter and the preset step size.

[0183] Step S174: Correct the display effect of the target model according to the offset parameter.

[0184] Specifically, scene roaming refers to the collective term for actions such as moving and rotating within a virtual scene that do not follow a predetermined script or narrative. Generally, this includes not only rotation and translation but also zooming in and out. In the field of digital twins, roaming is also an important capability of the model.

[0185] Specifically, when a user views a model on a terminal device, such as a digital twin model of a smart park, if the terminal device is a mobile phone, tablet, or other electronic device with a touchscreen, the user can view the model by touch. If the terminal device is a laptop or desktop computer, the user can view and move the model using input devices such as a mouse and keyboard. For the terminal, when the user performs a control operation, the type of input device can be identified first. The first type of device can be a mouse or keyboard; the second type can be a touchscreen. When the device is identified as the first type, the central axis corresponding to the current virtual camera can be calculated, and the standard label quantity can be calculated. Generally, there is a relative offset on the screen based on mouse / gestures, assumed to be S1 to S2. The central axis viewed by the camera in the current virtual scene is S3, and the angle formed is A. Therefore, the orthogonal vector value along the direction of A can be obtained as Move = (x, y, z). The product of this move vector and the step size is the total length of the required offset. Similarly, in rotation and scaling, the step size is the corresponding offset pixel value and the corresponding scaling ratio value. The step size refers to the minimum offset for movement / rotation within the scene, orthogonal to the camera's specified direction / angle and the corresponding eye distance centerline. The step size can be set manually or configured via parameters; assuming a step size of 10, the step size is used instead of the pixel length by default (since the display uses pixels as the unit of resolution, pixels are used here as well). For calculating the centerline, since the virtual scene has its own centerline, its position is the translation of the scene's central axis (determined during modeling) with respect to the cosine of the camera angle in the XY plane; this is the position of the camera's corresponding translation centerline.

[0186] Alternatively, if the input method is touch, the offset can be corrected based on acceleration / deceleration. In touchscreen applications, due to the influence of human operation, there will be acceleration and corresponding deceleration. The calculation method is as follows: Assuming the operation is a normalized operation, it can be considered that the duration of constant speed during the touch process is approximately 66.7%. Therefore, assuming the touch time is 3 seconds, then 2 seconds of time conforms to the characteristics of mouse operation. The remaining 1 second is divided equally, with 0.5 seconds for acceleration and 0.5 seconds for deceleration. The acceleration should be calculated as: logarithm of single step length * acceleration / deceleration duration. Therefore, the overall offset length will change. The calculation formula can include: Standard length + Log(single step length) * acceleration duration t + (mid-range constant speed length) + Standard length - Log(single step length) * deceleration duration; then substitute into the regular mouse length calculation. If the user's current control operation is rotation / scaling, the corresponding single step length object content value can be changed. That is, the corresponding rotation angle / the corresponding scaling ratio. ReferenceFigure 18 , 19 Figures 20 and 21 illustrate the effects of panning, rotating, and scaling, respectively. The above steps can be implemented during business logic binding using the UE engine's Blend view. After rendering the model, it is displayed in the terminal device's interactive interface.

[0187] In this example implementation, refer to Figure 21 As shown, the above method may further include:

[0188] Step S211: Receive a service request from a terminal device via a signaling server; wherein the service request includes the identification information of the target point of interest, task information, and the terminal device identifier;

[0189] Step S212: Process the service request to obtain the streaming media data corresponding to the target point of interest, and push the streaming media data corresponding to the target point of interest to the terminal device through the signaling server.

[0190] Specifically, refer to Figure 22 The network architecture shown may include terminal devices (such as...) Figure 22 The system includes one or more of the following: smartphone 101, visual data panel IOC 102, and computer 103; network 104; signaling server 105; and data server 106. Network 104 serves as the medium for providing a communication link between the terminal device and the server. Network 104 can include various connection types, such as wired communication links, wireless communication links, etc. It should be understood that... Figure 22 The number of terminal devices, networks, and servers shown is merely illustrative. Depending on implementation needs, any number of terminal devices, networks, and servers can be included. For example, signaling server 105 and data server 106 could be a server cluster composed of multiple servers.

[0191] Terminal devices can initiate service requests to the data server through the signaling server. These service requests include the identifier of the target point of interest, task information, and the terminal device identifier. For example, a service request could be a route planning task from an engineer's current location to a target repair point; or it could be a monitoring task for a specified road segment or building, and so on. Furthermore, service requests can also include control operations such as rotating or stretching the model.

[0192] In a data twin scenario, the 3D model can be generated after being constructed, rendered, and bound to business and non-business logic on a data server. The generated model can be encapsulated and packaged on the data server and bound to the addresses of preset terminal devices. Different terminal devices can be configured with different permissions to view different model data. After receiving a service request forwarded by the signaling server, the data server can obtain the streaming media data corresponding to the point of interest and send it to the terminal device via the signaling server.

[0193] The model building method provided in this disclosure can achieve high-precision model building. It can be applied to the model building of digital twins in smart parks to build an overall digital twin combined with a virtual simulation system. Business logic and non-business logic can be bound together in the form of plug-ins. For various mobile devices, binding is performed through the streaming media address sent out by the model terminal, and corresponding access methods and interaction logic are formulated according to their own business needs.

[0194] It should be noted that the above figures are merely illustrative of the processes included in the method according to exemplary embodiments of the present invention, and are not intended to be limiting. It is readily understood that the processes shown in the above figures do not indicate or limit the temporal order of these processes. Furthermore, it is readily understood that these processes may, for example, be executed synchronously or asynchronously in multiple modules.

[0195] Further reference Figure 23 As shown, this example embodiment also provides a model building device 230, which includes: a first-stage model calculation module 2301, a target model calculation module 2302, and a streaming media data processing module 2303. Wherein,

[0196] The first-stage model calculation module 2301 can be used to obtain basic geographic information data from the target data source and perform three-dimensional processing to obtain an initial model; and to perform material mapping on the initial model to obtain the first-stage model.

[0197] The target model calculation module 2302 can be used to bind non-business logic to the first stage model and to bind business logic to the first stage model in order to generate the target model corresponding to the modeling object.

[0198] The streaming media data processing module 2303 can be used to bind the target model to streaming media, so as to push the streaming media data corresponding to the target model to the corresponding preset terminal.

[0199] In this example implementation, the first-stage model calculation module 2301 can be used to obtain basic geographic information data from the target data source, and filter the basic geographic information data according to preset rules to obtain hierarchical data; and execute a set of modeling rules on the hierarchical data to obtain the initial model.

[0200] In this example implementation, the non-business logic includes model luminescence logic; the target model calculation module 2302 may include: a luminescence coefficient configuration module.

[0201] The luminescence coefficient configuration module can be used to determine the object to be processed in the first stage model based on the texture and material of the model; calculate the corresponding diffuse reflection illumination coefficient, specular reflection illumination coefficient and distance field parameter for the object to be processed; determine the corresponding illumination mixing coefficient based on the diffuse reflection illumination coefficient, specular reflection illumination coefficient and distance field parameter; configure the illumination mixing coefficient as the basic luminescence parameter of the object to be processed, and configure the corresponding actual luminescence coefficient according to the position of the object to be processed according to the basic luminescence parameter and a preset ratio.

[0202] In this example embodiment, the luminance coefficient configuration module may include: determining a first luminance parameter for the interactive reflection of ambient light by combining ambient light intensity and the material's reflectance coefficient to ambient light; determining a second luminance parameter for the interactive reflection of directional light by combining point light source intensity, the material's reflectance coefficient to ambient light, and the angle between the incident light direction and the vertex normal; and determining the diffuse reflection illumination coefficient based on the first luminance parameter and the second luminance parameter.

[0203] In this example embodiment, the luminance coefficient configuration module may include: determining an initial specular coefficient by combining the specular reflection coefficient, point light source intensity, specular index, and a first ray direction parameter; and correcting the initial specular coefficient using a second ray direction parameter to obtain the specular reflection illumination coefficient.

[0204] In this example embodiment, the luminescence coefficient configuration module may include: calculating the mixing angle parameter corresponding to the object to be processed based on the included angle between any two sample points in the object to be processed; and using the mixing angle parameter, combined with the diffuse reflection illumination coefficient, specular reflection illumination coefficient, and distance field parameter, determining the corresponding illumination mixing coefficient.

[0205] In this example embodiment, the device may further include a coordinate point dynamic binding module.

[0206] The coordinate point dynamic binding module can be used to configure a first standard angle based on the angle between the normal vectors of the world coordinates and screen coordinates corresponding to the coordinate point to be processed in the target model; configure the approximate three-dimensional coordinates of the coordinate point to be processed in the screen coordinate system based on the first standard angle; perform coordinate vector splitting on the approximate three-dimensional coordinates; and select a target interest point and the coordinate point to be processed for dynamic binding based on the coordinate vector splitting result.

[0207] In this example embodiment, the device may further include a display control module.

[0208] The display control module can be used to respond to the display control operation of the target model, obtain the current field of view of the virtual camera in real time, and perform concurrent control of the interest point currently followed by the focus on the x-time axis, y-time axis, and z-time axis to maintain the display position of the target interest point.

[0209] In this example embodiment, the device may further include a switching control module.

[0210] The switching control module can be used to control the switching of time axes in various dimensions using an angle controller.

[0211] In this example embodiment, the device may further include a data loading module.

[0212] The data loading module can be used to divide the interest point set according to the type corresponding to each interest point in the target model; and configure each interest point set as a sub-level corresponding to the main scene of the target model, so as to load each interest point set through level streaming according to the display control of the target model.

[0213] In this example embodiment, the device may further include a path planning module.

[0214] The path planning module can be used to obtain spline configuration parameters through a preset parameter interface, perform animation path planning based on the spline configuration parameters, and bind the skeleton array of the virtual object to the spline so as to move the virtual object according to the planned path.

[0215] In this example embodiment, the device may further include a display effect correction module.

[0216] The display effect correction module can be used to respond to the display control operation of the target model, identify the device type of the input device; when the input device is determined to be a first type of device, determine the orthogonal vector parameter of the angle between the current central axis of the virtual camera and the relative offset parameter of the input device; or, when the input device is determined to be a second type of device, determine the acceleration / deceleration parameter corresponding to the display control operation; and determine the offset parameter by combining the execution duration of the acceleration / deceleration parameter and the preset step size; and correct the display effect of the target model according to the offset parameter.

[0217] In this example embodiment, the device may further include a signaling processing module.

[0218] The signaling processing module can be used to receive service requests from terminal devices through a signaling server; wherein, the service request includes the identification information of the target point of interest, task information, and the terminal device identifier; process the service request to obtain streaming media data corresponding to the target point of interest, and push the streaming media data corresponding to the target point of interest to the terminal device through the signaling server.

[0219] The specific details of each module in the aforementioned model building device 230 have been described in detail in the corresponding model building method, so they will not be repeated here.

[0220] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0221] Furthermore, although the steps of the method in this disclosure are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result. Additional or alternative steps may be omitted, multiple steps may be combined into one step, and / or a step may be broken down into multiple steps.

[0222] In an exemplary embodiment of this disclosure, an electronic device capable of implementing the above-described method is also provided.

[0223] Those skilled in the art will understand that various aspects of this disclosure can be implemented as a system, method, or program product. Therefore, various aspects of this disclosure can be specifically implemented in the following forms: a completely hardware implementation, a completely software implementation (including firmware, microcode, etc.), or a combination of hardware and software aspects, collectively referred to herein as a "circuit," "module," or "system."

[0224] The following reference Figure 24 To describe an electronic device 1000 according to such an embodiment of the present disclosure. Figure 24 The electronic device 1000 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments disclosed herein.

[0225] like Figure 24 As shown, the electronic device 1000 includes a Central Processing Unit (CPU) 1001, which can perform various appropriate actions and processes based on programs stored in Read-Only Memory (ROM) 1002 or programs loaded from Storage Unit 1008 into Random Access Memory (RAM) 1003. The RAM 1003 also stores various programs and data required for system operation. The CPU 1001, ROM 1002, and RAM 1003 are interconnected via a bus 1004. An Input / Output (I / O) interface 1005 is also connected to the bus 1004.

[0226] The following components are connected to I / O interface 1005: an input section 1006 including a keyboard, mouse, etc.; an output section 1007 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 1008 including a hard disk, etc.; and a communication section 1009 including a network interface card such as a LAN (Local Area Network) card, modem, etc. The communication section 1009 performs communication processing via a network such as the Internet. A drive 1010 is also connected to I / O interface 1005 as needed. Removable media 1011, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., are installed on drive 1010 as needed so that computer programs read from them can be installed into storage section 1008 as needed.

[0227] In particular, according to embodiments of the present invention, the processes described below with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of the present invention include a computer program product comprising a computer program carried on a storage medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 1009, and / or installed from removable medium 1011. When the computer program is executed by central processing unit (CPU) 1001, it performs various functions defined in the system of this application.

[0228] Specifically, the aforementioned electronic devices can be smart mobile electronic devices such as mobile phones, tablets, or laptops. Alternatively, the aforementioned electronic devices can also be smart electronic devices such as desktop computers.

[0229] It should be noted that the storage medium shown in the embodiments of the present invention can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, optical fiber, portable compact disc read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In the present invention, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present invention, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, wherein computer-readable program code is carried. Such transmitted data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signal medium can also be any storage medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the storage medium can be transmitted using any suitable medium, including but not limited to wireless, wired, etc., or any suitable combination thereof.

[0230] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0231] The units described in the embodiments of the present invention can be implemented in software or hardware, and the described units can also be located in a processor. The names of these units do not necessarily limit the specific unit itself.

[0232] It should be noted that, as another aspect, this application also provides a storage medium, which may be included in an electronic device or may exist independently without being assembled into the electronic device. The aforementioned storage medium carries one or more programs, which, when executed by an electronic device, cause the electronic device to perform the methods described in the following embodiments. For example, the electronic device may perform... Figure 1 The steps shown.

[0233] Furthermore, the above figures are merely illustrative of the processes included in the method according to exemplary embodiments of the present invention, and are not intended to be limiting. It is readily understood that the processes shown in the above figures do not indicate or limit the temporal order of these processes. Additionally, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0234] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and embodiments are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.

Claims

1. A model construction method, characterized in that, The method includes: Basic geographic information data is obtained from the target data source and processed in three dimensions to obtain an initial model; the initial model is then preprocessed to obtain a first-stage model. Non-business logic binding is performed on the first-stage model, and business logic binding is performed on the first-stage model to generate the target model corresponding to the modeling object; The target model is bound to streaming media to push the streaming media data corresponding to the target model to the corresponding preset terminal; The non-business logic includes model illumination logic; the non-business logic binding of the first-stage model includes: In the first stage of the model, the object to be processed is determined based on the model's texture and material; Calculate the diffuse reflection illumination coefficient, specular reflection illumination coefficient, and distance field parameters for the object to be processed; The corresponding illumination mixing coefficient is determined based on the diffuse reflection illumination coefficient, the specular reflection illumination coefficient, and the distance field parameters. The illumination mixing coefficient is configured as the basic luminescence parameter of the object to be processed, and the corresponding actual luminescence coefficient is configured according to the position of the object to be processed according to the basic luminescence parameter and a preset ratio.

2. The model construction method according to claim 1, characterized in that, The process of acquiring basic geographic information data from the target data source and performing 3D processing to obtain an initial model includes: Obtain basic geographic information data from the target data source, and filter the basic geographic information data according to preset rules to obtain hierarchical data; A set of modeling rules is applied to the hierarchical data to obtain the initial model.

3. The model construction method according to claim 1, characterized in that, Calculating the diffuse illumination coefficient corresponding to the object to be processed includes: By combining the ambient light intensity and the material's reflectance to ambient light, the first light intensity parameter of the interactive reflection between the diffuse reflector and the ambient light is determined. The intensity of the point light source, the material's reflectivity to ambient light, and the angle between the incident light direction and the vertex normal are used to determine the second light intensity parameter of the interactive reflection between the diffuse reflector and the directional light. The diffuse reflection illumination coefficient is determined based on the first light intensity parameter and the second light intensity parameter.

4. The model construction method according to claim 1, characterized in that, Calculating the specular reflection illumination coefficient corresponding to the object to be processed includes: The initial specular coefficient is determined by combining the specular reflection coefficient, point light source intensity, specular index, and first ray direction parameters. The initial specular coefficient is corrected using the second ray direction parameter to obtain the specular reflection illumination coefficient.

5. The model construction method according to claim 1, characterized in that, The step of determining the corresponding illumination mixing coefficient based on the diffuse reflection illumination coefficient, the specular reflection illumination coefficient, and the distance field parameters includes: Based on the included angle between any two sample points in the object to be processed, calculate the mixed angle parameter corresponding to the object to be processed. The corresponding illumination mixing coefficient is determined by using the mixing angle parameter, combined with the diffuse reflection illumination coefficient, the specular reflection illumination coefficient, and the distance field parameter.

6. The model construction method according to claim 1, characterized in that, The method further includes: The angle between the normal vectors of the world coordinates and screen coordinates corresponding to the coordinate points to be processed in the target model is configured as the first standard angle. Configure the approximate three-dimensional coordinates of the coordinate point to be processed in the screen coordinate system according to the first standard angle; The approximate three-dimensional coordinates are split into coordinate vectors, and the target interest point is selected and dynamically bound to the coordinate point to be processed based on the coordinate vector splitting result.

7. The model construction method according to claim 1 or 6, characterized in that, The method further includes: In response to the display control operation of the target model, the current field of view of the virtual camera is obtained in real time; Concurrent control is applied to bind the currently focused point of interest on the x, y, and z time axes to maintain the display position of the target point of interest.

8. The model construction method according to claim 7, characterized in that, The method further includes: An angle controller is used to control the switching of time axes in various dimensions.

9. The model construction method according to claim 1 or 6, characterized in that, The method further includes: The interest point set is divided according to the type corresponding to each interest point in the target model; Each set of points of interest is configured as a sub-level corresponding to the main scene of the target model, so as to load each set of points of interest through level streaming according to the display control of the target model.

10. The model construction method according to claim 1, characterized in that, The method further includes: The spline configuration parameters are obtained through a preset parameter interface, and animation path planning is performed based on the spline configuration parameters; and The skeleton array of the virtual object is bound to splines to move the virtual object along a planned path.

11. The model construction method according to claim 1, characterized in that, The method further includes: In response to a display control operation on the target model, the device type of the input device is identified; When the input device is determined to be a first-type device, the orthogonal vector parameter of the angle between the current centerline of the virtual camera and the relative offset parameter of the input device is used; or, When the input device is determined to be a second type of device, the acceleration / deceleration parameters corresponding to the display control operation are determined; and the offset parameters are determined in combination with the execution duration of the acceleration / deceleration parameters and the preset step size. The display effect of the target model is corrected based on the offset parameter.

12. The model construction method according to claim 1, characterized in that, The method further includes: The signaling server receives service requests from terminal devices; wherein, the service request includes the identification information of the target point of interest, task information, and the terminal device identifier; The service request is processed to obtain the streaming media data corresponding to the target point of interest, and the streaming media data corresponding to the target point of interest is pushed to the terminal device through the signaling server.

13. A model building apparatus, characterized in that, The device includes: The first-stage model calculation module is used to obtain basic geographic information data from the target data source and perform three-dimensional processing to obtain an initial model; and to preprocess the initial model to obtain the first-stage model. The target model calculation module is used to bind non-business logic to the first stage model and to bind business logic to the first stage model in order to generate the target model corresponding to the modeling object. The streaming media data processing module is used to bind the target model to streaming media so as to push the streaming media data corresponding to the target model to the corresponding preset terminal. The non-business logic includes model illumination logic; the target model calculation module is configured to execute: In the first stage of the model, the object to be processed is determined based on the model's texture and material; Calculate the diffuse reflection illumination coefficient, specular reflection illumination coefficient, and distance field parameters for the object to be processed; The corresponding illumination mixing coefficient is determined based on the diffuse reflection illumination coefficient, the specular reflection illumination coefficient, and the distance field parameters. The illumination mixing coefficient is configured as the basic luminescence parameter of the object to be processed, and the corresponding actual luminescence coefficient is configured according to the position of the object to be processed according to the basic luminescence parameter and a preset ratio.

14. A storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the model building method as described in any one of claims 1 to 12.

15. An electronic device, characterized in that, include: processor; as well as Memory for storing the executable instructions of the processor; The processor is configured to execute the model building method of any one of claims 1 to 12 by executing the executable instructions.

Images