POI (Point of Interest) modeling method, electronic equipment and storage medium

Abstract

The invention discloses an interest point modeling method, electronic equipment and a storage medium, and the method comprises the steps: when an interest point uploaded by a user is received, publishing a webpage corresponding to the interest point through a webpage server; analyzing the web page by using a Chromium embedded frame plug-in embedded in a modeling engine to obtain a page image data stream corresponding to the interest point; and generating rendering data corresponding to the page image data flow through the modeling engine, and constructing an interest point model of the interest point according to the rendering data. According to the method, automatic construction of the interest point model is realized, tedious steps in a model construction process can be reduced, modeling is performed by autonomously uploading the interest points by the user, the interest point model can be generated according to user requirements, an autonomous customization function of the interest point model is provided for the user, the use experience of the user can be improved, and the application range of the interest model can be expanded.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to a point of interest modeling method, electronic equipment and storage medium. Background Art

[0002] Geographic Information System (GIS) is a technical system for collecting, storing, managing, analyzing and displaying geographic spatial data. Point of Interest (POI) is an important concept in GIS system. The importance of POI in GIS is mainly reflected in its ability to provide accurate geographic location information and provide the necessary data basis for applications such as spatial analysis, geographic decision-making and map display. In some scenarios, assets or models corresponding to POI are created in the GIS system according to user needs. The current POI model creation process is cumbersome and complicated, involving multiple professional fields, including but not limited to modeling and design, textures and materials, import and integration, and interactive functions, which makes it impossible to customize the POI model independently, the user experience is poor, and the application scenarios of the POI setting function of the GIS system are limited. Summary of the invention

[0003] The present invention provides a point of interest modeling method, an electronic device and a storage medium to realize the automatic construction of a point of interest model, which can reduce the tedious steps in the model construction process, provide users with the function of autonomous customization of the point of interest model, improve the user experience, and expand the application scope of the point of interest model.

[0004] According to one aspect of the present invention, a method for modeling points of interest is provided, wherein the method comprises:

[0005] Upon receiving a point of interest uploaded by a user, publishing a web page corresponding to the point of interest through a web server;

[0006] Parsing the web page using the Chromium embedded framework plug-in embedded in the modeling engine to obtain a page image data stream corresponding to the point of interest;

[0007] The modeling engine generates rendering data corresponding to the page image data stream, and constructs a point of interest model of the point of interest according to the rendering data.

[0008] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0009] at least one processor; and

[0010] a memory communicatively connected to the at least one processor; wherein,

[0011] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the point of interest modeling method described in any embodiment of the present invention.

[0012] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the interest point modeling method described in any embodiment of the present invention when executed.

[0013] The technical solution of the embodiment of the present invention receives the points of interest uploaded by the user through a web server, calls the web page generated by the web server for the points of interest, calls the Chromium embedded framework plug-in embedded in the modeling engine to parse the web page, thereby generating a page image data stream including the points of interest, uses the modeling engine to render the page image data stream into rendering data, and creates a point of interest model of the point of interest according to the rendering data through the modeling engine, thereby realizing automatic modeling of the point of interest, generating rendering data of the point of interest model through the web page, which can reduce the difficulty of generating rendering data such as model texture, and modeling by users uploading points of interest on their own, so that the point of interest model can be generated according to user needs, thereby realizing customized construction of the point of interest model and improving the user experience.

[0014] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0016] Figure 1 is a system architecture diagram of a point of interest modeling system provided according to an embodiment of the present invention;

[0017] Figure 2 is a flowchart of a method for modeling points of interest provided according to Embodiment 1 of the present invention;

[0018] Figure 3 is a flow chart of a method for modeling points of interest provided according to Embodiment 2 of the present invention;

[0019] Figure 4is a flowchart of another method for modeling points of interest provided according to Embodiment 3 of the present invention;

[0020] Figure 5 is a flowchart of another method for modeling points of interest provided according to a fourth embodiment of the present invention;

[0021] Figure 6 This is an example diagram of a method for modeling points of interest provided in Embodiment 5 of the present invention;

[0022] Figure 7 It is a structural schematic diagram of an electronic device for implementing the method for modeling points of interest according to an embodiment of the present invention. DETAILED DESCRIPTION

[0023] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0024] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0025] In order to solve the high complexity problem of point of interest modeling in GIS system, Figure 1 is a system architecture diagram of a point of interest modeling system provided according to an embodiment of the present invention, see Figure 1The point of interest modeling system may include a web server and a modeling engine. The web server and the modeling engine may be communicatively connected. The web server may be a software and / or hardware device that stores, processes and transmits web pages to clients on the Internet or an intranet. The web server may receive points of interest uploaded by users. The points of interest may be customized information for modeling in a GIS system. The points of interest received by the web server may exist in the form of web page files, text information, image information, etc. The modeling engine may be software or a system for modeling a GIS system. The modeling engine may be used to create or edit three-dimensional models. The modeling engine may be Unreal Engine, etc.

[0026] Embodiment 1

[0027] Figure 2 is a flowchart of a method for modeling points of interest according to the first embodiment of the present invention. This embodiment is applicable to the case of modeling points of interest. Figure 2 The method provided in the embodiment of the present invention specifically includes the following steps:

[0028] Step 110: When receiving the points of interest uploaded by the user, publish the web page corresponding to the points of interest through the web server.

[0029] Among them, the points of interest can be the mark points of the area of ​​interest in the three-dimensional visualization. The display form of the points of interest can include icons and animations, etc. The points of interest can be marked by the user independently. The points of interest at least include the content and location of the points of interest. For example, the user can select a virtual geographical location in the GIS system to mark as a point of interest. The web server can provide users with a parsing service for points of interest. The web server can process the points of interest into web pages through pre-configured web page templates. The web server can also communicate with the modeling engine to transmit the web pages to the modeling engine for modeling, which can realize the data structuring of the points of interest and simplify the modeling process. A web page may be a page constructed through points of interest. For example, points of interest may be filled into a web page template to constitute a web page, or the points of interest may be processed into a web page according to rules configured by a web server. For another example, a WEB server may be configured with a pre-trained large language model. When the WEB server receives points of interest uploaded by a user, the points of interest may be processed into a web page through the large language model. It is understandable that the points of interest uploaded by the user may be text information, which may describe the location of the point of interest, the icon style, and the text content displayed by the point of interest, etc. The web page may correspond to a web page specification configured by a web server or a modeling engine, and the web page may include an HTML page, an XML page, etc.

[0030] In an embodiment of the present invention, a user can communicate and access a web server, and upload his or her customized points of interest to the web server. The web server can process the points of interest, thereby constructing a web page that at least includes the points of interest. The web page can also include the user's identity authentication information or information for interconnection authentication between the web server and the modeling engine, etc. The web server can publish the generated web page, and the publishing can include storing the web page in a specified project file or a specified storage address, so that at least the modeling engine can access the web page containing the points of interest through the specified project file or the specified storage address.

[0031] In some exemplary embodiments, points of interest can be uploaded to a WEB server (web page server) in the form of HTML files or HTML code blocks. The WEB server can process the HMTL files or HTML code blocks to form a complete static web page. The WEB server can save the static web page to a preset storage address, which can be pre-agreed upon by the WEB server and the modeling engine. The modeling engine can read the static page composed of points of interest at the storage address.

[0032] Step 120: parse the web page using the Chromium embedded framework plug-in embedded in the modeling engine to obtain a page image data stream corresponding to the point of interest.

[0033] Among them, the modeling engine can be a tool for creating and / or editing a three-dimensional model. The modeling engine can build a three-dimensional model based on the point of interest. The modeling engine can realize functions such as model creation, model editing, material and texture mapping, and rendering. The modeling engine can include but is not limited to the Three.js modeling engine, the Babylon.js modeling engine, the Unreal Engine, etc. The Chromium Embedded Framework (CEF) plug-in can implement a built-in browser, provide web rendering capabilities, and display web content in the modeling engine. For example, the web content includes HTML5, CSS3, JavaScript, etc. The page image data stream can be the result of processing the web page through the Chromium Embedded Framework plug-in. The web page image data stream can be generated by parsing the static content of the web page. The web page image data stream may include icon images, text content, static page layout information, etc. of the point of interest uploaded by the user. In some embodiments, when the point of interest includes the location of the point of interest, the web page image data stream may also include the location of the point of interest.

[0034] In an embodiment of the present invention, a Chromium embedded framework may be configured in the modeling engine. When the modeling engine obtains a web page published by a web server, the Chromium embedded framework may be called to parse the web page, and texture information, page layout position, and content of the point of interest determined in the web page may be obtained as rendering data of the point of interest.

[0035] Step 130: Generate rendering data corresponding to the page image data stream through a modeling engine, and construct a point of interest model of the point of interest according to the rendering data.

[0036] The point of interest model may be a three-dimensional model constructed for the point of interest, and the point of interest model may exist in the form of a three-dimensional icon or a three-dimensional animation. The point of interest model may be generated based on the point of interest uploaded by the user, and the point of interest model may include at least one of the content, location, and presentation form of the point of interest. The rendering data may be the result of rendering the page image data stream, and the rendering data may include at least texture information. The rendering data may be determined by the result of parsing the web page by the Chromium embedded framework plug-in. In some embodiments, the rendering data may also include information such as the page layout position parsed from the page image data stream and the content of the point of interest.

[0037] Specifically, the modeling engine obtains the page image data stream parsed by the CEF plug-in, and the page image data stream can be obtained from the web page of the point of interest. The page image data stream can be rendered by the modeling engine to obtain rendering data. For example, the page image data stream includes an icon image of the point of interest. The modeling engine can obtain texture information of the icon image by rendering the page image data stream, and can create a point of interest object for the point of interest, and bind the corresponding texture and other information in the rendering data to the point of interest object, thereby forming a point of interest model of the point of interest.

[0038] Exemplarily, the page image data stream may include information such as the location, image, material selection information, display content, etc. of the point of interest. The modeling engine may extract the location, image, material selection information, display content, etc. from the page image data stream, and render the image as texture information, select the material according to the material selection information, and attach the texture information to the selected material, bind the material to the constructed point of interest object, and display the point of interest object according to the location and display content, thereby realizing the modeling of the point of interest.

[0039] In an embodiment of the present invention, points of interest uploaded by users are received through a web server, and a web page generated for the points of interest by the web server is called, and a Chromium embedded framework plug-in embedded in a modeling engine is called to parse the web page, thereby generating a page image data stream including the points of interest, and the page image data stream is rendered into rendering data by the modeling engine, and a point of interest model of the point of interest is created according to the rendering data by the modeling engine, thereby realizing automatic modeling of the points of interest, and generating rendering data of the point of interest model through a web page, thereby reducing the difficulty of generating rendering data such as model texture, and modeling by users uploading points of interest on their own initiative, thereby generating a point of interest model according to user needs, thereby realizing customized construction of the point of interest model, and improving the user experience.

[0040] Embodiment 2

[0041] Figure 3 is a flowchart of a method for modeling points of interest provided according to the second embodiment of the present invention. The embodiment of the present invention is a specific embodiment based on the above embodiment, and the processing process of the web page in the web server is described in detail. Figure 3 The method provided in the embodiment of the present invention specifically includes the following steps:

[0042] Step 210: Receive a page code snippet uploaded by a user, wherein the page code snippet includes at least the content of the point of interest and the location of the point of interest.

[0043] In an embodiment of the present invention, a user can upload points of interest in the form of a page code snippet, which can be generated by the user in the client used by the user or in a specific web page. For example, the user can upload the points of interest through the client, and the client can be configured with a software development kit (SDK), which can be used to generate point of interest information on the client. For example, a page can be implemented on the client through the SDK, and the user can select or fill in the point of interest content and point of interest location and other information in the page to constitute the point of interest information. After receiving the point of interest information, the client can convert the point of interest information into a page code snippet, which can be a partial code that constitutes a web page. The page code snippet is a block-level element code or other element code in a document object model (DOM) element in the web page. In other embodiments, a user may access a web page that may provide interactive controls for collecting points of interest. The user may upload information such as the content and location of the points of interest to the web page by interacting with the interactive controls. The web page may process the information such as the content and location of the points of interest uploaded by the user into page code snippets, and the web page may transmit the page code snippets to a web server, thereby enabling the uploading of the user's points of interest.

[0044] Step 220: Generate a web page corresponding to the page code snippet through a web page server, publish the web page, and obtain an access address of the web page.

[0045] The access address may be an address for accessing a web page, and the access address may include a physical address of the web page on a web server or a network address of the web page, etc. The access address may be used by a modeling engine to access the web page.

[0046] In an embodiment of the present invention, the web page server can process the page code snippet into a web page. For example, the web page server can add other necessary page code segments to the page code snippet according to the web page template to construct the web page. Alternatively, the web page server can pre-train a neural network model that can process the page code snippet into a web page. The web page server can publish the generated web page and configure an access address for the web page so that the modeling engine can access the web page through the access address.

[0047] Step 230: parse the web page using the Chromium embedded framework plug-in embedded in the modeling engine to obtain a page image data stream corresponding to the point of interest.

[0048] Step 240: Generate rendering data corresponding to the page image data stream through a modeling engine, and construct a point of interest model of the point of interest according to the rendering data.

[0049] In an embodiment of the present invention, a page code snippet uploaded by a user is received, and the page code snippet includes at least the location of the point of interest and the content of the point of interest. The web server processes the page code snippet into a web page, and publishes the web page to generate an access address of the corresponding web page. The web page is processed by a Chromium embedded framework plug-in in a modeling engine to generate a page image data stream of the point of interest. The page image data stream is rendered by the modeling engine to obtain rendering data, and the point of interest model is created by the modeling engine according to the rendering data. Automatic modeling of the point of interest can be achieved. The rendering data of the point of interest model is automatically generated by the web page, which can reduce the difficulty of generating rendering data such as model texture. The user can independently determine the point of interest, and customized modeling of the point of interest can be achieved, which can enhance the user experience.

[0050] Further, based on the above-mentioned embodiment of the invention, a web page corresponding to the page code snippet is generated by a web page server, including:

[0051] When the page code snippet is received, a pre-configured template page is read through the web page server; and the page code snippet is filled into the template page as a web page through the web page server.

[0052] The template page may be a template with a pre-designed page layout and style. The template page may include static files such as HTML, CSS, and JavaScript. The template page may be configured in a web server.

[0053] In the embodiment of the present invention, when the web page server receives the page code snippet, it can read the pre-configured template page and fill the page code snippet into the template page, so that the template page filled with the page code snippet is used as a web page. It can be understood that when the page code snippet takes the code snippet in the block element in the DOM element as an example, the code in the block element in the template page is in a vacant state. When the page code snippet is obtained, the above page code snippet can be filled into the block element of the template page to fill the template page into a complete web page. It can be understood that multiple page code snippets can be filled into the same template page.

[0054] In some embodiments of the invention, it also includes: requesting the communication service interface of the modeling engine through the web server, and calling the communication service interface to transmit the access address of the web page to the modeling engine.

[0055] The communication service interface may be a data transmission interface implemented through a communication protocol, and the communication service interface may be implemented through HTTP protocol or socket communication protocol.

[0056] In an embodiment of the present invention, the web server can send a communication establishment request to the communication service interface of the modeling engine, thereby calling the communication service interface within the modeling engine, and can transmit the access address of the web page to the modeling engine through the communication service interface, so that the modeling engine can access the web page including the point of interest through the access address.

[0057] Embodiment 3

[0058] Figure 4 is a flowchart of another method for modeling points of interest provided according to the third embodiment of the present invention. The present embodiment of the present invention is a specific embodiment of the present invention, and introduces the process of generating rendering data of points of interest. Figure 4 The method provided in the embodiment of the present invention specifically includes the following steps:

[0059] Step 310: When receiving the points of interest uploaded by the user, publish the web page corresponding to the points of interest through the web server.

[0060] Step 320: Call the Chromium embedded framework plug-in through the modeling engine to access the web page.

[0061] In an embodiment of the present invention, a Chromium embedded framework plug-in may be pre-installed in the modeling engine. After determining that the web server has published a web page including a point of interest, the Chromium embedded framework plug-in configured in the modeling engine may be called immediately, so that the Chromium embedded framework plug-in accesses the web page, thereby extracting the information of the point of interest included in the web page. It is understandable that the Chromium embedded framework plug-in may provide a built-in browser function in the modeling engine, and may load the web page into the provided browser, thereby enabling the Chromium embedded framework plug-in to access the web page.

[0062] Step 330: parse the document object model elements of the web page using the Chromium embedded framework plug-in to obtain a page image data stream corresponding to the point of interest in the web page, wherein the page image data stream includes at least an icon image of the point of interest.

[0063] Specifically, the document object model element may be a basic element constituting a web page, and the document object model element may include a block element, a tag element, an image element, etc., and each document object model element may correspond to a different code block in the web page. The icon image may be icon information for displaying the point of interest, and the icon image may be pattern information that needs to be displayed in the point of interest model, and the icon image may be included in the point of interest uploaded by the user.

[0064] In an embodiment of the present invention, the Chromium embedded framework plug-in can be used to parse the web page according to the document object model elements, obtain the text, icon image, interface position, virtual space position and other information of the point of interest, and process the extracted information into a page image data stream so that the modeling engine can process the page image data stream. Exemplarily, the Chromium embedded framework plug-in can be a JavaScript plug-in that can read and return the information in the div block element, and the parsing of the document object model elements can be implemented through the Chromium embedded framework plug-in, and the read information can be used as a page image data stream.

[0065] Step 340: Generate rendering data corresponding to the page image data stream through a modeling engine, and construct a point of interest model of the point of interest according to the rendering data.

[0066] In an embodiment of the present invention, when receiving points of interest uploaded by users, a web page including the points of interest is published through a web server, the web page is accessed by using a Chromium embedded framework plug-in embedded in a modeling engine, and the web page is parsed according to the document object model elements to obtain a page image data stream corresponding to the point of interest, the page image data stream is rendered by the modeling engine to obtain rendering data, a point of interest model of the point of interest is created according to the rendering data, and the model creation of the point of interest is realized, the web page is parsed by the Chromium embedded framework plug-in to obtain the page image data stream, and the modeling engine generates rendering data corresponding to the page image data stream, which can reduce the difficulty of generating rendering data of the point of interest model, and the user can independently determine the point of interest to realize customized modeling of the point of interest, which can improve the user experience.

[0067] Embodiment 4

[0068] Figure 5 is a flowchart of another method for modeling points of interest provided according to the fourth embodiment of the present invention. The embodiment of the present invention is a specific embodiment based on the above embodiment, and introduces the process of modeling points of interest based on rendering data. Figure 5 The method provided in the embodiment of the present invention specifically includes the following steps:

[0069] Step 410: When receiving the points of interest uploaded by the user, publish the web page corresponding to the points of interest through the web server.

[0070] Step 420: parse the web page using the Chromium embedded framework plug-in embedded in the modeling engine to obtain a page image data stream corresponding to the point of interest.

[0071] Step 430: Render the page image data stream through the modeling engine to obtain rendering data corresponding to the point of interest.

[0072] In an embodiment of the present invention, the page image data stream generated by the CEF plug-in may include elements such as page results, styles, JAVAScript codes, resource requests, CSS style rules, etc. of the web page. The modeling engine can create corresponding rendering objects for the above elements. For example, a corresponding graphic object can be created for the element corresponding to the HTML tag of each point of interest. These graphic objects can be simple geometric shapes. Then, the CSS style rules in the page image data stream can be used to set corresponding properties for the created rendering object, such as color, font, size, position, layout, etc., and relevant parameters for virtual scene construction or setting can be set for the rendering object. The information generated after the modeling engine renders the page image data stream can be used as rendering data for the point of interest.

[0073] Exemplarily, the rendering data may include at least texture information, and the texture information may be data of an appearance image of a virtual model constituting the point of interest. The texture information may include color texture, normal texture, displacement texture, etc. of the point of interest. The texture information may be generated by rendering an icon image in a page image data stream generated by a Chromium embedded framework plug-in. The texture information may be implemented through an off-screen rendering function or a texture sharing function. For example, the point of interest icon image may be rendered to a custom image buffer through the off-screen rendering function of the Chromium embedded framework plug-in, and the texture information may be read from the image buffer.

[0074] Step 440: Call the modeling engine to specify texture coordinates for the texture information in the rendering data.

[0075] Among them, texture coordinate specification can be a process of specifying a coordinate system of a texture image of a point of interest, and the coordinate system is used to map a two-dimensional texture image to a three-dimensional model surface. Texture coordinate specification can be achieved by adding a texture node for the point of interest in a material editor of a modeling engine, and configuring corresponding texture coordinates for each input pin of the texture node. Texture coordinates are usually defined in a two-dimensional space. For example, (0, 0) can represent the lower left corner of the texture.

[0076] In an embodiment of the present invention, the texture information in the rendering data can be processed by the modeling engine, and the texture coordinates of the texture information can be set so as to map the texture information to the surface of the three-dimensional model. For example, one or more texture coordinate nodes are determined for the texture information in the modeling engine, and corresponding input pins are set for the texture coordinate nodes according to the page layout position information, so that the texture coordinate nodes obtain corresponding texture coordinate values. Furthermore, the method of determining the texture coordinate value can be achieved by performing transformation operations such as translation, rotation, and scaling on the page layout position information.

[0077] Step 450: Call the modeling engine to determine the material of the point of interest, and attach texture to the material according to the texture information specified by the texture coordinates.

[0078] The material may be a surface property of the model of the point of interest, the material may include the texture of the surface of the point of interest, and the material may be affected by properties such as color, reflectivity, roughness, and transparency.

[0079] In an embodiment of the present invention, one or more materials can be selected for a point of interest through a modeling engine, and the texture information after the texture coordinates are specified can be attached to the surface of the material. Specifically, a material editor can be started through a modeling engine, and one or more materials can be selected in the material editor according to business scenarios or user needs. In some embodiments, the material can be determined by the user, and the selection information of the material can also be included in the point of interest uploaded by the user. After the material is determined, the texture node in the texture information generated in the above steps can be connected to the material node of the material, thereby achieving the attachment of the texture to the material.

[0080] Step 460: Create an interest point object through the modeling engine, and attach the material with texture attachment to the interest point object as an interest point model.

[0081] Among them, the point of interest object can be a modeling object constructed for the point of interest. The point of interest object can be set according to preset configuration parameters, which may include relevant parameters of the static mesh object, skeletal mesh object, terrain or particle system configuration of the point of interest model. In some embodiments, the point of interest object can be generated by rendering the page layout position in the data, and the point of interest content and other information.

[0082] In the embodiment of the present invention, a point of interest object can be created by a modeling engine, a static mesh object or a skeletal mesh object corresponding to the point of interest can be created, and a generated material can be attached to the created static mesh object or skeletal mesh object to form a point of interest model. For example, the material can be dragged to the point of interest object in the modeling engine, or the material slot of the point of interest object can be configured as a material with a texture attached.

[0083] In an embodiment of the present invention, points of interest uploaded by users are received through a web server, and a web page corresponding to the points of interest is generated, a Chromium embedded framework plug-in in a modeling engine is called to parse the web page, thereby generating a page image data stream of the points of interest, and a modeling engine is called to render and process the page image data stream to obtain rendering data corresponding to the points of interest, texture information is assigned texture coordinates through the modeling engine, and a material corresponding to the points of interest is created, and the modeling engine is used to attach the texture information to the material, the modeling engine creates a point of interest object, and binds the generated material to the point of interest object to realize a point of interest model, which can realize automatic modeling of the points of interest, determine the rendering data of the point of interest model through the web page, reduce the difficulty of generating rendering data, and model the points of interest by users uploading the points of interest on their own initiative, so that the point of interest model can be generated according to user needs, thereby realizing customized construction of the point of interest model and improving the user experience.

[0084] In some embodiments of the invention, it also includes: obtaining the point of interest position of the point of interest carried by the web page through the modeling engine; and using the modeling engine to render the point of interest model to the virtual scene position corresponding to the point of interest position.

[0085] The location of the point of interest may indicate the location of the point of interest in the virtual scene. Taking the GIS system as an example, the location of the point of interest may be the geographical location information indicating the point of interest in the virtual scene. The virtual scene location may indicate the location of the point of interest model in the virtual scene. The virtual scene location may correspond to the location of the point of interest. In some embodiments, the virtual scene location may be obtained by performing coordinate conversion on the location of the point of interest.

[0086] In an embodiment of the present invention, a web page may carry the location of a point of interest, and a modeling engine may obtain the location of the point of interest carried in the web page. For example, the modeling engine may directly access the web page to obtain the location of the point of interest, or the modeling engine may parse the web page by calling a CEF plug-in, and the modeling engine may extract the location of the point of interest from the web image data stream generated by the CEF plug-in parsing. The modeling engine may determine the virtual scene location of the point of interest model in the virtual scene according to the location of the point of interest, and display the point of interest model at the virtual scene location. When displaying the point of interest model at the virtual scene location, the modeling engine may also set ambient light occlusion, ray tracing reflection, etc. for rendering the point of interest model.

[0087] In some embodiments of the invention, based on the above embodiments of the invention, it also includes: setting interactive events for point of interest objects through a modeling engine.

[0088] Among them, the interaction event can be an event triggered when other objects in the modeling scene come into contact with the point of interest object. A collision body can be set for the point of interest object and the corresponding event can be bound. The event can include collision events, timer events or other types of events. The point of interest object can make corresponding interaction effects according to the interaction event. The interaction effect can include moving, rotating, changing the model appearance, triggering animation playback, triggering sound playback and other exchange behaviors.

[0089] In the embodiment of the present invention, a collision body may be added to the interest point object through the modeling engine, and one or more interaction events may be bound to the interest point object, so that the interest point object may produce an interaction effect when a collision occurs.

[0090] In some embodiments of the invention, based on the above embodiments of the invention, it also includes: feeding back usage information of the point of interest objects of the modeling engine to the user through real-time communication on the web page.

[0091] Among them, web real-time communication can be a way for users to communicate with the modeling engine, and web real-time communication can be achieved through the DataChannel data channel of webrtc or other communication protocols.

[0092] Specifically, the modeling engine can call web real-time communication to feed back the usage information of the point of interest to the user through the web real-time communication, so that the user can use the point of interest object. The usage information may include rendering data of the point of interest object.

[0093] Embodiment 5

[0094] Figure 6 is an example diagram of a method for modeling points of interest provided according to Embodiment 5 of the present invention. The embodiment of the present invention provides a method for modeling points of interest. Figure 6 The interest point modeling method can be implemented by an interest point modeling system, which may include a client, a WEB server, and an Unreal Engine installed with a Chromium Embedded Framework (CEF), wherein the Unreal Engine includes a UE instance and a CEF instance.

[0095] Among them, the client can include: Javascript control logic and Web Real-Time Communications (WebRTC). The Javascript control logic is mainly used for the client to customize the POI icon, write the customized POI icon style through HTML+CSS code snippets, and upload it to the web server.

[0096] The WEB server provides the ability to upload HTML+CSS code snippets of custom POIs and assembles HTML+CSS code snippets of custom POIs into HTML pages; it also provides an execution environment that allows Web applications to communicate and interact with clients through the HTTP protocol. The WEB server hosts and manages the operation of Web applications and supports the transmission of HTML content, allowing CEF to access the HTML pages of custom POIs through the HTTP protocol.

[0097] Unreal Engine provides an image rendering engine, including real-time lighting, physical rendering, particle systems and special effects, rendering of scenes in complex GIS systems, generation of POIs and POI images; it also provides WebRTC protocol support, and Unreal Engine can communicate with clients. The CEF plug-in provided by Unreal Engine is an embedded Web browser engine. 2. CEF can be embedded into the Unreal Engine engine through the Unreal Engine plug-in, enabling Unreal Engine to render HTML pages, JavaScript applications and multimedia content.

[0098] The method for implementing point of interest modeling in the system may include the following steps:

[0099] Step 1: In the initial stage, the parameters (custom HTML+CSS code snippet) passed in by the client are used to assemble the HTML+CSS code and query the relevant GIS location information in the SDK, and then the HTTP request is sent to the WEB server through the SDK. The process of sending the HTTP request can include the client making an interface request to the WEB server through the SDK. After obtaining the interface information returned by the WEB server, an HTTP request can be sent to the WEB server according to the interface information, thereby sending the custom HTML+CSS code snippet and the label location information to the WEB server. The custom code snippet is used to generate POI. The custom HTML+CSS code snippet can generate a static web page on the WEB server, and the label location information is GIS information including latitude, longitude and altitude, which is subsequently used to determine the location of the POI point in the Unreal Engine scene.

[0100] Step 2: The WEB server assembles the template page. Specifically, the WEB server receives the HTTP request from the client, extracts the HTML+CSS code snippet included in the HTTP request, and dynamically generates the corresponding HTML file based on the HTML+CSS code snippet, that is, the POI page, and publishes the POI page to the WEB server to determine the POI page access address.

[0101] Step 3: After step 2 is completed, the WEB server will immediately request the HTTP service interface provided by Unreal Engine and transmit the POI page access address generated in step 2 to the Unreal Engine.

[0102] Step 4: Unreal Engine creates a CEF instance and receives the POI page access address;

[0103] Specifically, after receiving the POI page access address provided by the WEB server, Unreal Engine will immediately call the CEF-encapsulated plug-in, use the CEF instance to initialize the spider service, establish a connection with the HTTP service of the WEB server, and initiate an access request to the POI page to the HTTP service based on the POI page access address, so as to access the POI page access address provided by the WEB server through an HTTP request.

[0104] Step 5: CEF parses and calculates DIV position information.

[0105] Specifically, the CEF instance receives data of the POI page fed back by the WEB server. After receiving the data, the POI page can be parsed, and the content and location information of the POI are parsed in units of div block elements according to the dom elements in HTML, wherein the location information of the content refers to the screen coordinate position of the POI in the POI page.

[0106] Step 6: The CEF instance can extract the page image data stream in the POI page according to the location information to achieve pre-rendering. The UE instance in Unreal Engine generates the corresponding texture in UnrealEngine using the page image data stream rendered by the CEF instance, that is, the page image data stream generated by CEF is used for back-end rendering in Unreal Engine, the texture is generated by the preset code of Unreal Engine, and the texture coordinates (Texture Coordinates) are specified by the location information of the POI content calculated in step 5. In addition, the UE instance can also monitor the exception or completion message in the CEF instance. When the CEF instance is pre-rendering the POI page data (i.e. blu_event), if there is an exception, that is, the CEF instance reports an error in the pre-rendering process of the POI page data, the CEF instance can notify the UE instance, so that when the UE instance receives the exception, it can notify the client through the DataChannel event that an error has occurred in the modeling process of the point of interest. After completing the pre-rendering process, the CEF instance can notify the UE of a completion message. When the UE instance receives the completion message, it can obtain the page image data stream generated by pre-rendering in the CEF instance, and the UE instance can perform subsequent rendering processing on the page image data stream.

[0107] Step 7: Attach the texture from step 6 to the dynamically generated material.

[0108] Step 8: Dynamically generate the corresponding POI object in the scene, such as Actor, through the tag location information uploaded in step 1, convert the latitude and longitude in the tag location information into coordinates in the three-dimensional coordinate system in Unreal Engine, render the dynamically generated POI object at the coordinates, and attach the material in step 7 to the POI object.

[0109] Step 9: The object generated in step 8 supports the extension of events such as click. After completing the modeling of the point of interest in Unreal Engine, it can be transmitted through the DataChannel data channel of webrtc to notify the client to complete the creation of the point of interest model.

[0110] The present invention encapsulates CEF as a plug-in of Unreal Engine to provide Unreal Engine with the ability to display and run WEB content, such as the ability to run HTML pages and JavaScript applications, and converts the data stream rendered by CEF into texture data in Unreal Engine. POI mapping is performed through the generated texture data, dynamically created materials, and dynamically created Unreal Engine objects, thereby realizing POI style customization, avoiding the complex process of POI generation, and eliminating the need to produce textures and materials in the modeling process. By rendering HTML pages through the ability of CEF, POI mapping can be performed using the existing GIS system, thereby expanding application scenarios.

[0111] Embodiment 6

[0112] Figure 7 Schematic diagram of the structure of an electronic device that implements the method for modeling points of interest of an embodiment of the present invention. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0113] like Figure 7 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0114] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0115] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the interest point modeling method.

[0116] In some embodiments, the interest point modeling method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the interest point modeling method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the interest point modeling marking method in any other appropriate manner (e.g., by means of firmware).

[0117] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0118] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0119] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0120] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0121] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0122] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0123] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0124] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for modeling points of interest, characterized in that: The method comprises: Upon receiving a point of interest uploaded by a user, publishing a web page corresponding to the point of interest through a web server; Parsing the web page using the Chromium embedded framework plug-in embedded in the modeling engine to obtain a page image data stream corresponding to the point of interest; The modeling engine generates rendering data corresponding to the page image data stream, and constructs a point of interest model of the point of interest according to the rendering data.

2. The method according to claim 1, characterized in that: When receiving a point of interest uploaded by a user, publishing a web page corresponding to the point of interest through the web server includes: Receiving a page code snippet uploaded by the user, wherein the page code snippet at least includes the content of the point of interest and the location of the point of interest; The web page corresponding to the page code snippet is generated by the web page server, and the web page is published to obtain the access address of the web page.

3. The method according to claim 2, characterized in that: The step of generating the web page corresponding to the page code snippet by the web page server includes: When receiving the page code snippet, reading a pre-configured template page through the web page server; The page code snippet is filled into the template page as the web page through the web page server.

4. The method according to claim 2, characterized in that: Also includes: The communication service interface of the modeling engine is requested through the web server, and the communication service interface is called to transmit the access address of the web page to the modeling engine.

5. The method according to claim 1, characterized in that: The method of parsing the web page using the Chromium embedded framework plug-in embedded in the modeling engine to obtain a page image data stream corresponding to the point of interest includes: Calling the Chromium embedded framework plug-in through the modeling engine to access the web page; The Chromium embedded framework plug-in is used to parse the document object model elements of the web page to obtain a page image data stream corresponding to the point of interest of the web page, wherein the page image data stream at least includes an icon image of the point of interest.

6. The method according to claim 5, characterized in that: The page image data stream also includes: interest point description information, page layout position information and interest point position.

7. The method according to claim 1, characterized in that Generating rendering data corresponding to the page image data stream by the modeling engine, and constructing a point of interest model of the point of interest according to the rendering data, includes: Rendering the page image data stream by the modeling engine to obtain the rendering data corresponding to the point of interest; Calling the modeling engine to specify texture coordinates for texture information in the rendering data; Calling the modeling engine to determine the material of the point of interest, and attaching texture to the material according to the texture information specified by the texture coordinates; An interest point object is created by the modeling engine, and the material with texture attached is attached to the interest point object as the interest point model.

8. The method according to claim 7, characterized in that: Also includes: Acquire the point of interest position of the point of interest carried by the web page through the modeling engine; The interest point model is rendered to a virtual scene position corresponding to the interest point position using the modeling engine.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the interest point modeling method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the interest point modeling method according to any one of claims 1 to 7 when executed.

Images