Power station three-dimensional man-machine interaction method and system based on digital human driving

Through the three-dimensional human-computer interaction method of the power station driven by digital humans, a three-dimensional interactive display page is dynamically generated, solving the problem of single display methods for power station operation situations and relying on manual customization for deep scene reproduction, and achieving efficient and economical power station operation control.

CN119512415APending Publication Date: 2025-02-25THREE GORGES JINSHAJIANG CHUANYUN HYDROPOWER DEV CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202411501712.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-25
Publication Date
2025-02-25

AI Technical Summary

Technical Problem

The existing power station operation trend display means is single, it is difficult to respond to management needs in a timely manner, and in-depth scenario replication relies on manual customization, with a long cycle and high cost, and there are technical risks.

Method used

The three-dimensional human-computer interaction method of power stations is adopted based on digital human-driven. Through digital human, knowledge base, intelligent model training, three-dimensional interaction and page dynamic creation technology, a three-dimensional interaction display page is dynamically generated, supporting three-dimensional human-computer interaction.

Benefits of technology

It improves the efficiency and economicality of power station operation and control, facilitates managers to understand the operation status of power stations and regional safety situation through three-dimensional interaction, and reduces the cycle and cost of manual customization.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119512415A_ABST
    Figure CN119512415A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of power station man-machine interaction, and discloses a power station three-dimensional man-machine interaction method and system based on digital human driving, and the method comprises the steps: constructing a digital human systematic knowledge base and a digital human image for a target power station, the digital human systematic knowledge base comprises a digital human model knowledge base, a digital human model resource base, a digital human business knowledge base and a digital human code knowledge base; constructing a three-dimensional interactive display page code template based on the digital human code knowledge base; and receiving a service instruction through the digital human image, carrying out semantic analysis on the service instruction based on the digital human service knowledge base, and matching to a corresponding three-dimensional interactive display page code template, thereby dynamically generating a three-dimensional interactive display page and carrying out rendering display. According to the invention, efficient and economical three-dimensional visualization of the power station safety dynamic research and judgment result can be supported, so that safety, production and operation information can be displayed in a more visual and accurate manner, and safe operation and production of the power station are promoted.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of power station human-computer interaction, and in particular to a three-dimensional human-computer interaction method and system for a power station based on digital human drive. Background Art

[0002] In the daily operation of power plants, the operation status of power plants is generally output in the form of text or two-dimensional charts. Some also use macro and micro scene reproduction on maps to display the current safety, production and operation status of the power plant. These scene reproductions require high-precision point cloud, modeling or engineering BIM professional three-dimensional design software deconstruction, and the real scene of the power plant is constructed through manual customization of the data, and then combined with heavy three-dimensional engine rendering and presentation.

[0003] For example, invention patent application CN117576319A discloses a substation simulation method and system based on a three-dimensional engine, including: obtaining point cloud data obtained after scanning the substation; generating a substation plane dimension diagram based on the point cloud data; creating a virtual scene of the substation in the three-dimensional engine, and matching the substation white film model in the virtual scene through the input substation plane dimension diagram; obtaining a real-life image of the substation, and replicating the scene in the substation white film model according to the real-life image, thereby obtaining a substation simulation model.

[0004] With the rapid development of digitalization, the means of displaying results purely in the form of text and charts are relatively simple, which easily forms visual inertia and is not conducive to timely management response by relevant personnel; deep scene replication routes are mostly manually customized, with a long implementation cycle and high cost, and are highly dependent on external parties in all aspects. There are certain technical risks. In the actual implementation process, it is necessary to focus on management safety, time, economy and other factors, which may affect the daily work and production efficiency of power station operation and maintenance management. Summary of the invention

[0005] In order to solve the above problems, the present invention proposes a three-dimensional human-computer interaction method and system for a power station driven by a digital human. Through technologies such as digital humans, knowledge bases, intelligent model training, three-dimensional interaction, and dynamic page creation, corresponding scenario-based functional pages can be dynamically generated according to business needs and three-dimensional human-computer interaction can be satisfied. It can more efficiently and economically support the daily operation and control of auxiliary power stations, and facilitate managers at all levels to better pay attention to regional security situations and understand the operation status of power stations through three-dimensional interaction.

[0006] The technical solution adopted by the present invention is as follows:

[0007] A three-dimensional human-computer interaction method for a power station based on digital human driving, comprising:

[0008] Constructing a digital human systematic knowledge base and digital human image for the target power station, wherein the digital human systematic knowledge base includes a digital human model knowledge base, a digital human model resource base, a digital human business knowledge base, and a digital human code knowledge base; and constructing a three-dimensional interactive display page code template based on the digital human code knowledge base;

[0009] Business instructions are received through the digital human image, semantically parsed based on the digital human business knowledge base, and matched to the corresponding 3D interactive display page code template, so as to dynamically generate a 3D interactive display page and render it.

[0010] Furthermore, the construction of a digital human systematic knowledge base and digital human image for the target power station includes:

[0011] Constructing a digital human model knowledge base: Organizing the knowledge text of the planning and layout plan of all power stations by category, structurally describing the indoor and outdoor layers of the ground and basement, as well as the equipment structure, geometric dimensions and resource information, and combining the power station operation and maintenance resource coding and equipment tree coding to form a semantic, systematic and structured digital human model knowledge base of all power station facilities and equipment;

[0012] Constructing a digital human model resource library: Collecting established model resources, presetting corresponding model resource entities for each coded entity through the resource coding relationship in the digital human model knowledge base; for resource codes that are not mapped to models, combining geometric information data, creating and generating geometric entities with three-dimensional appearance through regularized codes, forming a complete set of resource entity models, namely the digital human model resource library;

[0013] Build a digital human business knowledge base: Systematically organize the key business processes of the power station and the corresponding job responsibilities of each department, build a list of the power station's core business through standardized unit segmentation of job process actions, thereby building a digital human business knowledge base, and continuously improve the data for iterative optimization;

[0014] Build a digital human code knowledge base: organize the basic front-end development rules, build a conventional page layout and minimum three-dimensional interactive functional unit code base, and perform iterative optimization through data combination recursion to form a digital human code knowledge base;

[0015] Build a digital human image: Combine power station tooling and typical operation scenes to build a digital human virtual animation, and support voice linkage.

[0016] Furthermore, the three-dimensional interactive display page code template is constructed based on the digital human code knowledge base, including:

[0017] Based on the digital human code knowledge base, page code groups with different layouts are automatically generated according to the given technical description;

[0018] Based on the page code group, WebGL rendering technology is introduced to establish a three-dimensional canvas, and event code functions for loading, displaying, and interacting with three-dimensional scenes and single models are generated;

[0019] Establish a mapping relationship between the page code group and the scene code group on the three-dimensional canvas, and set interactive binding;

[0020] Based on the mapping relationship, a three-dimensional interactive display page code template is constructed with business-related pages and codes.

[0021] Furthermore, the receiving of business instructions through the digital human image, semantic analysis of the business instructions based on the digital human business knowledge base, and matching to the corresponding three-dimensional interactive display page code template include:

[0022] Receive voice or text business instructions through the digital human image, and analyze them through the business knowledge of the digital human business knowledge base to match the semantic content of business needs;

[0023] Based on the digital human business knowledge base, the semantic content of the business requirements is semantically parsed and matched to the corresponding three-dimensional interactive display page code template.

[0024] Furthermore, the dynamically generating a three-dimensional interactive display page and rendering and displaying it includes:

[0025] Dynamically generate 3D interactive pages, match the business points obtained after semanticization to the corresponding functional points, and based on the 3D interactive display page code template, use the digital human code knowledge base to improve and enrich the 3D scene element effects and scene combination effects involved in the page function points, so as to realize the dynamic generation of 3D interactive pages;

[0026] Rendering and displaying the 3D interactive system page: Through server-side data transmission, the 3D interactive page is loaded on the browser side, and the results are rendered and displayed, thereby realizing 3D human-computer interaction.

[0027] A three-dimensional human-computer interaction system for a power station based on digital human drive, comprising:

[0028] A model building module is configured to build a digital human systematic knowledge base and a digital human image for a target power station, wherein the digital human systematic knowledge base includes a digital human model knowledge base, a digital human model resource base, a digital human business knowledge base, and a digital human code knowledge base; and to build a three-dimensional interactive display page code template based on the digital human code knowledge base;

[0029] The three-dimensional interaction module is configured to receive business instructions through the digital human image, perform semantic analysis on the business instructions based on the digital human business knowledge base, and match them to the corresponding three-dimensional interaction display page code template, thereby dynamically generating a three-dimensional interaction display page and rendering it for display.

[0030] Furthermore, in the model building module, a systematic knowledge base of a digital human and a digital human image are built for the target power station, including:

[0031] Constructing a digital human model knowledge base: Organizing the knowledge text of the planning and layout plan of all power stations by category, structurally describing the indoor and outdoor layers of the ground and basement, as well as the equipment structure, geometric dimensions and resource information, and combining the power station operation and maintenance resource coding and equipment tree coding to form a semantic, systematic and structured digital human model knowledge base of all power station facilities and equipment;

[0032] Constructing a digital human model resource library: Collecting established model resources, presetting corresponding model resource entities for each coded entity through the resource coding relationship in the digital human model knowledge base; for resource codes that are not mapped to models, combining geometric information data, creating and generating geometric entities with three-dimensional appearance through regularized codes, forming a complete set of resource entity models, namely the digital human model resource library;

[0033] Build a digital human business knowledge base: Systematically organize the key business processes of the power station and the corresponding job responsibilities of each department, build a list of the power station's core business through standardized unit segmentation of job process actions, thereby building a digital human business knowledge base, and continuously improve the data for iterative optimization;

[0034] Build a digital human code knowledge base: organize the basic front-end development rules, build a conventional page layout and minimum three-dimensional interactive functional unit code base, and perform iterative optimization through data combination recursion to form a digital human code knowledge base;

[0035] Build a digital human image: Combine power station tooling and typical operation scenes to build a digital human virtual animation, and support voice linkage.

[0036] Furthermore, in the model construction module, a three-dimensional interactive display page code template is constructed based on the digital human code knowledge base, including:

[0037] Based on the digital human code knowledge base, page code groups with different layouts are automatically generated according to the given technical description;

[0038] Based on the page code group, WebGL rendering technology is introduced to establish a three-dimensional canvas, and event code functions for loading, displaying, and interacting with three-dimensional scenes and single models are generated;

[0039] Establish a mapping relationship between the page code group and the scene code group on the three-dimensional canvas, and set interactive binding;

[0040] Based on the mapping relationship, a three-dimensional interactive display page code template is constructed with business-related pages and codes.

[0041] Furthermore, in the three-dimensional interaction module, the business instructions are received through the digital human image, the business instructions are semantically parsed based on the digital human business knowledge base, and matched to the corresponding three-dimensional interaction display page code template, including:

[0042] Receive voice or text business instructions through the digital human image, and analyze them through the business knowledge of the digital human business knowledge base to match the semantic content of business needs;

[0043] Based on the digital human business knowledge base, the semantic content of the business requirements is semantically parsed and matched to the corresponding three-dimensional interactive display page code template.

[0044] Furthermore, in the three-dimensional interaction module, a three-dimensional interaction display page is dynamically generated and rendered for display, including:

[0045] Dynamically generate 3D interactive pages, match the business points obtained after semanticization to the corresponding functional points, and based on the 3D interactive display page code template, use the digital human code knowledge base to improve and enrich the 3D scene element effects and scene combination effects involved in the page function points, so as to realize the dynamic generation of 3D interactive pages;

[0046] Rendering and displaying the 3D interactive system page: Through server-side data transmission, the 3D interactive page is loaded on the browser side, and the results are rendered and displayed, thereby realizing 3D human-computer interaction.

[0047] The beneficial effects of the present invention are:

[0048] The present invention, through the combination of digital humans, knowledge bases, three-dimensional and other technologies and model self-learning, can dynamically generate scenario-based function pages according to business needs and meet three-dimensional human-computer interaction, improve the personnel business control interaction mode, improve the efficiency of three-dimensional model creation, and model resource coverage, and can more efficiently and economically support the daily operation and control of auxiliary power stations, making it convenient for managers at all levels to understand the operation status of power stations and the security situation of key areas. The specific instructions are as follows.

[0049] 1. Constructing a digital human model knowledge base. The present invention organizes the knowledge text of the planning and layout scheme of all power stations by categories, structurally describes the indoor and outdoor layers of the ground and basement, and the equipment structure, geometric dimensions and resource information description, and combines the power station operation and maintenance resource coding and equipment tree coding, plus the experience of business personnel, to form a semantic, systematic and structured model knowledge base of all power station facilities and equipment.

[0050] 2. A digital human model resource library has been constructed. The present invention collects established model resources, and presets corresponding model resource entities for each coding entity through the resource coding relationship in the model knowledge base; for resource codes that are not mapped to models, geometric entities with three-dimensional appearance are created and generated through regularized codes in combination with geometric information data, thus obtaining a full set of resource entity models, avoiding manual precision modeling errors, and improving generation time and model coverage.

[0051] 3. Constructed a digital human business knowledge base. The present invention systematically organizes the key business processes of the power station and the corresponding job responsibilities of each department, and subdivides the standardized units of the job process actions to complete the construction of the power station core business list, realize the creation of the knowledge base model, and continuously improve the data to iterate the model. It can highly understand the natural semantics, make business knowledge digital, experience transfer intelligent, and reuse and mine structured. It is more spiritual than the general document-based knowledge base and closer to actual business needs.

[0052] 4. Constructing a digital human code knowledge base. The present invention constructs a conventional page layout and a minimum three-dimensional interactive functional unit code base by organizing the front-end HTML, css, and js basic development rules, and continuously improves the code generation model algorithm through data combination recursion, thereby generating functional and functional code groups. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] Figure 1 This is one of the flow charts of a three-dimensional human-computer interaction method for a power station based on digital human driving in Example 1 of the present invention.

[0054] Figure 2 This is the second flow chart of a three-dimensional human-computer interaction method for a power station based on digital human driving according to the first embodiment of the present invention. DETAILED DESCRIPTION

[0055] In order to have a clearer understanding of the technical features, purposes and effects of the present invention, the specific implementation methods of the present invention are now described. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention, that is, the embodiments described are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of the present invention.

[0056] Example 1

[0057] At present, the operation status of power plants is generally output in the form of text or two-dimensional charts. However, the means of displaying results purely in the form of text and charts are relatively simple, which easily forms visual inertia and is not conducive to timely management response by relevant personnel. Deep scene replication routes are mostly manually customized, with a long implementation cycle and high cost. In addition, they are highly dependent on external parties in all aspects, and have certain technical risks. In the actual implementation process, it is necessary to focus on management safety, time, economy and other factors, which may affect the daily work and production efficiency of power plant operation and maintenance management.

[0058] Based on this, this embodiment provides a three-dimensional human-computer interaction method for a power station based on digital human driving, such as Figure 1 As shown, it includes: building a systematic knowledge base and a digital human image for the target power station, the systematic knowledge base of the digital human includes a digital human model knowledge base, a digital human model resource base, a digital human business knowledge base and a digital human code knowledge base; and building a three-dimensional interactive display page code template based on the digital human code knowledge base; receiving business instructions through the digital human image, semantically parsing the business instructions based on the digital human business knowledge base, and matching them to the corresponding three-dimensional interactive display page code template, so as to dynamically generate a three-dimensional interactive display page and render it for display.

[0059] Specifically, Figure 2 As shown, the three-dimensional human-computer interaction method for a power station of this embodiment can be implemented by the following steps:

[0060] S1. Systematically construct the digital human knowledge base, including the following sub-steps:

[0061] S1-1. Build a digital human model knowledge base, organize the knowledge text of the planning and layout plan of all power stations by category, and structurally describe the indoor and outdoor layers of the ground and basement, as well as the equipment structure, geometric dimensions and resource information description. Combined with the power station operation and maintenance resource coding and equipment tree coding, and coupled with the experience of business personnel, a semantic, systematic and structured model knowledge base of all power station facilities and equipment is formed;

[0062] S1-2, build a digital human model resource library, collect the established model resources, and preset the corresponding model resource entity for each coding entity through the resource coding relationship in the model knowledge base of S1-1; for the resource code that is not mapped to the model, combine the geometric information data constructed by S1-1, and create a geometric entity with a three-dimensional appearance through regularized code to obtain a full set of resource entity models, avoiding the error of manual precision modeling, and improving the generation time and model coverage;

[0063] S1-3. Build a digital human business knowledge base, systematically organize the key business processes of the power station and the corresponding job responsibilities of each department, complete the construction of the power station core business list through standardized unit segmentation of job process actions, realize the creation of knowledge base model, and continuously improve data to iterate the model. It can highly understand natural semantics, make business knowledge digital, experience transfer intelligent, and reuse mining structured. It is more intelligent than general document-based knowledge bases and closer to actual business needs;

[0064] S1-4. Build a digital human code knowledge base, organize the front-end HTML, css, and js basic development rules, build a conventional page layout and minimum three-dimensional interactive functional unit code base, and continuously improve the code generation model algorithm through data combination recursion to achieve the generation of functional and functional code groups;

[0065] S1-5. Build a digital human image library, design digital human virtual animations by combining factory and station tooling with typical work scenarios, and support linkage with voice.

[0066] S2, the digital human dynamically constructs a three-dimensional interactive template, including the following sub-steps:

[0067] S2-1, through the code knowledge base results of S1-4, automatically generate template display page codes with different layouts according to the given technical description;

[0068] S2-2. Based on the code structure of the S2-1 page, WebGL rendering technology is introduced to establish a 3D canvas, and event code functions for loading, displaying, and interacting with 3D scenes and single models are generated;

[0069] S2-3, establish a mapping relationship between the page code group of S2-1 and the scene code group on the canvas of S2-2, set interactive binding, and open up the event linkage between the page and the three-dimensional;

[0070] S2-4. Based on S2-3, complete the construction of the 3D interactive display page code template using business-related pages and codes.

[0071] S3, Digital Human sends a business instruction, including the following sub-steps:

[0072] S3-1, receiving the voice or text information of the digital human image in S1-5, parsing it through the business knowledge in S1-3, and matching it to obtain the semantic content of business requirements;

[0073] S3-2, based on the business knowledge base capability built in S1-3, completes semantic analysis of the business content obtained in S3-1 and matches it to the page code template corresponding to S2-4.

[0074] S4, dynamically generate a three-dimensional interactive system page, combine the semanticized business points in S3-1, match them to the functional points, and based on the business requirement page template obtained in S3-2, use the code knowledge base of S1-4 to improve and enrich the three-dimensional scene element effects and scene combination effects involved in the page functional points, so as to realize the dynamic generation of three-dimensional interactive pages.

[0075] S5, rendering and displaying the three-dimensional interactive system page, through server-side data transmission, loading the system page generated by S4 on the browser side, rendering and displaying the results, and providing three-dimensional human-computer interaction functional applications.

[0076] To sum up, the three-dimensional human-computer interaction method of the power station in this embodiment is based on technologies such as digital humans, knowledge bases, intelligent model training, three-dimensional interaction, and dynamic page creation. It can dynamically generate corresponding scenario-based functional pages according to business needs and meet three-dimensional human-computer interaction. It can support the daily operation and control of auxiliary power stations more efficiently and economically, and facilitate managers at all levels to better pay attention to regional security situations and understand the operation status of power stations through three-dimensional interaction.

[0077] Example 2

[0078] This embodiment provides a three-dimensional human-computer interaction system for a power station based on digital human driving, including:

[0079] The model building module is configured to build a digital human systematic knowledge base and a digital human image for the target power station. The digital human systematic knowledge base includes a digital human model knowledge base, a digital human model resource base, a digital human business knowledge base, and a digital human code knowledge base; and to build a three-dimensional interactive display page code template based on the digital human code knowledge base;

[0080] The three-dimensional interaction module is configured to receive business instructions through the digital human image, perform semantic analysis on the business instructions based on the digital human business knowledge base, and match them to the corresponding three-dimensional interaction display page code template, thereby dynamically generating a three-dimensional interaction display page and rendering it for display.

[0081] Preferably, in the model building module, a systematic knowledge base of a digital human and a digital human image are built for the target power station, including:

[0082] Constructing a digital human model knowledge base: Organizing the knowledge text of the planning and layout plan of all power stations by category, structurally describing the indoor and outdoor layers of the ground and basement, as well as the equipment structure, geometric dimensions and resource information, and combining the power station operation and maintenance resource coding and equipment tree coding to form a semantic, systematic and structured digital human model knowledge base of all power station facilities and equipment;

[0083] Constructing a digital human model resource library: Collecting established model resources, presetting corresponding model resource entities for each coded entity through the resource coding relationship in the digital human model knowledge base; for resource codes that are not mapped to models, combining geometric information data, creating and generating geometric entities with three-dimensional appearance through regularized codes, forming a complete set of resource entity models, namely the digital human model resource library;

[0084] Build a digital human business knowledge base: Systematically organize the key business processes of the power station and the corresponding job responsibilities of each department, build a list of the power station's core business through standardized unit segmentation of job process actions, thereby building a digital human business knowledge base, and continuously improve the data for iterative optimization;

[0085] Build a digital human code knowledge base: organize the basic front-end development rules, build a conventional page layout and minimum three-dimensional interactive functional unit code base, and perform iterative optimization through data combination recursion to form a digital human code knowledge base;

[0086] Build a digital human image: Combine power station tooling and typical operation scenes to build a digital human virtual animation, and support voice linkage.

[0087] Preferably, in the model construction module, a three-dimensional interactive display page code template is constructed based on the digital human code knowledge base, including:

[0088] Based on the digital human code knowledge base, page code groups with different layouts are automatically generated according to the given technical description;

[0089] Based on the page code group, WebGL rendering technology is introduced to build a 3D canvas, and event code functions for loading, displaying, and interacting with 3D scenes and single models are generated;

[0090] Establish a mapping relationship between the page code group and the scene code group on the 3D canvas, and set interactive binding;

[0091] Based on the mapping relationship, a three-dimensional interactive display page code template is constructed with business-related pages and codes.

[0092] Preferably, in the three-dimensional interaction module, the business instruction is received through the digital human image, the business instruction is semantically parsed based on the digital human business knowledge base, and matched to the corresponding three-dimensional interaction display page code template, including:

[0093] Receive voice or text business instructions through the digital human image, and analyze them through the business knowledge of the digital human business knowledge base to match the semantic content of business needs;

[0094] Based on the digital human business knowledge base, the semantic content of business requirements is semantically parsed and matched to the corresponding three-dimensional interactive display page code template.

[0095] Preferably, in the three-dimensional interaction module, dynamically generating a three-dimensional interactive display page and rendering and displaying it includes:

[0096] Dynamically generate 3D interactive pages, match the business points obtained after semanticization to the corresponding functional points, and based on the 3D interactive display page code template, use the digital human code knowledge base to improve and enrich the 3D scene element effects and scene combination effects involved in the page function points, so as to realize the dynamic generation of 3D interactive pages;

[0097] Rendering and displaying the 3D interactive system page: Through server-side data transmission, the 3D interactive page is loaded on the browser side, and the results are rendered and displayed, thereby realizing 3D human-computer interaction.

[0098] Example 3

[0099] This embodiment is based on embodiment 1:

[0100] This embodiment provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, a three-dimensional human-computer interaction method for a power station based on digital human driving is implemented in Embodiment 1. The computer program may be in source code form, object code form, executable file, or some intermediate form.

[0101] Example 4

[0102] This embodiment is based on embodiment 1:

[0103] This embodiment provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements a three-dimensional human-computer interaction method for a power station based on digital human drive in embodiment 1. The computer program may be in source code form, object code form, executable file, or some intermediate form, etc. The storage medium includes: any entity or device capable of carrying computer program code, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal, and software distribution medium, etc. It should be noted that the content contained in the storage medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the storage medium does not include electric carrier signals and telecommunication signals.

[0104] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity of description, they are expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

Claims

1. A three-dimensional human-computer interaction method for a power station based on digital human driving, characterized in that: include: Constructing a digital human systematic knowledge base and a digital human image for the target power station, wherein the digital human systematic knowledge base includes a digital human model knowledge base, a digital human model resource base, a digital human business knowledge base, and a digital human code knowledge base; And build a three-dimensional interactive display page code template based on the digital human code knowledge base; Business instructions are received through the digital human image, semantically parsed based on the digital human business knowledge base, and matched to the corresponding 3D interactive display page code template, so as to dynamically generate a 3D interactive display page and render it.

2. A three-dimensional human-computer interaction method for a power station based on digital human driving according to claim 1, characterized in that: The construction of a systematic knowledge base of digital human and a digital human image for the target power station includes: Constructing a digital human model knowledge base: Organizing the knowledge text of the planning and layout plan of all power stations by category, structurally describing the indoor and outdoor layers of the ground and basement, as well as the equipment structure, geometric dimensions and resource information, and combining the power station operation and maintenance resource coding and equipment tree coding to form a semantic, systematic and structured digital human model knowledge base of all power station facilities and equipment; Constructing a digital human model resource library: Collecting established model resources, presetting corresponding model resource entities for each coded entity through the resource coding relationship in the digital human model knowledge base; for resource codes that are not mapped to models, combining geometric information data, creating and generating geometric entities with three-dimensional appearance through regularized codes, forming a complete set of resource entity models, namely the digital human model resource library; Build a digital human business knowledge base: Systematically organize the key business processes of the power station and the corresponding job responsibilities of each department, build a list of the power station's core business through standardized unit segmentation of job process actions, thereby building a digital human business knowledge base, and continuously improve the data for iterative optimization; Build a digital human code knowledge base: organize the basic front-end development rules, build a conventional page layout and minimum three-dimensional interactive functional unit code base, and perform iterative optimization through data combination recursion to form a digital human code knowledge base; Build a digital human image: Combine power station tooling and typical operation scenes to build a digital human virtual animation, and support voice linkage.

3. The three-dimensional human-computer interaction method for a power station based on digital human driving according to claim 1 is characterized in that: The three-dimensional interactive display page code template is constructed based on the digital human code knowledge base, including: Based on the digital human code knowledge base, page code groups with different layouts are automatically generated according to the given technical description; Based on the page code group, WebGL rendering technology is introduced to establish a three-dimensional canvas, and event code functions for loading, displaying, and interacting with three-dimensional scenes and single models are generated; Establish a mapping relationship between the page code group and the scene code group on the three-dimensional canvas, and set interactive binding; Based on the mapping relationship, a three-dimensional interactive display page code template is constructed with business-related pages and codes.

4. The three-dimensional human-computer interaction method for a power station based on digital human driving according to claim 1 is characterized in that: The receiving of business instructions through the digital human image, semantic analysis of the business instructions based on the digital human business knowledge base, and matching to the corresponding three-dimensional interactive display page code template include: Receive voice or text business instructions through the digital human image, and analyze them through the business knowledge of the digital human business knowledge base to match the semantic content of business needs; Based on the digital human business knowledge base, the semantic content of the business requirements is semantically parsed and matched to the corresponding three-dimensional interactive display page code template.

5. The three-dimensional human-computer interaction method for a power station based on digital human driving according to claim 1 is characterized in that: The dynamically generating a three-dimensional interactive display page and rendering and displaying it includes: Dynamically generate 3D interactive pages, match the business points obtained after semanticization to the corresponding functional points, and based on the 3D interactive display page code template, use the digital human code knowledge base to improve and enrich the 3D scene element effects and scene combination effects involved in the page function points, so as to realize the dynamic generation of 3D interactive pages; Rendering and displaying the 3D interactive system page: Through server-side data transmission, the 3D interactive page is loaded on the browser side, and the results are rendered and displayed, thereby realizing 3D human-computer interaction.

6. A three-dimensional human-computer interaction system for a power station based on digital human drive, characterized in that: include: A model building module is configured to build a digital human systematic knowledge base and a digital human image for a target power station, wherein the digital human systematic knowledge base includes a digital human model knowledge base, a digital human model resource base, a digital human business knowledge base, and a digital human code knowledge base; And build a three-dimensional interactive display page code template based on the digital human code knowledge base; The three-dimensional interaction module is configured to receive business instructions through the digital human image, perform semantic analysis on the business instructions based on the digital human business knowledge base, and match them to the corresponding three-dimensional interaction display page code template, thereby dynamically generating a three-dimensional interaction display page and rendering it for display.

7. A three-dimensional human-computer interaction system for a power station based on digital human driving according to claim 6, characterized in that: In the model building module, a systematic knowledge base of digital human and a digital human image are built for the target power station, including: Constructing a digital human model knowledge base: Organizing the knowledge text of the planning and layout plan of all power stations by category, structurally describing the indoor and outdoor layers of the ground and basement, as well as the equipment structure, geometric dimensions and resource information, and combining the power station operation and maintenance resource coding and equipment tree coding to form a semantic, systematic and structured digital human model knowledge base of all power station facilities and equipment; Constructing a digital human model resource library: Collecting established model resources, presetting corresponding model resource entities for each coded entity through the resource coding relationship in the digital human model knowledge base; for resource codes that are not mapped to models, combining geometric information data, creating and generating geometric entities with three-dimensional appearance through regularized codes, forming a complete set of resource entity models, namely the digital human model resource library; Build a digital human business knowledge base: Systematically organize the key business processes of the power station and the corresponding job responsibilities of each department, build a list of the power station's core business through standardized unit segmentation of job process actions, thereby building a digital human business knowledge base, and continuously improve the data for iterative optimization; Build a digital human code knowledge base: organize the basic front-end development rules, build a conventional page layout and minimum three-dimensional interactive functional unit code base, and perform iterative optimization through data combination recursion to form a digital human code knowledge base; Build a digital human image: Combine power station tooling and typical operation scenes to build a digital human virtual animation, and support voice linkage.

8. The three-dimensional human-computer interaction system for a power station based on digital human driving according to claim 6 is characterized in that: In the model building module, a three-dimensional interactive display page code template is built based on the digital human code knowledge base, including: Based on the digital human code knowledge base, page code groups with different layouts are automatically generated according to the given technical description; Based on the page code group, WebGL rendering technology is introduced to establish a three-dimensional canvas, and event code functions for loading, displaying, and interacting with three-dimensional scenes and single models are generated; Establish a mapping relationship between the page code group and the scene code group on the three-dimensional canvas, and set interactive binding; Based on the mapping relationship, a three-dimensional interactive display page code template is constructed with business-related pages and codes.

9. The three-dimensional human-computer interaction system for a power station based on digital human driving according to claim 6 is characterized in that: In the three-dimensional interaction module, business instructions are received through the digital human image, the business instructions are semantically parsed based on the digital human business knowledge base, and matched to the corresponding three-dimensional interaction display page code template, including: Receive voice or text business instructions through the digital human image, and analyze them through the business knowledge of the digital human business knowledge base to match the semantic content of business needs; Based on the digital human business knowledge base, the semantic content of the business requirements is semantically parsed and matched to the corresponding three-dimensional interactive display page code template.

10. The three-dimensional human-computer interaction system for a power station based on digital human driving according to claim 6, characterized in that: In the three-dimensional interaction module, a three-dimensional interactive display page is dynamically generated and rendered for display, including: Dynamically generate 3D interactive pages, match the business points obtained after semanticization to the corresponding functional points, and based on the 3D interactive display page code template, use the digital human code knowledge base to improve and enrich the 3D scene element effects and scene combination effects involved in the page function points, so as to realize the dynamic generation of 3D interactive pages; Rendering and displaying the 3D interactive system page: Through server-side data transmission, the 3D interactive page is loaded on the browser side, and the results are rendered and displayed, thereby realizing 3D human-computer interaction.

Citation Information

Patent Citations

  • Substation simulation method and system based on three-dimensional engine

    CN117576319A