Intelligent electric power virtual digital human interaction system based on autonomous decision

Abstract

The invention relates to the technical field of intelligent power grid research, and discloses an intelligent power virtual digital human interaction system based on autonomous decision, which ensures the security of data transmission by integrating an advanced encryption technology, enhances the autonomous decision ability of a virtual digital human by using machine learning and an artificial intelligence algorithm, and improves the data transmission efficiency. And intelligent monitoring and prediction of the power use condition and the equipment operation state are realized. The system not only can update and safely transmit power system data in real time, but also can accurately capture user intentions through semantic understanding and intelligent logical reasoning, and provides vivid and lifelike interaction experience. In addition, the system has a self-optimization function, continuous iterative updating can be carried out according to feedback, and the decision accuracy is improved. The system is advantaged in that seamless integration with an existing electric power system is realized, various application scene supports including data consultation, fault elimination and intelligent control are provided, electric power service efficiency and quality are greatly improved, and requirements of the electric power industry for high safety and intelligent operation are satisfied.

Description

Technical Field

[0001] The present invention relates to the technical field of smart grid research, and particularly to an intelligent power virtual digital human interaction system based on autonomous decision-making. Background Art

[0002] With the development of the smart grid, that is, the advancement of "Grid 2.0", the operation of the power system increasingly depends on an integrated, high-speed bidirectional communication network, as well as advanced sensing and measurement technologies, equipment technologies, control methods, and decision support systems. The smart grid aims to achieve higher reliability, security, economy, efficiency, and environmental friendliness, while ensuring usage safety. As an important part of the smart grid, the intelligent interaction system not only optimizes resource allocation and service personalization through functions such as automatic regulation, power quantity monitoring, real-time monitoring, and fault diagnosis, but also significantly improves power supply reliability and efficiency.

[0003] However, in the current intelligent interaction system, the application of virtual digital humans still faces many challenges. On the one hand, the security of data transmission is insufficient, which is particularly critical in the highly sensitive power industry, because any security vulnerability may lead to serious consequences, including but not limited to service interruption, data leakage, etc. On the other hand, the intelligence level of existing virtual digital humans is limited, mainly reflected in the weak autonomous decision-making ability, and it is difficult to effectively respond and process according to the complex and changeable grid state. These limitations restrict the potential of virtual digital humans in improving the quality of power services and cannot fully meet the requirements of the power industry for efficient and safe operation.

[0004] To solve the above problems, an intelligent power virtual digital human interaction system based on autonomous decision-making has emerged, dedicated to enhancing the role of virtual digital humans in the smart grid by strengthening the security mechanism of data transmission, such as adopting advanced encryption technologies and protocols to protect sensitive information. Summary of the Invention

[0005] In view of the above existing problems, the present invention is proposed.

[0006] Therefore, the present invention provides an intelligent power virtual digital human interaction system based on autonomous decision-making to solve the problems of insufficient data transmission security and weak autonomous decision-making ability faced by the existing intelligent interaction system when applying virtual digital humans, which limits its potential in improving the quality of power services and ensuring efficient and safe operation.

[0007] To solve the above technical problems, the present invention provides the following technical solutions:

[0008] In a first aspect, the present invention provides an intelligent power virtual digital human interaction system based on autonomous decision-making. The system includes a first recognition and processing module, an autonomous decision-making module, a scenario trigger and judgment module, a first voice interaction module, a data management and processing module, and a communication module;

[0009] The first recognition and processing module is used to convert the user's voice, gesture, and text inputs into information that can be processed by the digital human, and render its facial expressions and limb movements in real time;

[0010] The autonomous decision-making module is used to evaluate the information output by the first recognition and processing module, match scenarios according to the evaluation results, and execute the decision results;

[0011] The scenario trigger and judgment module is used to trigger corresponding functional units according to the power system scenario, and start corresponding control strategies through data verification, auditing, and cross-verification in combination with the autonomous decision-making module;

[0012] The first voice interaction module is used to convert the output result of the scenario trigger and judgment module into voice output to achieve voice communication with the user;

[0013] The data management and processing module is used to process and classify and manage the operation data of power equipment;

[0014] The communication module is used to provide a data transmission and communication environment for the digital human intelligent interaction system.

[0015] As a preferred solution of the intelligent power virtual digital human interaction system based on autonomous decision-making according to the present invention, wherein: the autonomous decision-making module includes an attitude evaluation unit, a risk evaluation unit, a scenario matching unit, a decision generation unit, a decision execution unit, and an iterative update unit;

[0016] The attitude evaluation unit is used to evaluate the speech rate and intonation in the data information, the risk evaluation unit is used to evaluate the risk of the evaluated data, the scenario matching unit is used to match the risk-evaluated data with scenarios, the decision generation unit is used to generate decision results after matching the corresponding trigger scenarios, the decision execution unit is used to execute the decision results, and the iterative update unit is used to establish a real-time data update mechanism so that the information obtained by the digital human can reflect the actual changes in a timely manner.

[0017] As a preferred solution of the intelligent power virtual digital human interaction system based on autonomous decision-making according to the present invention, wherein: the scenario trigger and judgment module includes a scenario trigger module and a judgment module;

[0018] The scenario trigger module includes a data consultation unit, a fault elimination unit, an intelligent control unit, an intelligent prediction unit, an energy consumption unit, and a security defense unit;

[0019] The data consultation unit is used to match the data or the corresponding device operation parameters that need to be consulted in the scenario of receiving a request to consult power data or device operation parameters, and cooperate with the autonomous decision-making module. The fault elimination unit is used to perform a fault check on the monitored intelligent power equipment in the scenario of receiving a fault elimination instruction issued by the user, and cooperate with the autonomous decision-making module. The intelligent control unit is used to judge the correctness of the instruction in the scenario of receiving a device operation instruction issued by the user, and cooperate with the autonomous decision-making module. The intelligent prediction unit is used to start a triple decision-making mechanism in the scenario where the intelligent inspection robot transmits abnormal data during the operation of the corresponding device, and cooperate with the autonomous decision-making module. The energy consumption unit is used to start an adaptive control strategy in the scenario where the sudden increase in the power generated by the corresponding power generation method causes grid frequency fluctuations, and cooperate with the autonomous decision-making module. The security defense unit is used to immediately start an active defense mechanism in the scenario of detecting an abnormal traffic attack on the power SCADA system, and cooperate with the autonomous decision-making module.

[0020] As a preferred solution of the intelligent power virtual digital human interaction system based on autonomous decision-making according to the present invention, wherein: the scenario trigger and judgment module includes a scenario trigger module and a judgment module;

[0021] The judgment module includes a data verification unit, a data audit unit, a cross-verification unit, a data update unit, and a warning module;

[0022] The data verification unit is used to set strict verification rules for the collected, matched, and transmitted data. The data audit unit is used to establish a data audit system to track and audit the entire process of the data source, collection, processing, storage, and use. The cross-verification unit uses an integrated learning method to cross-verify the results processed by the scenario matching unit using a fusion model of different algorithms. The data update unit is used to establish a real-time data update mechanism. The warning module is used to cooperate with the voice synthesis module and the multi-modal interaction module in the first voice interaction module for subsequent processing after the data is judged to be normal.

[0023] As a preferred solution of the intelligent power virtual digital human interaction system based on autonomous decision-making according to the present invention, wherein: the first recognition and processing module includes a recognition module, a semantic understanding module, and an image processing module;

[0024] The recognition module is used for speech recognition to convert the user's voice input into text information that the digital human can understand. The semantic understanding module is used to deeply analyze the user's voice and input text to understand the underlying intentions and emotions. The image processing module is used to enhance the real-time rendering of the digital human's facial expressions and body movements.

[0025] As a preferred solution of the intelligent power virtual digital human interaction system based on autonomous decision-making according to the present invention, wherein: the first voice interaction module includes a multimodal interaction module, a speech synthesis module, and a voice communication module;

[0026] The multimodal interaction module is used to enrich the micro-expressions of the virtual digital human. The speech synthesis module is used to convert text information into voice output through speech synthesis technology. The voice communication module is used to communicate with the user by voice.

[0027] As a preferred solution of the intelligent power virtual digital human interaction system based on autonomous decision-making according to the present invention, wherein: the data management and processing module includes an intelligent power module, a data processing module, a data management module, and a data storage module;

[0028] The intelligent power module is used to monitor the operation status of power equipment and count the operation data of power equipment. The data processing module is used to preprocess the operation status of the power equipment and the counted operation data of the power equipment. The data management module is used to classify and manage the preprocessed data. The data storage module is used to store data.

[0029] As a preferred solution of the intelligent power virtual digital human interaction system based on autonomous decision-making according to the present invention, wherein: the digital human intelligent interaction system further includes an interface management module, a database, an input module, an understanding module, and a dialogue management module;

[0030] The database is used to store the data collected by the intelligent power module and the process logic data for the virtual data human to learn and use. The understanding module is used to deeply understand the user's input and convert the user's input into a semantic representation that the machine can process. The dialogue management module is used to generate responses and guide the progress of the dialogue according to the user's input and the system's knowledge base.

[0031] As a preferred solution of the intelligent power virtual digital human interaction system based on autonomous decision-making according to the present invention, wherein: the input module includes a manual input unit, a speech recognition unit, and a video capture unit;

[0032] The manual input unit uses a touch keyboard for text input. The speech recognition unit uses a microphone for text input. The video capture unit uses a capture camera to collect the user's body movements.

[0033] As a preferred solution of the intelligent power virtual digital human interaction system based on autonomous decision-making described in the present invention, where: the understanding module includes an emotion analysis unit, a lip shape capture unit, and a gesture capture unit. After identifying the instructions issued by the user, the understanding module understands and executes the received instructions.

[0034] Compared with the prior art, the beneficial effects of the present invention are:

[0035] The present invention provides an intelligent power virtual digital human interaction system based on autonomous decision-making, which ensures the security of data transmission by integrating advanced encryption technologies, enhances the autonomous decision-making ability of virtual digital humans by using machine learning and artificial intelligence algorithms, and realizes intelligent monitoring and prediction of power usage conditions and equipment operating states. This system can not only update and securely transmit power system data in real time, but also accurately capture user intentions through semantic understanding and intelligent logical reasoning, providing a vivid and realistic interaction experience. In addition, the system has a self-optimization function, which can continuously iterate and update according to feedback to improve decision-making accuracy; it realizes seamless integration with the existing power system, provides various application scenario supports including data consultation, troubleshooting, and intelligent control, greatly improves the efficiency and quality of power services, and meets the requirements of the power industry for high security and intelligent operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0037] Figure 1 It is a schematic diagram of the modules of the system according to an embodiment of the present invention;

[0038] Figure 2 It is a schematic diagram of some modules of the virtual digital human intelligent interaction system according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0039] In order to make the above objects, features, and advantages of the present invention more obvious and understandable, the specific embodiments of the present invention will be described in detail below with reference to the drawings of the specification. Obviously, the described embodiments are some embodiments of the present invention, rather than all embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0040] Example 1, refer to Figure 1An embodiment of the present invention provides an intelligent power virtual digital human interaction system based on autonomous decision-making, as follows Figure 1 Specifically, it includes a first recognition and processing module (recognition module, semantic understanding module, image processing module), an autonomous decision-making module, a scenario trigger and judgment module, a first voice interaction module (recognition module, semantic understanding module, image processing module), a data management and processing module (intelligent power module, data processing module, data management module, data storage module), and a communication module;

[0041] Specifically, the first recognition and processing module is used to convert the user's voice, gesture, and text inputs into information that can be processed by the digital human, and render its facial expressions and body movements in real time;

[0042] Specifically, the autonomous decision-making module is used to evaluate the information output by the first recognition and processing module, match scenarios according to the evaluation results, and execute the decision results;

[0043] Specifically, the scenario trigger and judgment module is used to trigger corresponding functional units according to the power system scenario, and start corresponding control strategies through data verification, auditing, and cross-verification in combination with the autonomous decision-making module;

[0044] Specifically, the first voice interaction module is used to convert the output result of the scenario trigger and judgment module into voice output to achieve voice communication with the user;

[0045] Specifically, the data management and processing module is used to process and classify and manage the operation data of power equipment;

[0046] Specifically, the communication module is used to provide a data transmission and communication environment for the digital human intelligent interaction system.

[0047] In the embodiment of the present application, the first recognition and processing module includes a recognition module, a semantic understanding module, and an image processing module; among them, the recognition module is used for speech recognition, converting the user's voice input into text information that can be understood by the digital human for the digital human to understand and process; the semantic understanding module is used for in-depth analysis of the voice and text input by the user, understanding the underlying intentions and emotions, and laying a foundation for subsequent conversations and exchanges; the image processing module is used to enhance the real-time rendering of the digital human's facial expressions and body movements.

[0048] It should be noted that the recognition module includes a speech recognition unit, a motion capture unit, and a machine translation unit; through the recognition module, signals such as voice, gesture, lip language, and different languages can be received, improving the intelligence of the virtual data human. The speech recognition unit includes noise reduction technology, which can reduce the interference of the surrounding environment on the speech recognition of the speech recognition unit.

[0049] In the embodiments of the present application, the autonomous decision-making module includes an attitude evaluation unit, a risk assessment unit, a scenario matching unit, a decision generation unit, a decision execution unit, and an iterative update unit;

[0050] Among them, the attitude evaluation unit is used to evaluate the speech rate and intonation in the data information, the risk assessment unit is used to conduct a risk assessment on the evaluated data, the scenario matching unit is used to match the scenarios of the risk-assessed data, the decision generation unit is used to generate a decision result after matching the corresponding trigger scenario, the decision execution unit is used to execute the decision result, and the iterative update unit is used to establish a real-time data update mechanism so that the information obtained by the digital human can timely reflect the actual changes.

[0051] In the embodiments of the present application, the scenario trigger and judgment module includes a scenario trigger module and a judgment module;

[0052] Specifically, the scenario trigger module includes a data consultation unit, a fault exclusion unit, an intelligent control unit, an intelligent prediction unit, an energy consumption unit, and a security defense unit;

[0053] Among them, the data consultation unit is used to match the data to be consulted or the corresponding device operation parameters in cooperation with the autonomous decision-making module when receiving a scenario that requires consulting power data or device operation parameters. The fault exclusion unit is used to conduct a fault investigation on the monitored intelligent power equipment in cooperation with the autonomous decision-making module when receiving a scenario where the user issues a fault exclusion instruction. The intelligent control unit is used to judge the correctness of the instruction in cooperation with the autonomous decision-making module when receiving a scenario where the user issues a device operation instruction. The intelligent prediction unit is used to start a triple decision-making mechanism in cooperation with the autonomous decision-making module when the intelligent inspection robot transmits abnormal data during the operation of the corresponding device. The energy consumption unit is used to start an adaptive control strategy in cooperation with the autonomous decision-making module when receiving a scenario where the sudden increase in the power generation of the corresponding power generation method causes grid frequency fluctuations. The security defense unit is used to immediately start an active defense mechanism in cooperation with the autonomous decision-making module when detecting an abnormal traffic attack on the power SCADA system.

[0054] Specifically, the judgment module includes a data verification unit, a data audit unit, a cross-verification unit, a data update unit, and a warning module;

[0055] Among them, the data verification unit is used to set strict verification rules for the collected, matched, and transmitted data. The data audit unit is used to establish a data audit system to track and audit the entire process of the data source, collection, processing, storage, and use. The cross-verification unit uses an integrated learning method to cross-verify the results processed by the scenario matching unit using a fusion model of different algorithms. The data update unit is used to establish a real-time data update mechanism. The warning module is used to cooperate with the speech synthesis module and the multimodal interaction module in the first voice interaction module for subsequent processing after the data is judged to be normal.

[0056] Specifically, the processing flow of the cross-validation unit includes:

[0057] Obtain the processed result from the scene matching unit as the input data set, and preprocess the input data set. Divide the preprocessed data set into a training set and a validation set;

[0058] Select several different machine learning or deep learning models (such as decision trees, neural networks, support vector machines) as the basic models, and use the training set to train each selected basic model;

[0059] Use each basic model to predict the data in the validation set to obtain multiple prediction results; Use the weighted average method to integrate the prediction results of each basic model;

[0060] Execute the cross-validation process, calculate the performance metrics of each iteration and summarize these results to evaluate the stability and generalization ability of the entire model; Based on the results of the cross-validation, evaluate the overall performance of the fusion model;

[0061] If the performance does not meet the expected standard, it is necessary to adjust the selection of the basic model, parameter configuration or fusion strategy, and repeat the above steps; If the model performs well, deploy it for actual data verification tasks.

[0062] In the embodiment of the present application, the first voice interaction module includes a multimodal interaction module, a voice synthesis module, and a voice communication module; Among them, the multimodal interaction module is used to enrich the micro-expressions of the virtual digital human, and the voice synthesis module is used to convert text information into voice output through voice synthesis technology, making the voice of the digital human sound natural and fluent; The voice communication module is used to communicate with the user through voice.

[0063] In the embodiment of the present application, the data management and processing module includes an intelligent power module, a data processing module, a data management module, and a data storage module; Among them, the intelligent power module is used to monitor the operating status of power equipment and count the operating data of power equipment, the data processing module is used to preprocess the operating status of power equipment and count the operating data of power equipment, the data management module is used to classify and manage the preprocessed data, and the data storage module is used to store data.

[0064] It should be noted that the intelligent power module can perform power automation regulation and power monitoring, build a smart grid, real-time monitoring and fault diagnosis, optimize resource allocation and personalized services, and improve power supply reliability and efficiency. The intelligent power module realizes the intelligent management and optimized scheduling of the power system by integrating artificial intelligence technology, improving the efficiency and quality of power services. The intelligent power module mainly includes the following aspects:

[0065] Intelligent Monitoring and Fault Diagnosis: By installing high-definition cameras and sensors on power equipment, images and operation data of the equipment are collected. Using image recognition and data analysis algorithms in machine learning, the operation status of the equipment can be monitored in real time, and potential faults such as overheating, discharging, and insulation aging can be accurately identified. Combining the data of voltage, current, power, etc. collected by sensors for comprehensive analysis, the fault trend of the equipment can be predicted in advance, providing timely warnings for maintenance personnel and avoiding power outages caused by sudden faults;

[0066] Optimized Scheduling and Supply-Demand Balance: In the aspect of optimized scheduling of the power system, artificial intelligence algorithms optimize the production and distribution of electricity according to various factors such as historical data, weather forecasts, and user demands. For example, through multiple deep learning algorithms, the electricity demand and the power generation capacity of renewable energy in the future period are predicted, and a reasonable power generation plan is formulated to improve energy utilization efficiency while meeting the demand and reducing operating costs;

[0067] Distributed Energy Management: For distributed energy systems, the AI intelligent microgrid system realizes the coordinated management and efficient scheduling of multiple energy sources, energy storage devices, and various loads through intelligent control and optimization algorithms. The system collects power data in real time, uses artificial intelligence algorithms for in-depth analysis and prediction, formulates a reasonable energy scheduling strategy in advance, gives priority to using renewable energy for power generation, and makes reasonable allocation when the power generation of renewable energy is insufficient;

[0068] Reactive Power and Voltage Control: In the reactive power control of the power system, artificial intelligence technology relies on the construction of an expert system with a comprehensive knowledge base and inference mechanism to process problems in the way of human thinking. Through the learning mode, the system can independently handle the loss problems in the operation process, improve the control accuracy, and reduce the losses in the power drive scenario;

[0069] Intelligent Customer Service System: The power intelligent customer service system adopts a three-layer architecture model, including a presentation layer, a logic processing layer, and a data layer. The presentation layer is responsible for the user interaction interface, the logic processing layer is responsible for business logic processing and algorithm application, and the data layer is responsible for data storage and management. The system integrates natural language processing and machine learning technologies to achieve intelligent dialogue interaction and automated processing, providing services such as power consultation, repair reporting, and complaints.

[0070] It should be noted that the data obtained by the intelligent power module is processed and managed through the data processing module and the data management module to facilitate the fast and secure transmission and storage of data. The semantic understanding module receives the original voice signals collected from the recognition module and performs preliminary processing, including filtering out interference factors such as high-frequency noise and clutter, and normalizing the signals to improve the signal quality and reduce the computational complexity in subsequent processing steps, facilitating the extraction of corresponding content from the voice.

[0071] In the embodiments of the present application, the communication module is used to provide a data transmission and communication environment, and the communication module can provide network services for the operation of the virtual digital human intelligent interaction system to facilitate data processing, transmission, and storage.

[0072] It should be noted that, as Figure 1 shown, the output end of the recognition module is connected to the input end of the semantic understanding module. A variety of data cleaning technologies are adopted to remove noise, outliers, and duplicate data in the data to ensure the accuracy and consistency of the data recognized by the recognition module. The output end of the semantic understanding module is connected to the input end of the speech synthesis module, the output end of the semantic understanding module is connected to the input end of the image processing module, the output end of the image processing module is connected to the input end of the autonomous decision-making module, the output end of the autonomous decision-making module is connected to the input end of the speech synthesis module, the output end of the autonomous decision-making module is connected to the input end of the scene triggering module, the output end of the scene triggering module is connected to the input end of the judgment module, the output end of the judgment module is connected to the input end of the multimodal interaction module, the multimodal interaction module and the speech synthesis module are connected to each other, the output end of the speech synthesis module is connected to the input end of the speech communication module, the output end of the attitude evaluation unit is connected to the input end of the risk assessment unit, the output end of the risk assessment unit is connected to the input end of the scene matching module, the output end of the scene matching module is connected to the input end of the decision-making generation unit, the output end of the decision-making generation unit is connected to the input end of the decision-making execution unit. The autonomous decision-making module also includes a feedback and optimization unit and an iterative update unit. The output end of the intelligent power module is connected to the input end of the data processing module, the output end of the data processing module is connected to the input end of the data management module, the output end of the data management module is connected to the input end of the data storage module, the data storage module and the speech synthesis module are bidirectionally connected. Data update unit: Establish a real-time data update mechanism to enable the information obtained by the digital human to timely reflect the actual changes in the power system and reduce decision-making errors caused by data lag. Early warning module: If the data judgment is abnormal, it is necessary to cooperate with the autonomous decision-making module to re-match and make decisions.

[0073] It should be noted that in order to improve the security and autonomy of the intelligent interaction data transmission between intelligent power and virtual digital humans, the virtual digital human intelligent interaction system is divided into an intelligent power module and an identification module. The intelligent power module conducts intelligent monitoring and prediction on the power usage situation and equipment operation situation. The obtained monitoring data is processed by the data processing module, then classified and managed by the data management module, and finally stored by the data storage module. When data needs to be extracted, the extracted text data is converted into sound through the speech synthesis module, and then communicated with the user in cooperation with the voice communication module. This process ensures the real-time update and secure transmission of the power system data. When conducting intelligent interaction with the virtual digital human, through the speech recognition technology of the identification module, the user's voice input is converted into text information for the digital human to understand and process. And the semantic understanding module deeply analyzes the text input by the user to understand the underlying intention and emotion, laying a foundation for subsequent conversations and exchanges. During the semantic understanding process, the image processing module vividly makes the virtual data human imitate thinking expressions or actions, making the virtual digital human more vivid and realistic. If there is a misalignment or ambiguity in semantic understanding, the corresponding rule words can be extracted through the speech synthesis module, and the ununderstood situation can be fed back to the user through the voice communication module. After semantic understanding, the data content is decision-making by the autonomous decision-making module. In this process, the attitude evaluation unit determines the task priority according to the user's needs and the scenario state. Then, the risk assessment unit evaluates the possible risks or conflicts brought by the current decision. Then, the scenario matching unit conducts scenario matching. After the matching is completed, the decision generation unit makes a strategy selection based on rules. Then, intelligent logical reasoning is used for rule matching to increase the correctness of the decision. Finally, the decision execution unit executes the decision and matches the corresponding scenario. In this process, the feedback and optimization unit in the autonomous decision-making module can monitor the execution effect, collect the user's behavioral responses to the virtual digital human, and evaluate the decision effect, recording successful and failed cases. Then, only by cooperating with the iterative update unit can the decision-making ability be continuously optimized according to the feedback data and the rule base of the autonomous decision-making module be updated regularly. After matching the corresponding scenario, such as data consultation, the corresponding rule results can be matched through the data consultation unit and displayed in the form of charts and voice explanations. In the fault troubleshooting scenario, the corresponding scenario is rule-matched and executed by the fault troubleshooting unit, and the corresponding code is displayed according to the troubleshooting result. In the intelligent control scenario, the received instructions are processed by the intelligent control unit to generate the code for controlling the operation of the equipment to achieve remote control of the power equipment operation. In the intelligent prediction scenario, the intelligent power equipment is evaluated and predicted by the intelligent prediction unit. After discovering problems, the abnormal fluctuation range is confirmed through comparison with historical data, and the remaining life is predicted by calling the equipment health assessment model. The fault development path is simulated in real time. When the predicted fault probability exceeds 90%,Cooperate with the autonomous decision-making module to automatically generate maintenance work orders, send alerts to the duty personnel through the virtual digital human, and at the same time trigger the standby equipment switching plan. In the energy consumption scenario, the energy consumption unit is used to allocate sudden power data fluctuations, calculate the network-wide moment of inertia in real time, call the optimal energy storage configuration model and generate second-level adjustment instructions. In the security defense scenario, the security protection unit is used to identify attack characteristics based on the behavior analysis model, automatically isolate the affected network segment, trigger the honeypot trapping system, and at the same time send alerts to the duty personnel through the virtual digital human. The processing results obtained when the scenario trigger module triggers the corresponding scenario are secondarily judged by the judgment module to ensure the correctness of autonomous decision-making and scenario triggering. After the judgment module completes the judgment and decision-making, the voice synthesis module extracts the data of the matching rules from the data storage module and converts it into voice, and then cooperates with the multi-modal interaction module and the voice communication module to communicate with the user in the form of voice for the synthesized data information. Through this system, the seamless integration of the virtual digital human intelligent interaction system and the existing power system is realized. At the same time, the data requirements and interface standards are defined, the system architecture is designed, the key function modules are developed, and the effective interaction of data between systems is realized. The security of the system is also considered, and corresponding measures are taken to protect the security during data transmission, meeting the requirements of the power industry for high security.

[0074] Example 2, referring to Figure 2 , based on the previous embodiment, this embodiment provides an intelligent power virtual digital human interaction system based on autonomous decision-making, further including an interface management module, a database, an input module, an understanding module, and a dialogue management module;

[0075] Specifically, the database is used to store the data collected by the intelligent power module and the process logic data for the virtual data human to learn and use; the understanding module is used to deeply understand the user's input and convert the user's input into a semantic representation that can be processed by the machine; the dialogue management module is used to generate responses and guide the progress of the dialogue according to the user's input and the system's knowledge base.

[0076] It should be noted that the database stores the data collected by the intelligent power module and the process logic data for the virtual data person to learn and use. The input module is responsible for receiving user inputs, which can be in various forms such as voice, text, image, etc. The input module converts the user inputs into a data format that can be understood by the machine and transmits it to the understanding module. The intelligent power database mainly includes the following types: Relational databases: such as MySQL, PostgreSQL, Oracle, etc. These databases are widely used because of their high data consistency, strong query ability, and support for complex transaction management. Relational databases can ensure data consistency and integrity, are suitable for processing a large amount of real-time and historical data, and meet the requirements of the stable operation and optimized management of the power system; NoSQL databases: such as MongoDB, Cassandra, HBase, etc. These databases have high scalability and high availability and are suitable for scenarios with a large amount of data and high-frequency data writing. In the power system, the data generated by smart grids and Internet of Things devices is huge. NoSQL databases can efficiently process this data through a distributed architecture and a flexible data model; Domestic databases: such as DM Data, KingbaseES, GBase, Shenzhou Universal, etc. These databases are also widely used in the power system. Especially in the intelligent grid dispatching technology support system D5000 of the State Grid, DM Data provides 80% of the database support.

[0077] In the embodiment of the present application, the input module includes a manual input unit, a voice recognition unit, and a video capture unit; among them, the manual input unit uses a touch keyboard for text input; the voice recognition unit uses a microphone for text input; the video capture unit uses a capture camera to collect the user's body movements.

[0078] In the embodiment of the present application, the understanding module includes an emotion analysis unit, a lip shape capture unit, and a gesture capture unit. The understanding module can collect data from multiple aspects and, after identifying the instructions issued by the user, understand and execute the received instructions.

[0079] It should be noted that through the emotion analysis unit analyzing the user's emotions and intentions, the virtual digital person can better understand the user's needs and provide more personalized services; the emotion analysis unit can capture the user's micro-expressions and can also add some micro-expressions to the virtual digital person to improve the intelligence level of the virtual digital person.

[0080] It should be noted that in order to achieve the seamless integration of the virtual digital human intelligent interaction system with the existing power system, the present invention adopts an interface management module that can set the interface according to requirements, and a transmission module for receiving information for the virtual digital human. The received data is understood and analyzed by the understanding module, and then the dialogue logic and mode are set through the dialogue management module. At the same time, the text data is extracted from the database by the speech synthesis module and converted into voice data, and finally the voice communication module is used to communicate with the user, so as to achieve the seamless integration of the virtual digital human intelligent interaction system with the existing power system through this system.

[0081] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be modified or equivalently replaced without departing from the spirit and scope of the technical solutions of the present invention, and they should all be covered by the scope of the claims of the present invention.

[0082] Although the preferred embodiments of the present application have been described, those skilled in the art can make additional changes and modifications once they learn the basic creative concepts. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0083] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application also intends to include these modifications and variations.

Claims

1. An intelligent power virtual digital human interaction system based on autonomous decision-making, characterized in that, The system includes a first recognition and processing module, an autonomous decision-making module, a scenario triggering and judgment module, a first voice interaction module, a data management and processing module, and a communication module; The first recognition and processing module is used to convert the user's voice, gesture, and text inputs into information that can be processed by the digital human, and render its facial expressions and body movements in real time; The autonomous decision-making module is used to evaluate the information output by the first recognition and processing module, match scenarios according to the evaluation results, and execute the decision results; The scenario triggering and judgment module is used to trigger corresponding functional units according to the power system scenario, and start corresponding control strategies through data verification, auditing, and cross-verification in combination with the autonomous decision-making module; The first voice interaction module is used to convert the output result of the scenario triggering and judgment module into voice output to achieve voice communication with the user; The data management and processing module is used to process and classify and manage the operation data of power equipment; The communication module is used to provide a data transmission and communication environment for the digital human intelligent interaction system.

2. The intelligent power virtual digital human interaction system based on autonomous decision-making according to claim 1, wherein The autonomous decision-making module includes an attitude evaluation unit, a risk evaluation unit, a scenario matching unit, a decision generation unit, a decision execution unit, and an iterative update unit; The attitude evaluation unit is used to evaluate the speech rate and intonation in the data information, the risk evaluation unit is used to evaluate the risk of the evaluated data, the scenario matching unit is used to match the risk-evaluated data with scenarios, the decision generation unit is used to generate decision results after matching the corresponding trigger scenarios, the decision execution unit is used to execute the decision results, and the iterative update unit is used to establish a real-time data update mechanism so that the information obtained by the digital human can reflect the actual changes in a timely manner.

3. The intelligent power virtual digital human interaction system based on autonomous decision-making according to claim 2, wherein The scenario triggering and judgment module includes a scenario triggering module and a judgment module; The scenario triggering module includes a data consultation unit, a fault elimination unit, an intelligent control unit, an intelligent prediction unit, an energy consumption unit, and a security defense unit; The data consultation unit is used to match the data or corresponding equipment operation parameters to be consulted in cooperation with the autonomous decision-making module in the scenario of receiving a request to consult power data or equipment operation parameters. The fault elimination unit is used to perform fault detection on the monitored intelligent power equipment in cooperation with the autonomous decision-making module in the scenario of receiving a fault elimination instruction issued by the user. The intelligent control unit is used to judge the correctness of the instruction in cooperation with the autonomous decision-making module in the scenario of receiving an equipment operation instruction issued by the user. The intelligent prediction unit is used to start a triple decision-making mechanism in cooperation with the autonomous decision-making module in the scenario where the intelligent inspection robot transmits abnormal data during the operation of the corresponding equipment. The energy consumption unit is used to start an adaptive control strategy in cooperation with the autonomous decision-making module in the scenario where the sudden increase in the power generation of the corresponding power generation method causes grid frequency fluctuations. The security defense unit is used to immediately start an active defense mechanism in cooperation with the autonomous decision-making module when detecting an abnormal traffic attack on the power SCADA system.

4. The intelligent power virtual digital human interaction system based on autonomous decision-making according to claim 3, wherein, The scenario triggering and judgment module includes a scenario triggering module and a judgment module; The judgment module includes a data verification unit, a data auditing unit, a cross-verification unit, a data update unit, and an early warning module; The data verification unit is used to set strict verification rules for the collected, matched, and transmitted data. The data auditing unit is used to establish a data auditing system to track and audit the entire process of the data's source, collection, processing, storage, and use. The cross-verification unit uses an integrated learning method to cross-verify the results processed by the scenario matching unit using a fusion model of different algorithms. The data update unit is used to establish a real-time data update mechanism. The early warning module, after the data is judged to be normal, cooperates with the speech synthesis module and the multimodal interaction module in the first voice interaction module for subsequent processing.

5. The intelligent power virtual digital human interaction system based on autonomous decision-making according to claim 1, wherein The first recognition and processing module includes a recognition module, a semantic understanding module, and an image processing module; The recognition module is used for speech recognition to convert the user's voice input into text information that can be understood by the digital human. The semantic understanding module is used to deeply analyze the user's spoken voice and input text to understand the underlying intentions and emotions. The image processing module is used to enhance the real-time rendering of the digital human's facial expressions and body movements.

6. The intelligent power virtual digital human interaction system based on autonomous decision-making according to claim 5, characterized in that, The first voice interaction module includes a multimodal interaction module, a speech synthesis module, and a voice communication module; The multimodal interaction module is used to enrich the micro-expressions of the virtual digital human. The speech synthesis module is used to convert text information into voice output through speech synthesis technology. The voice communication module is used to communicate with the user via voice.

7. The intelligent power virtual digital human interaction system based on autonomous decision-making according to claim 6, characterized in that The data management and processing module includes an intelligent power module, a data processing module, a data management module, and a data storage module; The intelligent power module is used to monitor the operating status of power equipment and statistically analyze the operating data of power equipment. The data processing module is used to preprocess the operating status of the power equipment and the statistically analyzed operating data of power equipment. The data management module is used to classify and manage the preprocessed data. The data storage module is used to store data.

8. The intelligent power virtual digital human interaction system based on autonomous decision-making according to claim 1, characterized in that, The digital human intelligent interaction system further includes an interface management module, a database, an input module, an understanding module, and a dialogue management module; The database is used to store the data collected by the intelligent power module and the process logic data for the virtual data human to learn and use. The understanding module is used to deeply understand the user's input and convert the user's input into a semantic representation that can be processed by a machine. The dialogue management module is used to generate responses and guide the progress of the dialogue based on the user's input and the system's knowledge base.

9. The intelligent power virtual digital human interaction system based on autonomous decision-making according to claim 8, characterized in that, The input module includes a manual input unit, a voice recognition unit, and a video capture unit; The manual input unit uses a touch keyboard for text input. The voice recognition unit uses a microphone for text input. The video capture unit uses a capture camera to collect the user's body movements.

10. The intelligent power virtual digital human interaction system based on autonomous decision-making according to claim 9, wherein The understanding module includes an emotion analysis unit, a lip movement capture unit, and a gesture capture unit. After recognizing the instructions issued by the user, the understanding module understands and executes the received instructions.

Images