3964 results about "Data profiling" patented technology

The various embodiments herein provide a system and method for networked digital twins with autonomous collaborative decision-making. The system comprises a Digital Twin Engine for real-time data acquisition, model synthesis, and simulation, an AI Module for advanced data analysis, an autonomous collaborative decision-making module for optimized decision-making, a communication layer for secure data exchange, and supporting modules for coordination, storage, security, and user interaction. The method for generating and deploying digital twins comprises data collection, transmission, preprocessing, model synthesis, simulation, validation, and deployment. The method for networking and collaboration comprises AI-based data processing, complex event processing, autonomous decision-making, task distribution, decision communication, real-time monitoring, and continuous improvement. This system enhances operational efficiency, scalability, and security, reducing the need for human intervention and providing a comprehensive management solution for complex systems.

The invention discloses an interactive data insight system based on a large language model. The interactive data insight system comprises an intention recognition and classification module, an entity extraction module, an entity and business term alignment module, an SQL generation module and a structured query verification module. The key technical problems that an existing natural language data analysis system is insufficient in semantic understanding, inaccurate in entity alignment, weak in multi-round dialogue support, unstable in SQL generation, lack of safety and the like can be solved, semantic understanding and natural language interaction of complex business data are achieved, the data analysis threshold is greatly reduced, and the data analysis efficiency is improved. And the query efficiency and the result controllability are improved.

The invention discloses a data security protection method and system combined with big data analysis, and relates to the field of data security protection, and the method comprises the steps: building a multi-dimensional data collection and fusion data set according to API access records, external threat intelligence and context metadata association data; based on an isolated forest algorithm, calculating a sample path length to evaluate a behavior anomaly probability score; risk indexes of external threats, data sensitivity and permission exceptions are quantified respectively; constructing a data security risk comprehensive assessment model based on a weighted summation algorithm, and updating and optimizing the weight in the model by using a gradient boosting tree algorithm; and according to an output result of the data security risk comprehensive assessment model, setting a security risk level, and according to the security risk level, dynamically responding to a protection measure. The method has the advantages that continuous and dynamic risk assessment and automatic response to third-party data access behaviors are realized by fusing multi-source data and an intelligent algorithm.

The invention discloses a dynamic portrait construction method and system fusing a large model and user behavior data, belongs to the technical field of artificial intelligence and big data analysis, and aims to solve the problems of insufficient real-time performance, difficulty in multi-source data integration and high privacy risk in the traditional technology. The method comprises the following steps: collecting basic attributes, behavior sequences and unstructured data by burying points, and processing through an Apache Flink session window and a dynamic watermark; multi-modal feature extraction (discrete feature embedding, bidirectional LSTM coding behavior sequence and BERT coding text) is carried out, and joint embedding is generated through cross-modal contrast learning; generating three types of labels, namely a static label (rule engine), a dynamic label (1.3 B parameter quantity Nano-vLLM) and a predictive label (XGBoost), and dynamically adjusting weights; and realizing global model updating through federated learning and differential privacy. The system comprises a data acquisition layer, a feature extraction layer and a label generation updating layer. The real-time performance and accuracy of the portrait are improved, the privacy of the user is protected, and the commercial value in e-commerce, finance and other scenes is remarkable.

Methods and systems for a monitoring system for data collection in an industrial environment including a data collector communicatively coupled to a plurality of input channels connected to data collection points operationally coupled to at least one industrial component in at least one of an industrial boiler system or industrial pipeline system; a data storage structured to store a library of stored noise patterns associated with operation of the at least one industrial component; a data acquisition circuit structured to interpret a plurality of detection values from the collected data; and a data analysis circuit structured to: analyze the collected data, determine a measured noise pattern for the at least one industrial component, and compare the measured noise pattern to the library of stored noise patterns to identify a changed condition of the at least one industrial component.

Methods, systems, and computer storage media for providing a modular cybersecurity platform are described. The modular cybersecurity platform is implemented using a modular cybersecurity engine that operates based on an analytical framework for dynamic data analysis and data management in a data intelligence system. In particular, the analytical framework is based on complementary modular components that are designed to interoperate in the modular cybersecurity engine. The modular cybersecurity engine includes a modular distributed system, a credential detection system, and a credential semantic graph system. The modular cybersecurity engine supports cybersecurity and sensitive data management scenarios that can empower investigators in various investigations, and provide automated flows that are highly scalable and support different types of functionality (e.g., priority embedding pipeline, credential scanning, and credential semantic graph analysis). The utility of the modular cybersecurity engine is demonstrated by its wide-ranging application in addressing complex cybersecurity challenges and sensitive data management tasks.

The invention discloses a phi-OTDR optical cable fault diagnosis method and system based on multi-channel topological data analysis, and is applied to the technical field of optical fiber sensing and intelligent operation and maintenance. The method comprises the following steps: acquiring a backward Rayleigh scattering signal of a sensing optical cable to obtain a spatio-temporal data matrix; preprocessing and multi-scale slicing are carried out to obtain spatio-temporal data segments, and initial position information based on the optical time domain reflection principle is added to each spatio-temporal data segment; different types of spatio-temporal data fragments are routed to corresponding topology analysis channels for parallel processing; extracting topological features and positioning information, and fusing the topological features and the positioning information to form optical cable full-state vectors; and outputting a diagnosis result based on the pre-trained intelligent diagnosis model, wherein the diagnosis result comprises a fault type, accurate position information and a health degree evaluation result. According to the method, the positioning robustness in a strong noise environment is effectively improved, and accurate fault classification and early capture and early warning of progressive performance reduction of the optical cable are realized.

The invention relates to the technical field of big data analysis, and discloses a prospecting target area positioning method and system based on big data, and the method comprises the steps: collecting multi-source exploration data in real time through distributed nodes, completing coordinate normalization, semantic alignment and time synchronization through a spatial heterogeneous data flow engine, and generating a standardized incremental data block; performing local feature sensitivity analysis based on the historical model library, identifying a newly added feature dimension, and performing parameter increment updating by adopting a sliding window gradient descent method; inputting the updated model into a target evolution model driven by a Bayesian space-time probability field, and dynamically calculating the metallogenic probability of each space grid in combination with a stress field, an element migration path and historical verification data; and generating high, medium and low three-level target area maps according to probability sorting, and pushing the high, medium and low three-level target area maps to a three-dimensional visual decision terminal. According to the method, minute-level dynamic response of the target region under triggering of newly-added data is realized, computing resource consumption is reduced to be less than 5% of that of an original system, and prospecting efficiency and abnormal region identification timeliness are improved.

The invention relates to the technical field, and discloses a power distribution network multi-time scale fault scene deduction method comprising the following steps: obtaining meteorological and power grid operation data, establishing a time sequence fault tree model, and analyzing the trigger probability of multi-line disconnection and rainstorm short circuit faults in a target time period; extracting cross-level fault propagation features, analyzing a dynamic coupling relationship among multi-line disconnection, transformer substation flooding and cascading trip, forming a fault feature mode set, and identifying a single fault and a cascading fault in combination with time sequence analysis; historical fault data are analyzed, time sequence features and topological features of single and cascading faults are extracted, if a single fault propagation path is in a single level, a support vector machine is used for being combined with the features to judge fault types, and a classification result is output; and performing anomaly detection and confidence evaluation on a fault classification result, outputting a fault evolution path and risk evaluation, and analyzing the contribution degree of cascading trip to a large-area power failure risk in combination with historical blackout data to obtain power failure risk probability distribution.

The invention relates to the technical field of fund information management, in particular to a fund exchange information management system based on big data analysis. The system comprises a multi-source heterogeneous data acquisition and fusion module, an enterprise dynamic behavior portrait construction module, a hidden association network mining module and a trade background authenticity dynamic evaluation module. The method comprises the following steps: firstly, collecting and processing data from a plurality of data sources to generate a fused fund exchange record; constructing an enterprise dynamic behavior portrait based on the record; furthermore, a hidden association network graph is constructed based on the data, the data are received at the same time, the transaction behavior deviation degree is identified through behavior consistency check, fund closed-loop analysis is carried out on abnormal transactions, and finally a trade background authenticity index and a risk decision signal are generated. According to the invention, dynamic evaluation and risk early warning of supply chain financing trade background authenticity are realized, and the risk control capability of a financial institution is effectively improved.

The invention discloses an AI knowledge base retrieval method and system based on context awareness and dynamic fusion, belongs to the technical field of artificial intelligence, and aims to solve the technical problems of insufficient context understanding, weak model adaptability and low retrieval precision in a traditional retrieval method. Comprising the steps of collecting and preprocessing multi-dimensional context data; obtaining a context analysis result comprising a query semantic vector, a query intention type, a scene demand weight vector and a user preference model; constructing a plurality of basic retrieval models and registering metadata for each basic retrieval model; on the basis of context analysis results, the fusion weight of each basic retrieval model is calculated through a multi-factor decision algorithm, and the initial retrieval results are fused and sorted; and carrying out iterative optimization on a model algorithm involved in context data analysis and parameters of each basic model based on interaction feedback data of a user on a retrieval result.

The invention relates to the technical field of financial data analysis and artificial intelligence, in particular to a multi-source heterogeneous financial data fusion and intelligent analysis system which comprises a data standardization processing module, a time sequence event fusion module, a knowledge graph construction module, a relation reasoning module and a self-adaptive anomaly detection module. The data standardization processing module is used for converting heterogeneous financial data from different sources into unified tensor representation; the time sequence event fusion module adopts a double-clue cooperation mechanism to establish a mapping relation between continuous time sequence data and discrete events; the knowledge graph construction module extracts financial entities and relationships thereof, and constructs a multi-level knowledge graph; the relation reasoning module performs deep reasoning based on a graph attention mechanism; and the adaptive anomaly detection module dynamically adjusts the detection threshold according to the market environment. According to the system, implicit association in heterogeneous financial data can be deeply mined, market anomalies are recognized in advance, and comprehensive support is provided for financial decision making.

The invention relates to the field of data analysis, and discloses a financial statement dynamic analysis system based on multi-agent collaboration, which comprises a data input module, a preprocessing module, a data analysis module and a diagnosis output module, the data analysis module performs multi-dimensional parallel analysis from numerical trend, text semantics and business rules through cooperative work of a time sequence prediction agent, a text evaluation agent and a rule reasoning agent, and provides reference support by relying on a knowledge base; and the diagnosis output module synthesizes conclusions of the agents to generate a comprehensive financial risk index and judges a risk state. According to the method, the deterioration trend intensity value is calculated by monitoring the comprehensive financial risk index in the continuous report period, and the analysis granularity of the intelligent agent is evaluated according to the dynamic regulation and control text. Besides, for the identified significant risks, the system can automatically position key financial indexes and associated risk roots through an iterative positioning method in cooperation with numerical anomaly and text risk events.

The invention provides a power consumption feature extraction method and system for a static random access memory standard cell library, electronic equipment and a storage medium, and the method comprises the steps: S1, reading a standard cell model file, a standard cell netlist and a standard cell time sequence path of a static random access memory, and constructing and generating an excitation waveform description file; s2, establishing a simulation file of the static random access memory standard unit, simulating the static random access memory standard unit, and respectively obtaining electrical characteristic data of an input pin and an output pin of the static random access memory standard unit; s3, analyzing the electrical characteristic data of the static random access memory standard unit, and obtaining a short-circuit power consumption time sequence path and a switching power consumption time sequence path existing in the static random access memory standard unit; and S4, respectively calculating power consumption values of each switching power consumption time sequence path and each short-circuit power consumption time sequence path. According to the method, the power consumption characteristics of the SRAM standard cell are extracted in the design stage of the standard cell library, and the precision and efficiency of power consumption analysis can be improved.

The invention relates to the field of drawing recognition, in particular to a PDF drawing data extraction method and system based on intelligent recognition. Comprising the following steps: reading an internal structure of a PDF engineering drawing to obtain a native text stream, a vector path and a grating image; identifying the native text flow through a shunt preprocessing framework to form structured text data; rendering the vector path and the grating image to obtain a background image; analyzing the structured text data by utilizing the intelligent recognition model through the character recognition and extraction sub-model, obtaining drawing metadata and recording the position, and obtaining a character recognition result; analyzing the background image through a graphic element recognition and classification sub-model, recognizing and classifying component elements, and obtaining a graphic recognition result; and performing fusion according to the visual space corresponding relation to form a drawing analysis result. According to the method, the adaptive capacity of engineering drawings with various sources and different qualities is improved through the shunting preprocessing framework and the intelligent identification model.

Systems and methods for interfacing with data profilers using a machine learning model. In some aspects, the system receives a data profiler configured to create and interface with a plurality of data profiles. The system trains a profile query model to generate responses to user queries relating to data profiles. The system receives a user query concerning data profiles associated with the data profiler. Using an interpretation model, the system pre-processes the user query and data profile attributes to determine an activation pattern for the profile query model. The system uses the profile query model to process the user query and the data profile attributes of the data profiler and generate a preliminary response. The system post-processes the preliminary response to generate a verified response by applying a corrective program. The system then transmits the verified response in a conversational program related to the user query.

In one example, a method performed by a processing system including at least one processor includes automatically inferring metadata about a structured query language database, constructing, based on the metadata, a prompt for generating a new structured query language query to be executed against the structured query language database, and providing the prompt to a language model for use in generating the new structured query language query.

The invention discloses a medical informatization data intelligent analysis system based on a large model, and belongs to the technical field of medical informatization and artificial intelligence, and the system comprises a data collection and standardization module, a medical knowledge graph construction module, a knowledge enhancement inference analysis module, a data quality evaluation module and a structured output module. The system collects multi-source heterogeneous medical data from an electronic medical record system, a laboratory information system, a medical image information system and a hospital information system, performs standardization processing, automatically constructs a medical knowledge graph, and performs intelligent analysis and reasoning on the medical data by using a knowledge retrieval enhanced medical field large language model. Meanwhile, the data quality is evaluated in four dimensions of integrity, accuracy, timeliness and relevance, and finally a structured analysis report is generated. The multi-source medical data can be effectively integrated, the accuracy and interpretability of medical data analysis are improved, and intelligent support is provided for clinical decision making.

The invention relates to a data query method and system, computer equipment and a readable storage medium. The method is applied to a data query system, the data query system comprises an interaction module, a plurality of query engines, a distributed storage module and an analysis module, and the method comprises the steps that after the interaction module obtains a query condition input by a user and at least one target query engine selected by the user from the plurality of query engines, the target query engine is stored in the distributed storage module; converting the query condition into a target query statement, and sending the target query statement to each target query engine; each target query engine queries from the distributed storage module based on a dynamic pruning strategy according to the target query statement to obtain an initial query result; and the analysis module processes the initial query result queried by each target query engine based on a vectorization acceleration calculation strategy to obtain a target query result. By adopting the method, the query speed can be increased.

The invention discloses a financial monitoring system based on real-time data processing and intelligent analysis, and relates to the technical field of financial information, and the system comprises a bill collection module which employs a configuration API interface, carries high-concurrency data streams through a distributed message queue, carries out the real-time connection of an upstream business system and a financial system, and receives bill detail data; and the analysis and check task arrangement module manages the task dependency relationship based on a directed acyclic graph model, and arranges a data pulling task, a bill general task and a bill check task according to a preset rule. According to the financial monitoring system provided by the invention, the automation and intelligence level of financial management is remarkably improved by integrating real-time data processing and intelligent analysis technologies, the system adopts a configured API interface and a distributed message queue, efficient butt joint with an upstream business system and a financial system is realized, and the financial management efficiency is improved. The real-time performance and accuracy of data receiving are ensured, and the data processing flow is more flexible and controllable.

The invention relates to the technical field of power distribution lines, in particular to a power distribution line abnormal line loss analysis and treatment method and system, and the method comprises the following steps: synchronously extracting real-time monitoring data and historical data based on a power distribution line network, carrying out the data alignment and data cleaning, screening features associated with current leakage and voltage drop, and carrying out the analysis and treatment of the abnormal line loss of the power distribution line. Comprising load change rate and temperature fluctuation. According to the invention, through application of real-time and historical data analysis, the detection and management efficiency of the abnormal line loss of the distribution line is improved, the accuracy of data processing is improved through synchronous extraction and data alignment, early recognition of abnormal modes is allowed, the possibility of energy loss and unplanned power failure is reduced, and through adoption of Fourier transform and wavelet transform, the detection efficiency of the abnormal line loss of the distribution line is improved. According to the method, abnormal signals are accurately recognized, the analysis capability of the signals is enhanced, the accuracy of abnormal detection is improved, fault positioning and maintenance plan making are effectively optimized through combination of the GIS system, and the pertinence and efficiency of maintenance work are remarkably improved.

The invention discloses a method and system for privacy data protection in a big data analysis process, and relates to the technical field of civil aviation data security and privacy protection, and the method comprises the steps: obtaining civil aviation multi-source heterogeneous data, extracting passenger identity features, travel track features and consumption behavior features, and generating a structured feature matrix; extracting an association relationship between fields through a convolutional neural network, calculating a field sensitivity initial value, generating a field sensitivity weight in combination with a field uniqueness index and the sensitivity initial value, and generating a privacy level mapping table containing the field sensitivity weight according to the sensitivity weight; calculating query sensitivity and a privacy budget parameter, generating a differential privacy noise parameter and a homomorphic encryption key, and generating a hierarchical protection strategy; performing noise injection and ciphertext conversion on the original data to generate a desensitized data set; passenger flow statistics is executed through secret state calculation, and a public analysis result is generated. Over protection of low-sensitivity data is avoided, and sufficient safety of high-sensitivity data is ensured.

The invention discloses a production control management system for ultrathin stones, which mainly realizes intelligent management and control of the whole production process of the ultrathin stones and solves the problems of unstable quality and low efficiency in traditional production. The system comprises eight core units, namely a process parameter configuration unit, a grinding control unit, a fusion layer formation control unit, a thickness monitoring unit, a standing curing monitoring unit, a quality detection unit, a data recording and tracing unit and a central control unit, and the units are electrically connected and coordinated to construct a whole-process closed-loop management and control system. The system adopts technologies such as an intelligent algorithm, deep learning, machine learning, image recognition and big data analysis. A process parameter configuration unit generates an adaptive scheme in combination with raw material fluctuation; the grinding and fusion layer control unit corrects equipment parameters in real time and detects abnormity; the thickness monitoring and standing curing unit accurately regulates and controls the thickness and the curing environment; the quality detection unit is used for realizing defect classification and performance pre-judgment; and the data recording and tracing unit is associated with the whole-process data through the unique identifier.

The invention relates to the technical field of water supply network monitoring, and discloses a water supply network leakage monitoring and positioning system and method based on big data analysis, and the method comprises the steps: obtaining continuous audio stream data and network topological graph data collected by a distributed sensor, and calculating background baseline parameters; performing multi-scale wavelet transform decomposition on the current audio frame, calculating an energy entropy feature and generating a single-frame abnormal score; applying a cumulative sum control chart algorithm to output a cumulative abnormal index; generating an enhanced anomaly score through a graph attention network; and performing leakage judgment and positioning based on the abnormal scores of the multiple sensors. The technical problem that weak leakage signal detection sensitivity is low is solved.

The invention discloses a computing power resource dynamic analysis system and method based on big data, and relates to the technical field of data analys.The method comprises the steps that operation records in a training period are collected, user scores of the operation records are calculated, and user levels corresponding to the operation records are determined based on the range of the user levels; calculating a task score according to a task scoring model corresponding to the user level, calculating a predicted value of a platform index through a platform index prediction model, and generating a regulation and control strategy model in combination with the task score, the platform index and a platform regulation and control strategy; newly uploaded task content is collected in real time, predicted values of real-time task scores and platform indexes are calculated according to a task scoring model and a platform index prediction model, a real-time platform regulation and control strategy is obtained through generation of a regulation and control strategy model and calculation, the platform is adjusted, and the computing power resource utilization rate and the task execution efficiency are improved.

The invention discloses a multi-modal medical data fusion and analysis method, which is applied to the technical field of medical informatization and comprises the following steps: acquiring multi-modal medical data; wherein the multi-modal medical data comprises structured data, unstructured data and semi-structured data generated in the diagnosis and treatment process of the patient; structural data features are extracted by adopting an optimized Z-score standardization formula; using sparse attention CNN to extract unstructured data features; deepening diagnosis and treatment semantic association by adopting a Transform encoder and entity embedding fusion form, and extracting semi-structured data features; multi-modal data are fused through closed-loop design of coding dimension reduction integration, decoding reconstruction verification, exclusive loss optimization and feature standardization output, and a feature relevance verification mechanism is fused; and matching the fused multi-modal data with a data analysis task, and performing task analysis and mining. According to the invention, efficient and reliable technical support is provided for medical digital transformation and precise diagnosis and treatment.

The invention relates to the technical field of medical big data analysis, and discloses a hospital medical record data anomaly analysis method based on big data. According to the method, multi-source medical record data including diagnosis and treatment event records, nursing operation sequences and patient sign monitoring streams in a hospital information system are collected, and structured reforming is carried out. And constructing a medical record element interaction graph based on the reformed data, and detecting an abnormal state conduction path between the data elements through the graph model. And performing hierarchical traceability calculation according to the detected conduction path, positioning an abnormal source and generating a positioning report, and finally outputting a calibration instruction set according to the report. According to the method, the abnormal conduction chain is systematically identified from the correlation perspective, and the root source of the abnormality can be automatically and accurately traced, so that the logicality and the positioning accuracy of the medical record data abnormality analysis are improved.

The invention provides an interactive multi-dimensional data visualization display sand table and method for business data analysis, and the method comprises the steps: carrying out the semantic mapping of state parameters in an interaction control operation when the interaction control operation is received, obtaining a plurality of pieces of visualization intention metadata, and generating a structured query instruction; based on the structured query instruction, extracting a target data subset rendered visually by the heterogeneous commercial data source from a multi-dimensional data cube of the commercial data source, performing visual optimization on the visually rendered chart type, the visual coding channel and the initial visual parameter through the cardinal number of the dimension field in the target data subset and the data distribution type and the numerical range of the measurement field to obtain a visual configuration set of the target data subset; and using the visualization configuration set to render and generate a multi-dimensional data visualization view, and outputting and displaying the data visualization view in a graphical user interface. Based on the scheme, automatic closed loop generation from heterogeneous data to interactive views can be realized.

The invention discloses a method and system for screening drug targets with space-time specificity and computer equipment, and relates to the technical field of bioinformatics and computational biology. The screening method is based on single cell transcriptome sequencing data, and comprises the following steps: (1) quantitatively reconstructing spatial positioning and functional modes of cells in tissues, namely 1.1) carrying out data preprocessing on the single cell transcriptome sequencing data; 1.2) reconstructing the spatial positioning of the single cell; 1.3) reconstructing a single cell biological function mode; (2) screening a drug target with space-time specificity, wherein the screening comprises the following steps: 2.1) cell-cell communication analysis; the invention discloses a single-cell data analysis method based on a GRN (Gene Regulatory Network), which is characterized by comprising the following steps of (1) establishing a single-cell data analysis method, (2) establishing a GRN (Gene Regulatory Network) taking a specific tissue microenvironment state as a core, and (3) discovering a target spot. The single-cell data analysis method is innovative, provides a new thought and a technical path for research and development of drugs for metabolic diseases and other systemic diseases, and has a popularization and application basis.

The invention discloses a motor test bench system, which comprises a hardware system architecture and a software system architecture, wherein the hardware system architecture comprises a mechanical load and sensing unit, a centralized power supply and excitation unit, a data acquisition and control center and an upper computer system; the software system architecture comprises a unified data layer, an automatic control layer, a dynamic load regulation layer, a full-automatic test sequence layer, a man-machine interaction layer, a data analysis and report layer and a collaborative development interface; the problems that an existing test bench is single in signal collection, incomplete in information collection and poor in data synchronism; the load cannot be dynamically changed in real time; and high-order test data results are poor in visualization and cannot be directly converted into test reports.