1428 results about "Datawarehouses" patented technology

The invention relates to a method convenient for data consanguinity collection and analysis, which comprises the following steps of: obtaining original consanguinity data comprising a task execution log, application metadata and a cross-system dependency relationship, and carrying out standardization processing on the original consanguinity data to generate structured consanguinity information comprising an asset unique identifier, an upstream and downstream association relationship and a data operation type; structured consanguinity information is synchronously written into a graph database and a distributed data warehouse, the graph database stores real-time association topology, the distributed data warehouse stores full-amount historical versions, and a transaction consistency algorithm is adopted to ensure the atomicity of double-write operation, so that the data storage efficiency is improved. Single-asset-level consanguinity tracking is performed based on real-time topology of a graph database, global consanguinity analysis is performed based on batch computing power of a distributed data warehouse, a direct dependence path, a deep association network and a closed-loop link detection result are generated, and a closed-loop management mechanism from data acquisition, analysis to optimization is formed. And the problem that an analysis result is disjointed from an acquisition end in a traditional scheme is solved.

The invention discloses a DDGS three-dimensional storage device based on PLC control and a management method of the DDGS three-dimensional storage device, relates to the technical field of intelligent storage management, and solves the problems that in traditional DDGS feed storage, the storage space utilization rate is low, the storage turning cost is high, risk control is not timely, and a quick response strategy is lacked. According to the method, the dynamic perception metadata warehouse is constructed, and DDGS material characteristic key data is monitored in real time to support anomaly detection; a storage control topology model is generated by using a graph theory modeling and dynamic attribute injection method to map an exception type; periodically collecting equipment data and fusing and updating a storage state; state diagram nodes are enhanced, risk response priorities are calculated, and grading operation is triggered; pLC control logic is dynamically adjusted based on historical data, and real-time monitoring and multi-device linkage control are achieved; the intelligent level of DDGS three-dimensional warehouse management is remarkably improved, the warehouse space utilization rate is increased, and the risk control capability is enhanced.

The invention relates to the technical field of data processing, and discloses a cross-border e-commerce commodity recommendation system and method based on multi-source data fusion. The system comprises an acquisition module for performing data acquisition to obtain a cross-border unified data warehouse and federal learning cooperation data; the classification module performs text classification processing to obtain a user preference analysis result and an interpretable attention mark; a quantization module carries out quantization processing to obtain a cross-border selection feature matrix; the fusion module carries out weighted fusion processing to obtain a basic comprehensive score and a weight convergence detection result; the evaluation module performs risk evaluation processing to obtain risk probability distribution and cross-border compliance evaluation results; and the sorting module carries out real-time processing through lightweight preprocessing and a flow-type calculation pipeline to obtain a comprehensive score sorting list of cross-border selected products. The problem that a traditional cross-border e-commerce product selection method cannot effectively integrate multi-source heterogeneous data and cannot analyze user feedback text semantic information is solved.

Embodiments of this application provide a battery fault detection system and method, and a device. The system includes: a first data warehouse, configured to store battery historical operation data; a fault detection module, configured to acquire corresponding battery historical operation data from the first data warehouse for feature extraction to obtain corresponding fault detection feature data; a batch computing module, configured to perform batch computing on the fault detection feature data through a batch computing engine to obtain corresponding intermediate parameters; and a stream computing platform, configured to acquire the intermediate parameters and battery real-time operation data in real time through a stream computing engine for fusion computations to obtain a fault detection result of a corresponding battery.

The present disclosure relates to cyber-attack mitigation, information theoretic security in-motion, at-rest and storage intrusion mitigation with exclusive-path, content routing across an overlay network. Overlay network built upon Data Transport Controllers (DTC), SG nodes and SV nodes. System modules are deployed across various geo locations in a Wide Area Network, operating at the control of Universal Security Controller (USC). USC extracts system, security and storage activity telemetry data from Secure Vaults, Storage Gateways and Data Transport Controllers to orchestrate Autonomous Security Operations. SG nodes create SP fragments and store in SV nodes upon a data input operation. USC initiates an Exclusive-path content forwarding from the first SG node, across the DTC overlay through an exclusive list of DTC nodes and move it to second SG node. USC keeps the security control of SG nodes, DTC nodes and SV nodes and realize multi-vectored storage security at-rest and in-motion. SG nodes are connected to SV nodes which are micro-segmented, data vaults with restricted network reachability.

The invention provides a distributed storage and data warehouse permission synchronization method and system, and relates to the technical field of permission management, and the method comprises the steps: analyzing user operation data of distributed storage, training a machine learning model, and generating a directory permission intelligent mapping table; analyzing the structure information of the data table in the data warehouse, and generating a multi-dimensional table authority evaluation model; generating a self-adaptive permission rule base by combining the two, and deploying the self-adaptive permission rule base to each node of distributed storage; when the permission is changed, the system calculates an influence range according to the self-adaptive permission rule base and generates a permission updating instruction sequence; and the system monitors the instruction execution state, identifies abnormal nodes, and performs repair based on the permission propagation tree to ensure the permission consistency. According to the method, automatic synchronization of distributed storage and data warehouse authority can be realized, the authority management efficiency is improved, the manual intervention cost is reduced, and the data security is enhanced.

Optimizing data warehouse utilization by a data ingestion pipeline, including: gathering information describing usage of a plurality of data warehouses; receiving, from a data ingestion pipeline, a request for a data warehouse to receive data from the data ingestion pipeline; selecting, based on the information, the data warehouse from the plurality of data warehouses; and providing, to the data ingestion pipeline, an indication of the data warehouse.

Aspects of the disclosure are directed to integrating one or more large language models (LLMs) into a cloud database platform, such as a data warehouse. Users of the cloud database platform can provide queries to instruct one or more LLMs to perform generative natural language processing tasks by manipulating or generating text directly in the cloud database platform with a table valued function. Users can provide input to register or generate one or more LLMs of the cloud database platform for performing the natural language processing tasks. Integrating LLMs into the cloud database platform can improve processing capabilities of the LLMs and save computing resources, as specialized LLMs or application-specific API may no longer be necessary.

The invention relates to a building module data interface intelligent monitoring system based on the Internet of Things and a deployment method, and belongs to the technical field of building information monitoring. The system is composed of a distributed sensing unit, an edge computing gateway, a cloud platform and a visual terminal, a self-adaptive filtering algorithm and an abnormal mode recognition model are built in the edge computing gateway, the cloud platform adopts a time sequence database to construct a multi-dimensional data warehouse, and structural health degree evaluation is carried out by fusing an LSTM neural network and a random forest algorithm. The deployment method comprises the steps of optimizing a sensor distribution strategy based on a BIM model, establishing a wireless Mesh ad hoc network communication architecture, and configuring a grading early warning mechanism and a fault tracing function. The innovation point is that a dynamic threshold adjustment algorithm and an interface performance degradation prediction model are provided, and real-time monitoring of the connection state of the building module and life prediction are realized. The system has the advantages of flexible deployment, high detection precision and low maintenance cost, and the intelligent level of building structure safety monitoring is effectively improved.

The invention relates to the technical field of data sharing, and discloses a multi-department data sharing method and device, equipment and a storage medium. The method comprises the following steps: carrying out acquisition and standardized preprocessing on multi-department data required by enterprise project application to generate an intermediate data packet; establishing an event trigger distributed data control mechanism based on the intermediate data packet, calculating a dynamic trigger threshold, monitoring data change, and generating a target control data stream; performing template-free adaptive learning to generate an optimal data processing flow definition file; executing data classification, self-adaptive compression and increment processing at the edge computing node to generate an optimized data packet and metadata thereof; and inputting the optimized data packet and the metadata thereof into a SaaS cloud server central data warehouse to generate a project declaration data packet, thereby realizing consistency coordination and conflict automatic resolution of data of multiple departments, and realizing unified access and standardized processing of heterogeneous data sources.

The invention belongs to the technical field of data management, and particularly relates to a block chain-based heterogeneous data source right confirmation method, which comprises the steps of multi-source heterogeneous data acquisition, digital fingerprint generation, block chain hash anchoring, data storage and circulation and ownership tracing and verification. According to the invention, original data is collected from various terminals and system platforms by adopting a multi-source heterogeneous data acquisition technology so as to ensure the diversity and universality of data sources, and the collected original data is processed and unique digital fingerprints are generated. The method comprises the following steps: processing a digital fingerprint through a hash algorithm to generate a corresponding block chain hash value, anchoring the block chain hash value on a block chain, ensuring authority and permanency of a data ownership record, storing original data in a safe data warehouse, recording the hash value and ownership information of the data on the block chain at the same time, and storing the data in the block chain. Through combination of multi-source heterogeneous data acquisition, digital fingerprint generation and block chain hash anchoring technologies, automatic registration and efficient management of data ownership are realized.

Provided in the present application is a code generation method, comprising: a code development platform receives input information by a user in a first code file, extracts context information of the input information according to a data warehouse to which the first code file belongs, and retrieves a business knowledge base corresponding to the data warehouse according to the input information so as to obtain target business knowledge; then the code development platform combines the input information, the context information and the target business knowledge according to a prompt template, so as to obtain prompt information; and then the code development platform inputs the prompt information into a large language model (LLM) for reasoning, and presents to the user a code segment reasoned by the LLM. Thus, using the prompt information from the same data source in different processes for prompting the LLM can achieve complete sharing and complete alignment of the prompt information, thereby improving the accuracy of generating code in single time. Furthermore, using a unified prompt template to combine the context information and the business knowledge can make a code segment generated by the LLM more accurate, thereby improving the code acceptance rate in professional domains.

The invention relates to the technical field of smart city traffic, and discloses a smart city traffic dynamic optimization system and method based on digital twinning. The system obtains urban traffic network multi-dimensional data from a plurality of heterogeneous data sources through a traffic multi-dimensional data acquisition module and integrates the urban traffic network multi-dimensional data into a traffic related data warehouse; a traffic digital twinning model construction module extracts features from the data warehouse to generate a traffic related feature matrix, and a digital twinning traffic dynamic model is constructed according to the traffic related feature matrix to output a theoretical traffic state value; the traffic flow map construction module determines a dimension link map of each dimension and constructs a traffic flow link map; the traffic core feature screening module screens a traffic core feature sequence based on the map; the traffic multi-dimensional optimization analysis module performs multi-dimensional difference analysis on the theoretical traffic state value and real-time actually measured traffic data, and generates a region-level difference coefficient matrix in combination with the core feature sequence; and the traffic event association positioning module can realize accurate management and dynamic optimization of urban traffic.

The invention relates to the technical field of transformer monitoring, and discloses a comprehensive online transformer monitoring system which comprises a sensor layer, an edge computing layer, a cloud platform layer and a communication module. The cloud platform layer comprises a data warehouse, a big data processing engine, a comprehensive diagnosis engine, a model training engine and a system management module, the edge calculation layer is in communication connection with the cloud platform layer through a communication module, the comprehensive diagnosis engine integrates a deep neural network and a knowledge graph inference engine, and cross validation of data driving and knowledge guiding is achieved; a model training engine utilizes historical data and online incremental data to continuously optimize a model, and a dynamic knowledge graph updates a fault rule through a real-time diagnosis result and expert feedback, so that the system can adapt to novel faults and complex working conditions, and the diagnosis accuracy and adaptability are greatly improved.

The invention belongs to the technical field of information technology and intelligent health service, and discloses a community old-age care service resource optimal configuration method based on edge computing, which comprises the following steps: collecting physiological data, environmental data and activity data of old people to form original heterogeneous data, uploading the original heterogeneous data to a data warehouse through an urban and rural community network adaptation mechanism, generating a space-time tagging multi-modal data set; constructing a dynamic digital twinborn model, generating a space thermodynamic diagram, identifying different level priority requirements, and generating a time period allocation scheme through a conflict priority scoring mechanism; an MILP model is constructed to dynamically optimize edge node computing power and functional area space resources, and a resource optimization report and a block chain transaction list are generated; desensitizing the original data of the old people, creating a digital identity card, generating an encrypted service log, and synchronously recording migration behaviors of the old people; and triggering network strategy switching and priority threshold self-adaption, and carrying out resource scheduling and strategy closed-loop optimization.

The invention relates to the technical field of DCS health management, and provides a DCS health management data warehouse system, which comprises a data access and storage layer, a business logic layer and a display layer, and is characterized in that the business logic layer is used for processing DCS monitoring data, process parameter data and DCS business basic data and providing a data service interface; and a data interaction interface, a DCS field thematic base and an expert knowledge base are provided, so that the problems of data islands and unmined and utilized mass data in the DCS field are solved, unified acquisition, convergence and analysis of DCS process data and monitoring data are realized, DCS service basic data is governed, data quality is effectively improved, DCS data management efficiency and level are comprehensively improved, DCS knowledge fusion retrieval efficiency is improved, and the DCS field data management system is suitable for popularization and application. And the open sharing capability of the DCS data is improved.

The invention discloses a Frechet distance-based abnormal inflow traceability method and system for a sewage treatment plant, and the method comprises the steps: carrying out the unit division of the inflow range of the sewage treatment plant through combining land parcel information, pipe network information, convergence conditions, monitoring stations and the like, and analyzing the correlation between total phosphorus and conductivity; arranging a pipe network water quality monitoring micro station, and carding a factory-network-land parcel-source pointer relation library; a sewage treatment plant big data warehouse is constructed, related data are cleaned and treated, and the data are accessed to a pollutant traceability visualization platform; a sewage plant water pollution traceability model is constructed, a water inlet total phosphorus standard exceeding event is selected to carry out traceability research, the traceability model is embedded into a visual platform, and sewage plant total phosphorus concentration standard exceeding traceability visualization is achieved. Compared with the abnormal inflow tracing method of the sewage treatment plant, the large data resource utilization rate can be greatly improved while a large amount of manpower and material resources are saved, and a basis is provided for locking secretly-discharged enterprises, predicting pollution diffusion and environment emergency.

The invention discloses a supply chain collaborative management method and system for a whole-industry link platform, and the method comprises the steps: constructing a distributed supply chain data warehouse through employing a block chain and lightweight encryption; generating a multi-dimensional matching degree score table to recommend suppliers; decrypting and storing the encrypted bidding file, and calculating a comprehensive score according to a quantitative index and an expert qualitative index; constructing a hierarchical prediction model, and outputting a three-dimensional prediction result; calculating a supply-demand gap according to a supply-demand elastic coefficient coupling algorithm, automatically generating an order, and synchronizing the order to each end in real time; building a supply chain digital twinborn model, and dynamically planning an optimal transportation route through an intelligent fusion road condition algorithm; early warning information is automatically sent to generate a coping strategy, and full-link operation data are integrated for visual display; the objective of the invention is to solve the problems of existing supply chain data splitting, low supplier matching efficiency, low demand prediction precision, rigid logistics planning, risk monitoring lagging and poor collaboration of all links.

The invention discloses a lithium battery full life cycle quality tracing system based on digital twinning, and relates to the technical field of lithium battery quality tracing, and the system comprises a physical entity layer which integrates multiple types of sensors and detection equipment to collect full-link data; the digital twinning modeling layer is used for constructing a multi-scale model to map a battery state; the data acquisition and transmission layer is used for realizing data real-time transmission preprocessing through an edge gateway and an encryption protocol; the data storage and management layer is used for establishing a data warehouse by using a distributed database and performing backup; the intelligent analysis and decision-making layer integrates an algorithm to realize anomaly detection, performance prediction and tracing; the visualization and interaction layer is used for providing a multi-terminal visualization and interaction function; and the block chain evidence storage layer constructs an alliance chain to ensure that the data cannot be tampered. According to the invention, full-life-cycle data connection and credible tracing of the lithium battery are realized, the quality problem positioning efficiency is improved, intelligent early warning and optimization capabilities are provided, the operation threshold is reduced, and industrial quality control and green development are facilitated.

The invention belongs to the field of big data, and relates to a financial data processing method, which comprises the following steps: acquiring enterprise end financial data and government end financial data of a target project; performing data integration on the enterprise end financial data and the government end financial data by adopting a preset data warehouse to obtain a comprehensive financial data set; receiving a report request of a user, determining an accounting criterion based on the report request, and loading accounting processing logic corresponding to the accounting criterion from a pre-established accounting module; and based on the accounting processing logic, performing financial analysis processing on the comprehensive financial data set, and generating a financial statement corresponding to the target project. The invention further provides a device, equipment and a medium. The financial data processing efficiency can be improved.

The invention discloses a monitoring analysis method and system for hydropower station flood overflow gate opening and closing working condition data, and relates to the technical field of monitoring analysis, and the method comprises the steps: building a data warehouse: carrying out the data connection with a cloud platform, and building a flood overflow gate and sand washing bottom hole data warehouse; audio and video imaging identification research: adopting an audio and video imaging technology to carry out imaging identification algorithm research on the flood overflow gate body and the opening and closing control equipment in the static state and the operation state of the gate; performing data and audio and video correlation research; the cloud platform data warehouse gathers and stores in real time, and data islands are broken. Audio and video imaging full-state monitoring is achieved, and potential faults are efficiently early warned. And data and audio and video correlation analysis is realized, and understanding is deepened. And a running inspection analysis and diagnosis function provides a detailed backtracking basis. Monitoring intellectualization is integrally improved, safe and reliable gate operation is ensured, and high-standard management requirements of modern hydropower stations are met.

Generating edited input tables for low-latency presentation including receiving, by the workbook manager on an intermediary computing system from a first workbook client on a first client computing system, a request for an input table on the cloud-based data warehouse; generating, by the workbook manager, a database statement to retrieve the input table from the cloud-based data warehouse, wherein generating the database statement comprises: determining that a cache on the intermediary computing system includes an uncommitted input table edit; and inserting the uncommitted input table edit into the database statement; retrieving, by the workbook manager, query results from the cloud-based data warehouse using the database statement, wherein the query results comprise the input table and the uncommitted input table edit; and providing, by the workbook manager, the query results to the first workbook client on the first client computing system.

The invention discloses a data sharing method of a digital twin city and a related device, and relates to the field of digital twin, a data virtualization system is constructed, multi-source data virtualization is carried out on each data source of a digital twin city system, data of different business systems are stored in respective business systems, and the data sharing efficiency is improved. A centralized data warehouse does not need to be constructed, uniform access connection of multi-source heterogeneous data is achieved, and specifically, under the condition that a master control node in the data virtualization system receives a calling request of a calling end, the master control node is controlled to generate at least one task according to the calling request, and the task is sent to at least one working node; the method comprises the following steps: receiving a task from a working node, controlling the working node to access a data source corresponding to the task to obtain a task result, and feeding back the task result to a master control node, so that the master control node feeds back the task result to a calling end, thereby realizing joint access across different data sources, returning an access result in real time, and improving the data sharing efficiency of the digital twin city.

The invention discloses a data warehouse multi-hop relationship quick retrieval method and system based on a graph embedded index, and relates to the technical field of multi-hop relationship retrieval data processing. The quick retrieval method for the multi-hop relationship of the data warehouse based on the graph embedded index comprises the following steps of: monitoring data flow interference; monitoring index updating timeliness; monitoring the query accuracy of the multi-hop relationship; and timely monitoring of data query response. According to the method, whether to perform graph model modeling to obtain the graph model is determined by judging whether to trigger the interference suppression mechanism, then the multi-level index is constructed based on the graph model, and whether to trigger the index step length updating mechanism is determined based on the index updating timeliness judgment result; and finally, based on a multi-hop relationship result query accuracy verification result, determining whether to trigger a candidate node screening range shrinkage mechanism, thereby achieving the effect of improving the multi-hop relationship retrieval efficiency of the data warehouse, and solving the problem of low multi-hop relationship retrieval efficiency of the data warehouse caused by data flow interference in the prior art.

According to an embodiment of the present invention, a method for using information in conjunction with a data repository includes encrypting data associated with the information with an encryption key, sending at least the encrypted data to the data repository, and possibly deleting the information. The method also includes receiving a request for the information from a remote device, and sending a request for the encrypted data to the data repository. The method further includes receiving the encrypted data from the data repository, decrypting the encrypted data using the encryption key, and sending the information to the remote device.

An AI-powered data quality monitoring and automatic alerting system (100) for cloud-based data warehouses, comprising: a. an AI-driven data quality monitoring module configured to continuously assess data in the cloud-based data warehouse for accuracy, completeness, consistency, and timeliness; b. an anomaly detection and warning system configured to automatically detect data anomalies based on the assessment performed by the data quality monitoring module and to generate real-time alerts based on detected anomalies; c. an automated data cleansing and remediation workflow that triggers corrective actions in response to detected anomalies, including data imputation, record merging, and validation to maintain data integrity.

The present invention is directed to systems for data integration and analysis using artificial intelligence networks to generate predictive outputs based on one or more inputs. The present invention incorporates healthcare data from a variety of sources and databases into a single system for predictive analysis using artificial intelligence. The present invention incorporates multifaceted authorization to access data from a variety of databases and integrate the data into a single data warehouse. The system of the present invention is further configured to analyze the integrated data to identify predictors, and subsequently uses the predictors to determine a predictive output based on an input.

A generative artificial intelligence (AI) system includes a generative AI model configured to generate outputs based on a training data set. The AI system additionally includes a secure data vault system. The secure data vault system additionally includes a sandbox system storing the generative AI model and operatively coupled to the generative AI model to send inputs to generate the outputs from the generative AI model, wherein the sandbox system comprises an execution environment configured to restrict execution of the generative AI model to a predefined memory address range. The secure data vault system further includes a secure network service communicatively coupled to the sandbox system and configured to authenticate a connection to an external system and to download from the external system an update package for the generative AI model when the connection is authenticated.

The invention discloses a control method and system of automation equipment for industrial production, and particularly relates to the technical field of automation equipment control. The method comprises the following steps: extracting diversified samples of normal values, abnormal values and hidden defects from an existing data warehouse, labeling categories, and constructing a high-quality initial data set; evaluating the stability of the model by using a layered K-fold cross validation method, and testing and evaluating the consistency of the abnormal response capability and the historical mode through a high-load condition when the model is unstable; comprehensively analyzing the stability and the abnormal response capability of the model, and evaluating the capability of the AI for identifying error modes in historical data; for inaccurate identification, the dynamic time warping algorithm is used for detecting the deviation degree of the equipment operation parameters, an alarm is triggered in time, and the production process is paused to guarantee the safety of the equipment, so that the reliability and accuracy of the AI model in a dynamic environment are remarkably improved, and meanwhile, the risks of equipment damage and production safety accidents caused by optimization errors are effectively reduced.

The invention particularly relates to a nuclear power important parameter abnormity identification and alarm system. The system comprises a data warehouse and at least one group of parameter abnormity identification modules arranged in the data warehouse. And each parameter abnormity identification module receives the real-time operation data of the unit as input so as to carry out abnormity identification and alarm on specified nuclear power parameters. According to the invention, the operation state of the unit is monitored, and the abnormity of important parameters, equipment and systems can be identified timely and accurately.