22 results about "Data mart" patented technology

The invention discloses a power distribution network line loss intelligent sensing and tracing decision-making method and system, and belongs to the technical field of power distribution network operation and management.The power distribution network line loss intelligent sensing and tracing decision-making method comprises the steps that multi-source heterogeneous data are connected, timestamp interpolation is carried out, and data are obtained; associating the position and GIS coordinates of the electrical equipment in the electrical network through the unique identifier of the electrical equipment, and outputting a standardized data mart; a dynamic line loss separation engine calculates total loss according to the standardized data mart and a photovoltaic back-feeding compensation item, dynamically corrects technical line loss through a photovoltaic output coefficient, subdivides a line loss component by using a K-means algorithm, and outputs a line loss component matrix; and calculating a feature vector and inputting the feature vector into the traceability decision tree to trace the line loss abnormal root cause. Time sequence and space dislocation of multi-source heterogeneous data is eliminated through timestamp intelligent interpolation and equipment ID two-dimensional mapping fusion data, accurate decoupling of management line loss and technical line loss is achieved through a corrected dynamic line loss separation engine, and the misjudgment rate of a new energy scene is reduced through a traceability decision tree.

The invention discloses a fusion method and device based on multi-source water conservancy data, equipment and a medium, and relates to the technical field of water conservancy data processing, and the technical scheme is characterized in that the method comprises the steps: collecting water conservancy original data, carrying out the classified storage of the water conservancy original data according to a water conservancy data specification, and obtaining a water conservancy classification data set; preprocessing the water conservancy classification data set to obtain a preprocessed water conservancy classification data set, combining similar data of multiple sources, and carrying out missing compensation processing on the similar data to obtain a fused similar data set; and carrying out hierarchical modeling on the fused data sets of the same kind by utilizing distributed processing and a multi-bin hierarchical architecture design to obtain a standardized unified water conservancy data mart. The system has the advantages of high-efficiency water conservancy data acquisition, high-quality similar data fusion, high-standard heterogeneous data fusion, high-availability water conservancy data service and the like.

The invention discloses a hydropower station operation data intelligent management system and method based on a data mart, and relates to the technical field of operation abnormity identification of a hydroelectric generating set, and the method comprises the steps: dividing a working condition interval of the hydroelectric generating set; obtaining a reference feature group of all the working condition intervals; actual electric power sampling is carried out on a certain working condition interval, a curve is fitted according to sampling data points, and a first fitted curve of the working condition interval is determined through a correlation calculation method; obtaining a first fitting curve of all the working condition intervals; storing the reference feature group and the first fitting curve into a data mart; carrying out real-time monitoring on a certain hydroelectric generating set, and carrying out sampling inspection to construct a first monitoring sequence; and based on the first monitoring sequence, retrieving the data mart, obtaining a reference feature group and a first fitting curve under the same working condition, and performing early warning according to different conditions. The method has good expandability and adaptability, and is suitable for intelligent monitoring and health diagnosis in a multi-unit cooperative operation scene.

The invention provides a bank customer portrait determination method and device, and the method comprises the steps: carrying out the processing of obtained bank internal system data and bank external system data, and generating a customer data mart; constructing a customer value index system according to the customer data marts; the customer value index system comprises customer multi-dimensional value index classes, each value index class comprises at least one value index, and the customer value index system further comprises a definition of each value index; carrying out weight analysis on the customer value index system by adopting an analytic hierarchy process, and constructing a customer evaluation model; based on customer data corresponding to a target customer group in the customer data mart and a customer evaluation model, generating a customer portrait of each target customer in the target customer group, and outputting the customer portrait in an interactive interface of the terminal equipment; the customer portrait at least indicates the index value and the overall grade of each target customer under each value index class. Therefore, a more comprehensive and accurate customer portrait of the bank customer can be generated.

This invention discloses an intelligent management system and method for hydropower station operation data based on a data mart, relating to the field of hydropower unit operation anomaly identification technology. The method includes: dividing the hydropower unit into operating condition intervals; obtaining a baseline feature set for all operating condition intervals; sampling actual power for a certain operating condition interval, fitting a curve based on the sampled data points, and determining a first fitted curve for that operating condition interval using a correlation calculation method; obtaining the first fitted curves for all operating condition intervals; storing the baseline feature set and the first fitted curve in a data mart; performing real-time monitoring of a certain hydropower unit and constructing a first monitoring sequence through random sampling; and based on the first monitoring sequence, retrieving the data mart to obtain the baseline feature set and the first fitted curve under the same operating condition, and issuing early warnings according to different situations. This invention has good scalability and adaptability, and is suitable for intelligent monitoring and health diagnosis in multi-unit collaborative operation scenarios.

The invention discloses an architecture design method of an operation management system, and relates to the technical field of enterprise operation management, and the method comprises the following specific steps: firstly, through multi-source data integration and cross-system verification, data integrity and accuracy are ensured; then ETL processing and layered modeling are carried out, DIM and DW layers are constructed, and asset information is reversely written; secondly, performing secondary data processing on a Data Mart layer, screening high-credibility data, and configuring a security and scaling mechanism; and finally, realizing visual display and linkage management, presenting data in multiple dimensions, early warning abnormity, and ensuring close linkage of an operation management platform, a data model and a mart. Comprehensive and accurate data are ensured through multi-source data integration and intelligent verification, ETL intelligent processing, bidirectional blood relationship tracing and fine-grained safety control are adopted, the intuition, accuracy and safety of operation management are improved, and efficient application of data and tight linkage of a platform are achieved.

Adaptable data warehousing computing systems and methods are disclosed for improved and flexible declarative control for programmatic modeling and database building, including in compute intense environments. A declarative scripting engine executes computing commands defined in a domain specific language (DSL), which is configured to programmatically configure a conceptual data model defining business object(s). A logical data model may be generated based on a declarative command defining the conceptual data model. A physical data model may be generated based on the logical data model, where the physical data model defines stage, core layer, and / or a data mart layers that may be deployed to a target database or data warehouse, and where the stage, core layer, and / or a data mart layers are the same or similar to those of the logical data model.

The invention discloses an industrial data exception attribution method, device and equipment, a storage medium and a product, is applied to a smart power plant data platform, and relates to the technical field of exception detection. The method comprises the following steps: acquiring multi-source industrial data in real time; performing standardization processing on the multi-source industrial data to generate a standardized data stream in a unified format; performing anomaly detection on the standardized data through a pre-trained integrated learning model, and identifying an abnormal mode in the data; and in response to the detected abnormal mode, performing multi-dimensional attribution analysis on the abnormal mode based on an association rule constructed by a data topic and a data mart, and determining a root cause of the abnormality. Through progressive processing of data integration, intelligent detection and business attribution, a complete closed loop from data perception to intelligent decision is realized, and mass data is converted into high-value decision information for directly driving business optimization.

The invention relates to the technical field of financial systems, and particularly discloses a centralized processing method for a certificate inquiry letter, which comprises the following steps of: acquiring a paper certificate inquiry letter, and scanning the paper certificate inquiry letter into an electronic image; extracting certification inquiry home page information and certification inquiry seal page information in the electronic image; checking the formats of the information of the certifying home page and the information of the certifying seal page, the information accuracy of the information of the certifying home page and the seal integrity of the certifying seal page; printing verification and charging are carried out based on the information of the certification inquiry home page; inputting the information of the certification inquiry home page and the information of the certification inquiry seal page into a preset certification inquiry letter template to generate an electronic certification inquiry letter; the electronic confirmation request is stored in a data mart, the data mart comprises a query interface, and the query interface is used for checking the information consistency of the electronic confirmation request and the corresponding paper confirmation request; and returning the qualified electronic confirmation request to the user equipment. According to the method, the processing efficiency of the paper inquiry certificate is improved, centralized processing of the inquiry certificate is realized, and the labor cost is reduced.

This application discloses an intelligent generation method and apparatus for decision analysis reports in the insurance field. The method includes: constructing a thematic data mart containing insurance business data, and vectorizing and semantically slicing insurance field rules and indicator texts to form a knowledge unit index; responding to a report generation request, constructing a computational agent based on a matched report template; using this agent, generating analytical text by using retrieved data and knowledge units as a context-driven generative model, and synthesizing a decision analysis report; collecting interactive operation data related to the report, and adjusting the configuration parameters of the report template accordingly. This application achieves full-process automation from multi-source data integration and professional knowledge structuring to intelligent analysis, report generation, and continuous optimization, solving the problems of low efficiency, poor accuracy, and difficulty in adapting to large-scale data and complex business logic in traditional manual analysis in the insurance industry, significantly improving decision support efficiency and intelligence.

This application discloses a data mart management method, apparatus, electronic device, and storage medium. The method includes: receiving data to be processed from a source system; storing the data to be processed in a predetermined table structure to obtain a standard-format data table; processing the data to be processed sequentially at multiple levels according to a hierarchical order based on the standard-format data table to obtain a processing result table of the data to be processed; and sending the processing result table of the data to be processed to a downstream system. The method of this application can standardize the creation and storage format of data tables, directly process the standardized data, reduce the application and subsequent maintenance difficulty of data tables in data marts, and improve the management efficiency of data marts.

The application discloses a business index acquisition method and device based on distributed processing and a readable medium. The method comprises the following steps: collecting background transaction data from a source database to a distributed processing system as source layer data; partitioning and storing the source layer data to obtain partition storage data corresponding to different business requirements and / or functions as model layer data; processing the partition storage data corresponding to different business requirements and / or functions in the model layer data based on a distributed processing mode to obtain corresponding marketing indexes as data mart layer data; and finally outputting the data mart layer data to a downstream business system. The application can make more accurate and customer demand-conforming marketing recommendations by introducing background transaction data into a marketing scenario. By introducing a distributed processing system and designing a hierarchical structure of a database table for data storage and processing, the application solves the problems of slow calculation, poor accuracy and stability of indexes and the like in the traditional mode for large data volume.

The invention discloses a financial risk rule automatic test method and device, equipment and a storage medium, and relates to the technical field of data processing, and the method comprises the steps: responding to a rule adjustment instruction, and determining a to-be-tested rule according to the rule adjustment instruction; determining external connection decision data required by testing from a data market according to the to-be-tested rule, wherein financial data of a user is stored in the data market; and testing the to-be-tested rule based on the external connection decision data to obtain a rule test result. According to the method, the external connection decision data required by the test is determined from the data mart according to the to-be-tested rule, and the to-be-tested rule is tested based on the external connection decision data, so that compared with the existing method that demand review and decision data generation need to be performed every time the rule is changed, the method can improve the rule test efficiency.

A system is provided.SOLUTION: A system comprising: means for analyzing input requirements using a production AI; means for selecting appropriate data marts based on the analyzed requirements; means for automatically generating SQL queries based on the selected data marts; means for presenting the generated SQL queries to a user and accepting user confirmations and modifications; and means for executing the confirmed or modified SQL queries and presenting the results to the user.SELECTED DRAWING: Figure 1

The invention discloses a BI enterprise-level report analysis system construction method, and belongs to the technical field of business intelligence and data analysis. According to the method, a five-layer architecture system is constructed and comprises a data source layer, a data processing layer, a data storage layer, an analysis layer and a display layer, so that comprehensive data management of bank retail business and public business is realized. According to the system, data cleaning, conversion and loading are carried out on a data processing layer by adopting an ETL / PLUS technology, and the data accuracy is ensured through metadata management and data quality management; a data warehouse and a data mart are established in the data storage layer, and large-scale data storage and rapid query are supported; and functions of multi-dimensional analysis, decision support, flexible query and the like are provided in the analysis layer. According to the method, the problems of data islands, low processing efficiency, insufficient safety and the like of a traditional report system are solved, centralized management, automatic processing and real-time analysis of the data are realized, and the data processing efficiency and the decision support capability are remarkably improved.

The embodiment of the application belongs to the field of base frame operation and maintenance, and relates to a data mart abnormality detection method and device, computer equipment and a storage medium. The method comprises the following steps: obtaining task blood relationship information of a data mart; for each application in the data mart, determining a fluctuation detection link of the application according to the task blood relationship information; determining the task weight and the repetition degree of each task in the link according to the task blood relationship information; obtaining the task log of the task to extract the running index of the task; calculating the task fluctuation value of the task according to the task weight, the repetition degree and the running index; calculating the application fluctuation value of the application based on the task fluctuation value, and calculating the mart fluctuation value of the data mart according to the application fluctuation value; comparing the mart fluctuation value with a standard mart fluctuation value to obtain a data mart abnormality detection result. In addition, the application also relates to blockchain technology, and the task blood relationship information can be stored in the blockchain. The application can discover abnormalities in the data mart in advance and give a warning.

The present application relates to the technical field of environmental management big data, and discloses a multi-source heterogeneous environmental data asset construction method based on a computing power network, comprising the following steps: S1, multi-source heterogeneous environmental data processing; S2, data warehouse classification construction; S3, theme data mart construction; S4, knowledge query graph construction; and S5, cross-media retrieval application.The present application solves the problems of poor general standardization of environmental management data, lack of data correlation and integration between different business departments, and low application degree in actual business applications by means of multi-source heterogeneous environmental data processing, data warehouse classification construction, theme data mart construction, knowledge query graph construction, and cross-media retrieval application, efficiently completes the preprocessing and accurate classification of various environmental management data on the computing power network, meets the current application requirements for massive data management in the informationization construction of environmental protection work, and realizes the transformation of environmental protection informationization to digital environmental protection and smart environmental protection.

The invention provides an advertisement putting evaluation and optimization method and system based on big data, and relates to the technical field of advertisement optimization, and the method comprises the steps: obtaining full-link data, user behavior time sequence data and putting environment attribute data, and generating a structured unified data mart; fusing the extracted user characteristic parameters with the delivery environment attribute data by using an attention mechanism fusion algorithm, and constructing a user behavior graph based on a graph neural network; a multi-dimensional difference evaluation model is constructed to calculate a causal effect value of advertisement intervention, and a putting effect evaluation index is generated in combination with a periodic feature matching mechanism; based on the evaluation index, an optimization strategy adjustment scheme is generated through a reinforcement learning algorithm and is automatically executed; the system comprises an optimization strategy generation module, an optimization strategy execution module and the like. According to the method, the accuracy and optimization efficiency of advertisement effect evaluation caused by data islands, dynamic fluctuation of user behaviors and market environment interference are improved, and accurate evaluation and dynamic adaptive optimization of advertisement putting are realized.

Disclosed herein are embodiments of systems, methods, and products comprises an analytic server for data rationalization and migration. The server receives data from a plurality of electronic data sources and stores the received data into a database within a central hub. The server demobilizes the data and performs enhancement on the data to prepare the data for complex calculation. The server copies the enhanced data to an operational data store, performs various calculation functions that filer, rationalize the data, and create data linkage. The server copies back the calculation result to the database for further processing and downstream consumption. The calculation results provide a consolidated view of data from different source systems and satisfy the reporting needs for different consumers. The server uses common data model to generate reports for different consumers. After the data migration and consolidation into a central hub, the server decommissions legacy components.

A device and method are described for a universal analytical data mart and data structure for same. The analytical data mart (ADM) associated data structure is designed to allow data from disparate sources to be integrated, enabling streamlined business intelligence, reporting and ad hoc analysis. Conceptually, the ADM enables analytics and business intelligence from multiple frames of reference including people, such as parties and actors including individuals and organizations, places, such as addresses with geographic information at various levels of view, objects, such as insured properties, automobiles and machinery, and events, milestones which happen at points in time and provide analytical / business value.

The present application relates to the field of database processing, and provides an automatic configuration processing method for a batch run based on an MPP database. The method solves the problems of batch run task error stop and batch run monitoring adjustment caused by data problems of an upstream system in a batch run scene of a risk control data mart in the prior art, and causes large and untimely workload of error processing. The main scheme includes the following steps: after transaction division of the batch run, the batch run is logged and written into a function_log log table; a planned error positioning and processing system table is designed and planned, error codes and corresponding error explanations and error processing suggestions are recorded, abnormal queries are performed on the function_log log table according to the error codes in the planned error positioning and processing system table, abnormal information obtained is used for abnormal prompt or error explanation and error processing suggestion; and abnormal data obtained through the abnormal queries and error processing suggestions is written into an abnormal data table.

This invention discloses a method for constructing a data mart for anti-money laundering applications. The method involves collecting internal and external data; processing the internal and external data into the data detail layer of the data mart; generating globally unique customer / account entity identifiers through cross-system identifier mapping and attribute matching; standardizing and merging heterogeneous data according to subject domains based on these globally unique customer / account entity identifiers; and storing the fused standardized subject domain data in the data detail layer to support subsequent applications. This invention designs a unified data model with customer, account, transaction, and judicial event as subject domains, breaking down internal and external data barriers. This structure not only achieves physical data centralization but also, through entity parsing and relation extraction, merges multi-source data into high-value assets with globally unique identifiers, enabling in-depth correlation analysis and laying a solid foundation for complex analysis.