151 results about "Data mart" patented technology

A method and apparatus for transporting data for a data warehousing application. Data is extracted from one or more source containing data having a standard data structure and is translated into data that contains meaningful business terms. The translated data is then stored. In the present embodiment, an analytic business component is operable for extracting data from the source, translating the extracted data and for storing the translated data into a staging area. The translated data is then processed to obtain data having a common structure. In the present embodiment, a source adapter processes the translated data to obtain data having a common structure. The data having a common structure is then transformed into a format suitable for loading into a data mart. In the present embodiment, an analytic data interface receives the data having a common structure and transforms the data for loading into a data warehouse. The data is then stored in a data warehouse.

Remote segmentation applied to a segmentation data mart allows a marketer to create a personalized email campaign for a selected segment of customers. Segmentation data is collected from a plurality of third party sources, imported and cleansed. The marketer may query a data mart with a user-defined rule created with parameters selected from fields available in the data mart. The marketer submits the query and is presented with a count with which the marketer may determine if the segment will be cost effective for the marketing campaign. If the count is acceptable, the query is saved. Later, when the marketer creates the email message for a particular campaign, s/he assigns the segment to the campaign. When the campaign is released, the query extracts email addresses currently meeting the criteria of the query and uses the addresses for distributing the email.

A method of managing slowly changing dimensions in a dimensional database, such as a dimensional data mart, is disclosed. The method consists of providing a dimension template for each dimension undergoing slow changes, which template assigns a behavior to each column of the dimension table. When a row of dimensional data is to be delivered to the dimension table, the table is searched for a record having the key value of the row of data to be delivered. If such a record exists and if any attributes of the row to be delivered have their values changed compared with the existing record, the table is updated according to the behavior type assigned to these attributes in the dimension template, either by overwriting the existing record with the record to be delivered or by creating a new record or records.

The invention belongs to the technical field of industrial big data application, and particularly relates to an industrial big data multidimensional analysis and visualization method based on a JSON document structure. The method comprises the following steps: by taking JSON as a basic carrier of data, constructing an industrial data mart in parallel by utilizing Spark and ElasticSearch through configuring a relational database and a file system data source and defining data conversion and data cleaning operations; configuring an overall process of data analysis in a graphical mode to construct an analysis data set of a multi-dimensional structure, and repeated association operation on massive data being avoided; and for a specific data analysis scene, customizing each dimension calculation index of the data analysis report in a visual dragging mode based on a pre-constructed multi-dimensional analysis data set, and generating an interactive graphic analysis report. According to the method, the JSON document format is used as a carrier of basic data, and the advantages of the JSON document format in storage and analysis are utilized, so that multi-dimensional analysis structure modeling and user-defined interactive analysis are more convenient and efficient.

Performance on a networked system is monitored through five interlocking monitoring techniques. A network monitoring process causes pseudo messages to be sent from various points in the network and monitors the progress of the pseudo messages. A client-server monitoring process monitors server availability and receives logs from various client-server processes and determines the performance of both server and server processes, which can be grouped by end-user location. A mainframe monitoring process monitors the performance of the various hardware and software components on a mainframe. A reporting and administration process compiles reports and makes them remotely available over the Internet. An e-business monitoring process monitors servers accessible to customers over the Internet by use of a Java applet which sends time stamps indicating access. The five processes are tied together through a central data repository, called a data mart.

Initially, customer time series credit files are acquired. The credit files are organized in a data mart environment for supporting a query system. Time series utilization attributes are created and a neural network time series segmentation process is applied and N.times.N dimension segments are generated for analysis. The chart may be modified to more accurately depict profitable credit revolvers. Credit data from each potential new customer is processed in a similar fashion by the neural network segmentation process. Profitable credit revolvers are identified by having credit utilization patterns belonging to profitable segments previously identified.

The invention relates to a method for establishing a dynamic virtual data base in an analyzing and processing system, which comprises the following steps: (1) defining metadata; (2) constructing a dimension indexing table; (3) constructing data marts; (4) instantiating the data marts; (5) constructing and instantiating a plurality of the data marts; and (6) dynamically modeling and instantiating the virtual data base. The method collects service required data from an enterprise database, defines fields with analysis significance into the metadata, carries out dynamic modeling, dynamic extraction and conversion processing on the corresponding metadata, constructs a plurality of the data marts conforming to an analysis subject and instantiates the virtual data base so as to realize the zero storage of the data in the virtual data base, overcome contradictions between system equipment resources and continuously increased information quantities and meet the requirements of high efficiency and data real-time for a management decision database of a decider.

The invention discloses a data warehouse based on data fusion and data mining and an application method of the data warehouse. The data warehouse mainly solves the problems that in the prior art, a data warehouse cannot meet requirements of users for reliability, consistency and sharing performance of storage and extraction of large amounts of data information. The data warehouse comprises a data extraction layer, a data storage layer and a data access layer, wherein the data extraction layer is used for extracting data in online transaction processing system, an external data source and off-line data storage media and leading the extracted data into the data storage layer; the data storage layer comprises an ODS used for storing the data which are subject-oriented, integrated and current or close to the current and constantly change, an EDW storing enterprise-level data and a data mart; the data access layer is used for accessing data in the data storage layer in a statement, image or data analysis mode and carrying out analysis prediction. According to the data warehouse based on data fusion and data mining and the application method, the aim of storing and accessing data safely, reliably and conveniently is achieved, and the data warehouse has high practical value and popularization value.

A method of populating multiple data marts in a single operation from a set of transactional data held in a database in a single aggregation process, in which aggregate values are calculated only once, a determination is made as to which output data marts required the aggregate value, and the aggregate values are output to the appropriate data marts. Dimension data associated with the output aggregate records is also output to the appropriate data marts.

Systems and methods are described for automating the creation of data marts within an enterprise. Data is maintained in a plurality of data sources that include at least a relational database and a multidimensional database. The system includes a business intelligence server that provides a virtual logical semantic model to integrate all of the plurality of data sources. The user specifies a list of levels and measures on the virtual logical semantic model. The list of levels and measures can span data from multiple data sources. The user can also specify a location in the plurality of data sources that will store the aggregate matrix. Once the list of levels and measures are specified, the business intelligence server generates a multidimensional cube to store the data for the aggregate matrix and stores the multidimensional cube in the data source location.

The invention discloses a patent data analysis method and system, belonging to the computer application field. The patent data analysis method comprises: constructing a subject corresponding to an analysis target in a local database; constructing a data mart consistent with the subject; constructing a data view corresponding to the subject in a data warehouse; extracting the patent data in the local database; storing the extracted patent data in the data warehouse; determining the corresponding data mart according to the request of a user; and analyzing the determined data mart, and returning the analysis result to the user in a view manner. The method can process the patent data by ETL (extract-transform-load) treatment specific to the subject, and can analyze the patent data to improve the patent data analysis efficiency and quality, thereby providing convenience for users.

The invention relates to an auxiliary decision supporting system of a hospital. The system comprises a production system layer, an interface layer, a data layer and an application layer. The system is characterized in that: the production system layer integrates data of each service system of the hospital, the data are integrated by the interface layer and organized to a data warehouse, the data required corresponding to each system of the application layer are extracted from the data warehouse through the data layer to form a data mart, and finally the data mart provides data support for the corresponding system so as to ensure development and operation of the corresponding system of the application layer. The system can integrate the complex data of the hospital and generate an intuitive data table to assist an administrator in integrating the all-round information of the hospital to make a decision so as to improve the efficiency and the validity of decision management.

The invention discloses a data loading cleaning engine, dispatching and storage system, which comprises a data source, a data warehouse and a user display module, wherein the data warehouse is connected with an ETL management module; the ETL management module comprises an ETL dispatching module, an ETL monitoring module, a data quality module and an ETL task module; the data warehouse comprises an interface file region, a detail data temporary storage region SSA, a detail data SOR, a data mart, a data summarizing module, a feedback module and a metadata storage MDR. The system provided by the invention has the advantages that the practicability is high; the data management is convenient and fast; the flexibility is high; the popularization is easy; the high-efficiency data processing is realized; the throughput is great; the dealing with the addition of more data sources can be realized; more analysis requirements are supported.

A method is provided for enterprise management and bundling of radio, outdoor and entertainment inventory to achieve maximum revenue on perishable products. An electronic data-mart 110 or central information storage and data processing system is established to collect influencing factors for the probability and price sensitivity of a particular advertising buyer 120. The data-mart 110 also collects business rules for inventory scaling, available inventory to sell, budget (goal) information, advertiser payment history, and station performance data to feed to a scenario planner 130. Once three or more variables exist, inventory and pricing fuzzy logic algorithms create scenario plans to present the most profitable bundle of offerings. The scenarios are typically pre-approved although presented to the local business units 150 for an abnormality failsafe. Once processed by the local business units 150, the scenarios are presented to the advertising buyer 120. Negotiations typically take place which cause for the process to restart. The main systems that interact to build these scenarios are: an enterprise data-mart 110, a scenario planner 130, a performance measure system 170, a rate or yield management subsystem 160, a traffic and accounts receivable system 180 and a similarly configured local inventory booking system 190. A business rules engine provides the local rule definitions for scaling inventory and price to provide for the most profitable combination.

The present invention discloses a method for implementing data integration and data service based on a panoramic business model of the power grid, and relates to the technical field of power system information. The method for implementing data integration and data service based on the panoramic business model of the power grid comprises that: by scheduling various business systems, all levels of systems and various departmental system data, modeling tools and data extraction tools are unified, and data is collected and processed to provide data services in a microservice frame manner. According to the method disclosed by the present invention, by relying on the panoramic business model of the power grid, integration of the scheduling domain data is implemented, the barriers between various business application systems are overcome, a unified and standardized scheduling data mart is established, unified data support is provided for the reporting module and other application modules, problems that the information data of the grid system is inaccurate, non-uniform and inconsistent are avoided, and efficient and convenient data management functions are provided.

The invention discloses a method and a system for identifying abnormal transactions based on a fund transaction network, The abnormal transaction identification method comprises the following steps: the step of constructing a data mart through multi-subject data, the step of determining the basic index data, the step of generating the first risk characteristic data, the step of forming a pluralityof fund transaction networks based on the transaction data, the step of generating suspicious cases of abnormal transactions and the step of generating suspicious screening reports; The abnormal transaction identification system includes: data mart building module, basic index mining module, risk characteristics generation module, transaction network building module, suspicious case generation module and screening report generation module. Based on the established fund transaction network and transaction risk model, the invention can completely restore the money laundering process and the money laundering scene, and provides strong support and assistance for the money laundering behavior investigation. The invention also has the prominent advantages of high precision, good comprehensiveness, strong objectivity and the like.

The invention discloses a privacy-removing processing method and a device using the privacy-removing processing method. The privacy-removing processing method comprises the following steps: extracting an index field of client privacy data obtained from a data source and calling a privacy-removing mapping relation chart; mapping the index field into mapping codes in the privacy-removing mapping chart according to the mapping rules of the privacy-removing mapping relation chart and finishing the privacy-removing process of the client privacy data. According to the privacy-removing processing method and the device using the privacy-removing processing method, a privacy-removing processing engine is designed to be arranged inside the an extract transform and load (ETL) module, on one hand, existing system resources of the ETL module is sufficiently used and occupation of system resources of a data cabin and a data mart is avoided; on the other hand, due to the fact that the ETL module is an united inlet of all data of an business analysis system, the ETL module carries out all the client privacy-removing process, and therefore uniformity of all the operations can be ensured.

The invention provides a construction method and system of a data warehouse (DW or DHW) and a server. The method includes: constructing a multi-layer data processing architecture for hierarchical processing on data; extracting needed data from data sources, and cleaning the extracted data to form the data according with preset requirements; scheduling and supervising data processing tasks; and controlling access authority of the data in the multi-layer data processing architecture, and supervising overall running status of the data. The multi-layer data processing architecture includes: a temporary storage layer (ODS), which temporarily stores the data acquired from the data sources; a core data layer, which stores and processes the data after cleaning; a data mart layer (MID), which organizes the data to form corresponding data topics; and an application layer (APP), which is user-oriented to process specific demand data input by a user. The method can quickly construct the enterprisedata warehouse, reduce complexity of warehouse construction, shorten a development cycle of building the data warehouse by an enterprise, and reduce warehouse development and operation and maintenance costs, and has broad application prospects.

The invention discloses a financial service management information platform which comprises a foundation platform and an application platform. The financial service management information platform can realize cross-system and trans-department data information sharing on the basis of finishing basic data merging and integration of each legal person organization. Data application marts having different service themes are established through a unified data view, the data application marts comprising a business report data mart, a business index system and business analysis data marts having different topics. Therefore, service level of a rural credit system is improved, and wisdom cooperation financial service is realized under the premise of guaranteeing the system to have good expansibility, safety and stability and high availability.