965 results about "Datawarehouses" patented technology

A system and method for automatically reconfiguring a computing environment comprises a consumption analysis server, a placement server, a deployment server in communication with a set of virtual machine monitors and a data warehouse in communication with a set of data collection agents, and a database. The consumption analysis server operates on measured resource utilization data in the data warehouse to yield a set of resource consumptions, available capacities and host and virtual machine configurations from the computing environment. The deployment server continuously monitors an event triggering condition and when the triggering condition is met, the placement server assigns a set of target virtual machines to a target set of hosts in a new placement and the deployment server implements the new placement through communication with the set of virtual machine monitors. The placement server right-sizes the virtual machines and the target set of hosts.

According to the present invention there is provided a method for establishing a data warehouse capable from a plurality of source databases including at least one relational database and at least one object-oriented database, comprising the steps of: integrating the schema of said plurality of source databases into a global schema, including resolving semantic conflicts between said source databases, and establishing a frame metadata model for describing data stored in said local databases, said frame metadata model including means for describing any constraints developed during schema integration and further including means for describing relationships between data stored in local object-oriented databases.

The invention discloses a Kubernetes based capacitor cloud configuration and an interaction method among modules of cloud configuration. The Kubernetes based capacitor cloud configuration comprises a processor, and a mirror image construction module, a data warehouse module, a load balancing module, a service discovery module and a container monitoring module connected with the processor; the mirror image construction module provides mirror image file making, storing and distributing services; the data warehouse module stores and processes data in a database of a cluster; the load balancing module carries out load balancing on calculating nodes in the Kubernetes cluster; the service discovery module obtains information of dynamic change of the calculating nodes in the Kubernetes cluster; and the container monitoring module collects and displays information of motion state of the calculating nodes in the Kubernetes cluster. The cloud configuration and the interaction method can be applied to container systems which need high availability and expansibility conveniently.

The invention relates to data warehouses and the ability to create and maintain data cubes of multi-dimensional data. More specifically, the invention pertains to data cube architectures that permit significant reduction of storage, exhibit very efficient retrieval and provide a very efficient incremental update of the data cubes.

An ETL/EAI data warehouse management system and method for processing data by dynamically distributing the computational load across a cluster network of distributed servers using a master node and multiple servant nodes, where each of the servant nodes owns all of its resources independently of the other nodes.

A system and method for reconfiguring a computing environment comprising a consumption analysis server, a placement server, an infrastructure management client and a data warehouse in communication with a set of data collection agents and a database. The consumption analysis server operates on measured resource utilization data to yield a set of resource consumptions in regularized time blocks, collects host and virtual machine configurations from the computing environment and determines available capacity for a set of target hosts. The placement server assigns a set of target virtual machines to the target set of hosts in a new placement. In one mode of operation the new placement is nearly optimal. In another mode of operation, the new placement is “good enough” to achieve a threshold score based on an objective function of resource capacity headroom. The new placement is implemented in the computing environment.

Techniques for transforming records prior to loading the records into a data warehouse in an efficient manner. In one embodiment, instead of using lookup transformations, a database operation such as an outer join operation is used to transform records stored in a fact staging table to add foreign keys to the records corresponding to the dimension tables that are associated with a fact table in a data warehouse to which the records are to be loaded. Since the outer join operation is memory intensive, a determination is made as to which dimension tables from the multiple dimension tables associated with the fact table are suitable, from a performance perspective, for the outer join operation. Only those suitable dimension tables are outer joined to the fact staging table to add the foreign keys for the outer joined dimension tables to the fact staging table records. Lookup transformations may be used to add foreign keys to the fact staging table records for the non-suitable dimension tables. The transformed fact records with the foreign keys may then be loaded into the fact table in the data warehouse.

A system for identifying hidden connections between non-sentiment phrases. The system comprises a network interface enabling an access to one or more data sources; a data warehouse storage for at least storing a plurality of phrases including sentiment phrases and non-sentiment phrases; an analysis unit for identifying hidden connections between non-sentiment phrases based on at least one proximity rule and for generating at least an association between at least two non-sentiment phrases having a hidden connection and a sentiment phrase, wherein an association between the at least two non-sentiment phrases having the hidden connection and the corresponding sentiment phrase is a term taxonomy.

The current invention discloses methods for transforming a set of relations into multidimensional data cubes. A syntheses process is disclosed that dynamically and with minimal user input eliminates ambiguities when populating a data cube by introducing table-like virtual relations. The methods are generic and applicable to many data warehouse designs. The methods support relational OLAP for a wider variety of data and structures than possible using current relational implementation schemas.

In one embodiment, a method an apparatus for managing a system comprising at least one operational data store and a data warehouse that is associated with at least some of the data in the operational data set, comprising automatically updating the schema of the data warehouse to reflect a change to the schema of the at least one operational data store. In a further embodiment, a method and apparatus for requiring that a designer of a database system provide metadata that defines changes to be made to a data warehouse in response to a modification of an area in an operational store. In another embodiment, a method and apparatus for detecting schema changes to an operational store, so that appropriate action may be taken in a data warehouse. In a further embodiment, a method and apparatus for implementing changes to a data warehouse schema, comprising the execution of one or more lower level calls to appropriate APIs to modify the schemas of both a relational database and an OLAP database.

Methods, systems, and articles of manufacture for constructing and populating data marts with dimensional data models from a set of data repositories that contain factual and association information about a set of related assets are disclosed. An intermediate data warehouse is generated to process the facts and associations for each asset. Using the intermediate warehouse, one or more data marts are generated with fact tables, dimensions, and hierarchies to fully model the information available for each asset.

A computerized maintenance management system for vehicles comprises a data warehouse, comprising a communications link for receiving data relating to vehicle maintenance, a storage component for storing received data, and a modeling component comprising modeling algorithms stored within the data warehouse. The modeling component is thus able to process the data in real-time within the data warehouse, and outputs a predictive model with recommended maintenance and/or replacement schedules that is always based on the most current available data.

A system for generating a model for tracking a changing dimension feature of data in a business model includes a memory for storing the business model and a computer readable code for modeling the changes in the changing dimension feature and a processor for executing the computer readable code to perform method steps including capturing the changing dimension feature of the business model, transforming the changing dimension feature into a data warehouse model corresponding the business model, identifying changing dimensions and attributes in the changing dimension feature according to the data warehouse model, and generating a run-time deployable component for tracking the changing dimension feature based on the identified changing dimensions and attributes.

The invention provides a data processing method and data processing device applied to a data warehouse. The data processing method includes: when a first data base is operated, rectifying records of a mirror database in the first database in the data warehouse according to an incremental log corresponding to the operation and then storing the rectified records in a key/value database; fetching latest entries from the key/value database, additionally storing the entries in a first data table of the data warehouse and enabling the first data table to include historical versions of the records of the mirror database; searching data in the first data table. Therefore, timeliness of the data in the data warehouse can be improved.

The invention relates to an enterprise operation and management personnel comprehensive quality and post competence assessment system. The enterprise operation and management personnel comprehensive quality and post competence assessment system is characterized in that overall architecture comprises assessment system application middleware, assessment system software, an assessment system data warehouse and an assessment system construction member; the assessment system application middleware (1) comprises a process integration module, a data integration module and an application integration module; and the assessment system software (2) comprises an assessment member center management module, an assessment management module, an assessment analysis module, a system management module, a customized assessment module, a static assessment module and a system application and management module. The enterprise operation and management personnel comprehensive quality and post competence assessment system has the beneficial effects that post competence, comprehensive quality level and operation and management knowledge level of a testee can be comprehensively, accurately and scientifically assessed, and the testee and an employing unit can be helped to fully and comprehensively understand comprehensive adaptation level of the testee on an operating post and development direction of the testee in an occupation.

The invention discloses a method for managing an image warehouse, which carries out efficient management on the image warehouse by using text-based image data description information. The management process comprises the steps of creating and uploading image data index files, searching keywords and downloading image data; the method comprises image data uploading and downloading; and when a client user uploads the image data to the image warehouse, the user is made to have the unique modification operation authority to the warehouse in a way of locking. The whole uploading operation and the whole downloading operation are performed through a data description file, and the data description file records the detail information of all image data such as the subfield number, the storage path and various attributes. The method has the advantages that: the same image data description files are kept in a client and a server, so that the operation of searching the image data by the user can beperformed at the client, the pressure of the network and the server is lightened and the efficiency of warehouse management is fundamentally improved.

A remote diagnostic system and method based on device data classification. Device diagnostic data with respect to a device can be acquired and a conditional probability look up table can be constructed for each fault code associated with the device diagnostic data by a classification module. A score function can then be created by summing the conditional probabilities and an occurrence of the fault code can be mapped to a service call category with a numerically highest score function. The fault occurrence data in association with a number of time stamps and device identifiers can be stored in a data warehouse. The occurrence of fault code can be matched with respect to a solution set which can be automatically dispatched to a customer via a communications link.

The invention discloses a cloud-edge cooperative amusement equipment fault prediction and health management system and method. The system comprises a distributed data acquisition system, edge computing equipment, a cloud computing platform and a management and control center. The data acquisition system distributed on the amusement equipment can acquire various heterogeneous state data including operation parameters, mechanical system parameters, hydraulic and pneumatic system parameters, electrical system parameters and the like in real time; and the edge computing equipment comprises an edgedata management functional module, a prediction service orchestrator functional module, an edge model training functional module, a fault early warning functional module and a communication service functional module, so the data caching capacity, the equipment health diagnosis capacity and the early warning capacity of an edge platform are achieved. The cloud computing platform comprises a data warehouse module, a model training module, a health management module and a communication service module, and achieves the data storage and model training capability of the cloud. The management and control center provides man-machine interaction, and is used for monitoring operation parameters and health conditions of the amusement equipment and receiving a fault prediction message.

A dynamic rule strategy and fraud detection method for detecting fraud trends is provided. The method includes storing captured transaction data in at least one data warehouse and utilizing a computer server including at least one processor for performing multiple steps. The steps include continuously monitoring the captured transaction data for detecting a concentration of fraud attacks in selected segments; receiving, the selected segments identified and developing a set of fraud detection rules based on the selected segments; and validating and implementing the fraud detection rules.

The invention provides a method for generating data warehouse ETL (Extraction, Transformation and Loading) codes and a device for generating the data warehouse ETL codes, so as to solve various problems caused by independent development of current data warehouse ETL. The method comprises the steps: by aiming at business logic needed to be processed, corresponding file header variables and explanatory note information thereof are added; the business logic needed to be processed is presented by SQL (Structured Query Language) statements, and then the SQL statements are used as variable values to be filled into array variables; general technological logic of various businesses is extracted, and is used for authoring codes of an ETL development template, wherein the ETL development template is used for calling the variable values to process the business logic; and the codes of the ETL development template, file headers and explanatory note information thereof and the array variables filled with the variable values are organized to form an executable ETL code script. With the device and method disclosed by the invention, the development efficiency is improved, the code style is uniform, the codes are convenient to manage, and the test efficiency is also effectively improved.

The invention discloses a data governance system and method. The system comprises a data access module which is used for reading multi-source heterogeneous data, enabling the multi-source heterogeneous data after data exploration and data definition to be accessed to a big data center, and carrying out the data account checking; the data processing module is used for extracting data, converting the extracted data into a required format, correcting or clearing abnormal data, and distributing the data to a corresponding data warehouse; the data organization module is used for storing the distributed data into a corresponding library in a classified manner to obtain various types of metadata; the data processing module is used for carrying out directory integration and grading classification on the metadata, determining the blood relationship and quality of the metadata, carrying out data operation and maintenance and carrying out use and service on the metadata; and the data service unit is used for providing data for users. The invention solves the technical problems that unified data quality evaluation standards and management specifications do not exist in data quality monitoring, all-around quality monitoring cannot be achieved, and a closed-loop processing mechanism is lacked for data quality.