335 results about "Data governance" patented technology

Embodiments of the present invention solve the technical problem of identifying, collecting, and managing rules that improve poor quality data on enterprise initiatives ranging from data governance to business intelligence. In a specific embodiment of the present invention, a method is provided for producing data quality rules for a data set. A set of candidate conditional functional dependencies are generated comprised of candidate seeds of attributes that are within a certain degree of relatedness in the ontology of the data set. The candidate conditional functional dependencies are then applied to the data refined until they reach a quiescent state where they have not been refined even though the data they have been applied to has been stable. The resulting refined candidate conditional functional dependencies are the data enhancement rules for the data set and other related data sets. In another specific embodiment of the present invention, a computer system for the development of data quality rules is provided having a rule repository, a data quality rules discovery engine, and a user interface.

The invention relates to a method and a system for constructing an intelligent contract in a block chain. The method comprises the steps of 1, constructing an intelligent contract core system in the block chain; Step 2, contract upgrading based on the intelligent contract core system; Step 3, contract execution based on the intelligent contract core system; And step 4, performing data privacy protection based on the intelligent contract core system. The characteristics of data isolation, contract upgradable and data privacy protection are provided, and the requirements of enterprise organizations for service iterative upgrade, data governance and data security are better met.

The invention discloses a service providing method based on Internet big data. The service providing method comprises Internet data standardization definition, Internet data acquisition, Internet datapreprocessing, Internet data security processing and Internet data service providing. The method comprises steps of establishing a standard specification of a data element according to a national standard or an industry standard, modeling according to the standards, and establishing a business logic model according to the standard of the data element; landing the model, quoting a business logic model, and instantiating the model; and the standard service is used for providing a unified interface service to the outside by defining a data service protocol standard. According to the invention, services of internet big data are provided; full-life-cycle management activities including data acquisition, standardization, data processing, data service, operation period monitoring and the like are covered; based on the capability of data governance, high-quality data is provided, specialized data asset service is further provided, comprehensive support is provided for data asset management and appreciation, stable and reliable data service is provided, and the requirements of practical application are met.

According to one embodiment of the present invention, a system monitors metadata to control rule execution and comprises at least one processor. The system detects changes to metadata within one or more repositories, and identifies one or more data processing rules associated with the metadata having the detected changes. An impact of the changed metadata on the identified one or more data processing rules is identified, and execution of the one or more data processing rules is controlled based on the determined impact of the changed metadata. Embodiments of the present invention further include a method and computer program product for monitoring metadata to control rule execution in substantially the same manner described above.

The invention discloses a data management method and device for big data. The method comprises the following steps that: defining metadata; importing the metadata; managing and analyzing the metadata to obtain an analysis result; and at least according to the analysis result, obtaining a metadata atlas. By use of the method, the technical problem in the prior art that no effective data management method for the big data is in the presence is solved.

A method for change management includes providing a dependency graph as an instantiation of a linked resource model in which a plurality of resources are linked by at least one dependency. The resources include at least one source resource and at least one target resource, each of the at least one dependency specifying preconditions on at least one of the at least one source resources for the dependency to be activated and an impact on at least one of the at least one target resources when the dependency is activated. A change to one of the plurality of resources is propagated to at least one other of the plurality of resources in the graph and information based on the propagation is output.

Improved data governance solutions to enterprise-level master data storage hubs are provided by implementing data governance functionality across the operational systems, analytical systems, and master data hubs of an enterprise. Data governance functionality is provided across the systems and hubs of an enterprise by providing visibility into the operational data, analytical data, and master data of an enterprise, by providing visibility into the data quality measuring processes that have been executed on the operational and analytical data, and by providing functionality for correcting fragmented, inconsistent, and erroneous information within operational and analytical data.

The invention discloses a data governance system and method. The system comprises a data access module which is used for reading multi-source heterogeneous data, enabling the multi-source heterogeneous data after data exploration and data definition to be accessed to a big data center, and carrying out the data account checking; the data processing module is used for extracting data, converting the extracted data into a required format, correcting or clearing abnormal data, and distributing the data to a corresponding data warehouse; the data organization module is used for storing the distributed data into a corresponding library in a classified manner to obtain various types of metadata; the data processing module is used for carrying out directory integration and grading classification on the metadata, determining the blood relationship and quality of the metadata, carrying out data operation and maintenance and carrying out use and service on the metadata; and the data service unit is used for providing data for users. The invention solves the technical problems that unified data quality evaluation standards and management specifications do not exist in data quality monitoring, all-around quality monitoring cannot be achieved, and a closed-loop processing mechanism is lacked for data quality.

The invention discloses a data fusion governance system which comprises an interface message reception/transmission module, an interface design editor and an interface service management module, wherein the interface message reception/transmission module is connected with one heterogeneous system through an interface and used for reading messages from the heterogeneous system and transferring signals processed by the interface service management to another or more heterogeneous systems downstream; the interface design editor is used for editing and debugging the information accessing the interface service management module and deploying the debugged information to the interface service management module; and the interface service management module is used for monitoring and managing connection operation. Compared with the traditional netted "straight-in in pairs" manner, the data fusion governance system has the advantages of reducing the management cost, being more reasonable in resource distribution, realizing resource sharing, unitizing the protocol standard and improving the data quality by inspecting, proof-reading and checking the data flowing through the system.

The invention discloses a data warehouse system based on data management and blood relationship design. The data warehouse system comprises a warehouse counting management module, a blood relationshipmanagement module, a metadata management module, a data quality management module and an operation scheduling management platform. The warehouse counting management module is responsible for collecting enterprise data, dividing the enterprise data according to a theme domain, and carrying out accurate label portraying and data service; the blood relationship management module surrounds the warehouse counting module, can perform inquire from bottom to top, and can visually display the blood relationship of the warehouse counting through a full link; the data quality management module cooperates with the operation scheduling management platform to regularly inspect data and business consistency; and the metadata management module is used for feeding back life cycle and version reports of the enterprise library table regularly.

The invention provides a data management method and management platform. Standardized governance for multi-element, isomeric and multi-language data is carried out. B/S architecture design is adopted and data resource management and governance work configuration is completed via web pages; a distributed data cleaning and governance program is built at a back end via secondary development; the front-end configuration and the rear-end program architecture are combined, so that standardized cleaning and governance work for data can be completed automatically. The web page architecture multi-user mode facilitates man-machine interaction; the multi-thread and distributed technology of the rear end can complete cleaning work rapidly and efficiently; the development of cleaning technology is more inclusive; data cleaning work for multiple regions and multiple languages of the world is finished. A cleaning platform system disclosed by the invention is implemented in the B/S architecture and a synergic cleaning system is built by establishing a distributed environment, so that multi-end and multi-thread joint data governance is achieved and the adaptability of the cleaning methods is improved.

The invention discloses a method and device for accessing a data table into a standard library and the method comprises the steps: carrying out the data item matching of a new data table and a standard library table in the standard library, and determining a first standard library table for target alignment according to the similarity; carrying out field-level benchmarking on the new data table and the first standard library table to generate a second standard library table, and establishing a mapping relation between the new data table and the second standard library table; and storing the second standard library table and the mapping relation into the standard library. According to the embodiment of the invention, through data item matching and field-level benchmarking, when the new datatable is accessed, the corresponding data item of the table field in the standard library can be quickly and efficiently identified, so that the new data table can be automatically accessed to the standard library or accessed to the standard library through a small amount of manual intervention, and the data management efficiency is improved.

The invention provides a visual graph system of data blood relations in data management. The system comprises an information node and also comprises the following modules: a data flow line which refers to the path of data flow and at least one node of an extraction strategy node, a cleaning rule node, a conversion rule node, a loading rule node and a processing rule node. The extraction strategy node is used for indicating how data is extracted; the cleaning rule node is used for showing screening criteria of the data in the data flow process; the conversion rule node is used for showing changing criteria of the data in the data flow process; the loading rule node is used for indicating how the data is loaded; the processing rule node is used for showing data archiving or destruction. According to the system, migration and flow of data can be clearly understood through blood relations of different levels, and the system provides the basis for data value evaluation and data management.

A data governing system based on metadata management comprises a system management module, a metadata collecting module and a metadata base module. The system management module has the functions of user management, role management, authority management and dictionary management; the metadata collecting module has the functions of suspension point configuration, data source configuration, metadatacollecting, task management collecting and metadata storage; the metadata base module comprises a metadata retrieval submodule, a metadata maintenance submodule, a metadata browsing submodule and a metadata application submodule. A user of the data governing system is connected with a metadata base located on the background through a UI front end interface and a middle end program, demand characteristics are configured, an interface is called from relational data for extracting the metadata type, metadata collection is achieved, and the metadata is analyzed and applied.

The invention discloses a management data access system. A client side is connected to a server side through a load balance module, after data accesses the server side, the accessed server side usability is ensured through a high availability support module, a flow control module counts requests of the client side, requests not conforming to flow control configuration are refused, an RPC communication module is used for achieving data transmission of the client side and the server side, a transaction support module is used for determining the type of the current data operation; a data operation execution module is used for completing actual data access operation, and finally access traces are recorded and counted through a data governance module. In this way, data and applications can be decoupled, so that data deployment changes do not affect applications, and the data access process is controlled.

The present invention discloses a data governance driven data sharing exchange method, comprising the steps of using a metadata collector to collect the metadata in a heterogeneous data source according to the metadata standard, storing the metadata in the metadata database, and using a metadata processing module to analyze the relationship between business metadata and technical metadata throughinfluence analysis, consanguinity analysis and whole chain analysis according to the metadata access information; using a data governance module to generate the quality rules of the to-be-governed table by identifying the relationship between the business metadata and the technical metadata, checks and compares the metadata content, and obtain the problem data, the error data, the correct data andthe quality analysis report; using a data sharing exchange module to provide data interface or push class service according to the data subscription mode, and output the data subscription result. Theinvention provides the unified management of the technical metadata and the service metadata, fully utilizes the data assets of the enterprise, and meets the service requirements of the enterprise for the cross-network safe data exchange.

The invention provides a city operation management center system. The system includes: a city data opening and information service sub-system, which uniformly fuses and encapsulates user information resources; a city coordination processing and linkage command sub-system, which deeply mines business relationships between various departments, and establishes a complete coordination processing system of daily city running of and a linkage command system of emergency treatment; a cyberspace comprehensive-governance sub-system, which caries out comprehensive network security supervision on city key-information infrastructure running status, and realizes system response to a unified situation of city cyberspace security; city running simulation and overall-planning sub-system, which provides knowledge and intelligence support with data as drives for city development planning, major-affair decision-making and major-event treatment decision-making; and a city running display and monitoring and early-warning sub-system, which displays basic information of realizing city governance, provides key sign information of city running, and carries out macroscopic display and early-warning analysison city running status.

Methods, including service methods, articles of manufacture, systems, articles and programmable devices provide a service-oriented architecture prioritization enablement framework. Business objectives and principles indicative of a service-oriented architecture enterprise are defined and categorized with respect to a plurality of business objectives and principles categories, and groupings of individual measurable business goals are categorized with respect to the categories. Total weight values are determined for each business goal as a product of an individual weighting values and base weightings of the categories. The business goal total weight values are iteratively applied priority values of a service of the service-oriented architecture associated with each business goal to generate a weighted priority values, which are aggregated to produce an aggregated priority weighting value for the service used for service prioritization.

The invention discloses a data governance method and a data governance system. The method comprises the following steps: carrying out the cleaning and fusion on a data source, and building a data standard library; collecting metadata of the data standard library by utilizing a meta-model, and governing the collected metadata to obtain governed metadata; standardizing data of the data standard library; and performing data quality management and supervision protection on the generated data. The problem of data waste is finally solved.

The invention provides a big data acquisition and governance quick retrieval system based on a data lake. The big data acquisition and governance quick retrieval system comprises a data acquisition front-end module, a data association metadata extraction module, a data resource pool module, a data governance module, a data service module and a data business module; the data association metadata extraction module is used for completing metadata extraction of multi-source heterogeneous data and storing extracted information in a distributed full-text retrieval database of the data service module; and the data service module has a function of automatically clearing cold data. According to the data lake-based data acquisition and governance quick retrieval system provided by the invention, thecharacteristics of a big data technology, a data governance technology and different types of databases are fully utilized, so that the problems of fragmentation of data resources and low data retrieval efficiency can be effectively avoided, and the problems of huge data storage resources and waste of storage resources are also avoided.

The invention relates to a multi-source heterogeneous data governance method and device. The method comprises the following steps: S1, constructing a query engine for uniformly connecting different types of databases and carrying out associated query by a standardized SQL grammar; S2, receiving a query instruction, connecting to a service of a query engine according to the received connection information of the data source, performing data query according to the received SQL statement, and returning a query result; and S3, receiving a processing instruction, correspondingly processing the query result according to the received processing instruction, and outputting a processing result. The multi-source heterogeneous data governance requirements are met, the process steps of data governanceare greatly simplified, and the operation and maintenance cost and time of governance tasks are reduced.

The invention relates to a system for realizing data governance in a big data environment, and the system comprises an environment initialization module which is used for providing basic operation conditions which need to be satisfied by the building of a data sharing platform, i.e., a data sharing platform product assembly, safety and a hardware environment; a data sharing design module which comprises an architecture layer and a core scene and service sharing publishing unit, and is used for providing services to the outside through the architecture layer; and a data governance application module which is used for establishing a data sharing integration platform and integrating the functions of resource integration, operation management, data development, data use, service engine management, scheduling planning, statistical monitoring and service authority configuration. By adopting the system for realizing data governance in the big data environment, the data sharing integration platform at the bottom layer of each business system is established, so that the platform runs through and manages the data of each business system, and the purposes of data exchange and sharing betweenthe respective business systems in governments and enterprises and data governance are achieved, and data value is increased.