Method and system for filtering and sorting subject datasets based on overall data quality

Abstract

The invention provides a subject data set filtering and ordering method and system based on total data quality. The method comprises the following steps that the data quality requirements of a user on data sets are consulted in a human-computer interaction interface according to subject data sets and quality metadata thereof which are sought by the user in a data directory; the subject data sets are filtered according to the mandatory quality measure requirement specified in the data quality requirements of the user on the data sets; the total data quality of the subject data sets obtained after filtering is calculated according to the quality measure indexes and the weight therefore which are selected in the data quality requirements of the user on the data sets, and the subject data sets are ordered accordingly; information of the subject data sets obtained after filtering and ordering is output in the human-machine interaction interface. Accordingly, the defect that in an existing data set subject seeking and filtering technique, the data quality is ignored is overcome, the user can conveniently screen out the subject data sets which meet the mandatory quality measure requirement and the total data quality requirement, and the development trend of a data directory portal technique is represented.

Description

technical field [0001] The invention belongs to the interdisciplinary fields of data set search and filtering, Web data directory and metadata, data quality management and other technical fields, and relates to a theme data set filtering technology based on overall data quality, especially a theme based on overall data quality Data set filtering and sorting method and system. Background technique [0002] Data is an important resource that can create huge value in today's world, and the World Wide Web (Web for short) has become a mainstream platform for data release, use, and consumption. Various data catalogs (data catalogs / catalogues) holding a large number of datasets (datasets) are centrally published on the Web, forming so-called data catalog portals (or data portals for short). The datasets in some open data (open data) catalog portals are free for data consumers (commonly referred to as "users"), such as: including the US government open data portal DATA.GOV ( https...

AI Technical Summary

Problems solved by technology

[0027] The technical problem to be solved by the present invention is to provide a new system for filtering and sorting the subject search result data set (i.e. subject data set) of the data directory portal based on the mandatory requirements of the quality measurement value specified by the user and the overall data quality requirements. Method and system, so as to overcome the shortcomings of the existing data set subject search and filtering technology ignoring data quality, facilitate users to filter out subject data sets that meet their specific data quality requirements, and solve a problem that people are eager to solve but have not been able to obtain A successful classic technical problem - "select data resources from the perspective of data quality"; at the same time, increase the chances of the data (sets) published on the Web being consumed by a wide range of users, promote the healthy development of the data ecosystem, and represent new technologies inevitable trend of development

Images