Internet of Things data cleaning method

A data cleaning and Internet of Things technology, applied in the field of data processing, can solve problems such as difficulties in information integration

Inactive Publication Date: 2015-12-23
HUNAN UNIV OF HUMANITIES SCI & TECH
View PDF8 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since each WEB trading platform expresses information in different ways, it brings certain difficulties to information integration

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Internet of Things data cleaning method
  • Internet of Things data cleaning method
  • Internet of Things data cleaning method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] Preferred embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0025] This application provides a data cleaning method for the Internet of Things, which is used to wash away dirty data in multiple data, find and correct identifiable errors in data files, remove those data that do not meet the requirements, and retain data that meets data quality conditions. Data, and then establish a database with qualified data to provide a strong guarantee for follow-up research work. Such as figure 1 As shown, the data cleaning method includes the following steps:

[0026] S1. Obtain product original records through multiple WEB trading platforms;

[0027] S2. Detect and clear multiple similar duplicate records in the original product records;

[0028] S3. Integrate the remaining records, and map the structure and data in the remaining data sources to the target structure and domain;

[0029] In this step, the buc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides an Internet of Things data cleaning method. The method comprises the following steps: S1, acquiring original product records by using a plurality of WEB transaction platforms; S2, detecting and clearing a plurality of approximately duplicated records of the original product records; S3, integrating remaining records, and mapping a structure and data in a remaining data source to a target structure and a domain; S4, defining a cleaning rule by software configuration or by using a configuration file; and S5, reading the set cleaning rule and cleaning the data. The method provided by the present application can convert dirty data of a plurality of original product records acquired from a plurality of WEB transaction platforms into data meeting a data quality condition, thereby forming a comprehensive and professional Internet of Things product database, and presenting a powerful guarantee for providing an efficient and professional product transaction information service.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a data cleaning method of the Internet of Things. Background technique [0002] Since the emergence of the Internet, the number of WEB pages on the Internet has grown rapidly, and it is precisely because of this growth rate that the world's largest information resource library has been formed. WEB information integration technology is to effectively process this information resource library, integrate relevant information, and provide data support for data mining, so that it can be better applied to information services in professional fields. In the current rapidly developing network age, information resources are increasingly abundant, and WEB information integration has become an important content in the information age, and WEB information integration has applications in many fields. [0003] For example, in the field of the Internet of Things, product suppliers can publish pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/215
Inventor 谢东肖东成运
Owner HUNAN UNIV OF HUMANITIES SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap