Building data cleaning and merging method and device and storage medium

Abstract

The invention discloses a building data cleaning and merging method and device and a storage medium. The method comprises the following steps: acquiring multiple pieces of poi information corresponding to each building name according to the building name in the second building data; obtaining a plurality of poi information corresponding to each building address according to the building address in the second building data; combining the multiple pieces of poi information corresponding to the building name and the multiple pieces of poi information corresponding to the building address of the same building to obtain a poi information set of each building; selecting one piece of poi information from the poi information set of each building as first poi information of each building; and judging whether any two buildings are the same building or not according to the first poi information of each building, and de-duplicating the building data which are judged to be the same building in the second building data to obtain third building data. According to the technical scheme, efficient merging of the building data is achieved, and redundant data are greatly reduced.

Description

technical field [0001] The present invention relates to the technical field of data cleaning and merging, in particular to a method, device and storage medium for real estate data cleaning and merging. Background technique [0002] After the crawler completes the data crawling, it clusters the real estate names and real estate addresses to complete the data clustering under multiple data sources; at the same time, it matches the industrial and commercial registration addresses of the enterprises with the real estate addresses, and associates the relevant enterprises with the corresponding ones. Under real estate; so as to support users to obtain data on real estate across the country and mine under real estate companies on the product side. In the prior art, when cleaning and merging real estate data, there are the following disadvantages: [0003] (1) The same real estate has different names and real estate addresses in each source, and the validity of the data has not bee...

AI Technical Summary

Problems solved by technology

[0003] (1) The same real estate has different names and real estate addresses in each source, and the validity of the data has not been ensured through data cleaning and data return;

[0004] (2) Ordinary data cleaning and merging rules are inefficient, and because no corresponding recognition algorithm is introduced to identify and deduplicate the same real estate, there is a large amount of redundant data, which affects the subsequent application of real estate data

Images