A multi-source data collection and multi-dimensional table integration method and system

By using a browser plugin to collect data, combined with the platform's feature library and intelligent scrolling technology, the problems of complexity and instability of existing tools have been solved, enabling low-threshold, highly stable multi-source data collection and multi-dimensional table integration.

CN121808126BActive Publication Date: 2026-07-07YUNNAN TIANDU SOFTWARE SYSTEM CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN Β· China
Patent Type
Patents(China)
Current Assignee / Owner
YUNNAN TIANDU SOFTWARE SYSTEM CO LTD
Filing Date
2026-03-06
Publication Date
2026-07-07

AI Technical Summary

Technical Problem

Existing data collection tools have high barriers to entry, insufficient collection stability, difficulty in adapting to dynamic changes in platform page structure, and are easily identified by the platform, leading to collection interruptions or failures.

Method used

The system enables account authorization and multidimensional table link configuration through a browser plugin. It identifies page types based on the platform's page feature library, matches collection strategies, parses DOM nodes using multi-selector adaptation rules, and controls collection behavior with intelligent scrolling and preset time intervals to perform data deduplication and structure transformation.

Benefits of technology

It lowers the barrier to entry for data collection, improves collection stability and data management flexibility, and supports cross-scenario data sharing and team collaboration.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121808126B_ABST
    Figure CN121808126B_ABST
Patent Text Reader

Abstract

The application discloses a kind of multi-source data acquisition and multi-dimensional table integration method and system, it is related to data processing technical field, method takes browser plug-in as carrier, is authorized interface by plug-in call account, completes target platform authorization and multi-dimensional table link configuration, establishes data transmission channel;Based on preset platform page feature library, analyze current page URL and DOM node feature, determine page type and match collection strategy;According to collection strategy, trigger asynchronous loading by intelligent scrolling, parse DOM node in combination with multi-selector adaptation rule, extract public raw data;After screening duplicate by preset deduplication algorithm, according to structured rule, convert into standardized structured data;Data is synchronized to multi-dimensional table by transmission channel, complete integration.The application solves the problem that the use threshold of traditional data collection tool is high, cross-platform adaptability is poor, data collaboration management is weak, supports cross-scene sharing collaboration.
Need to check novelty before this filing date? Find Prior Art