Omni-channel data middle table auxiliary construction method and system

Abstract

The invention discloses an auxiliary construction method and system for an omni-channel data middle table, and relates to the technical field of data processing, a multi-channel data source is accessed, collected metadata is converted into an intermediate data vector, and the intermediate data vector is stored in an original data pool; performing intelligent identification and analysis on metadata in the original data pool in combination with the intermediate data vector to generate an auxiliary processing data set; processing the metadata in the original data pool into a subject domain data table based on the generated auxiliary processing data set; and packaging the processed subject domain data table into a data service component with a standard API (Application Program Interface), taking each data service component as a reusable data asset, and registering the data service component into a data asset directory for unified management. According to the method, the automation level and the intelligence level of data middle table construction are remarkably improved, data quality and consistency are effectively guaranteed through metadata intelligent analysis, dynamic modeling and conflict resolution, and the problem of data islands is solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data processing, and in particular to a full-channel data middle platform assisted construction method and system. BACKGROUND

[0002] With the deepening of enterprise digital transformation, more and more business channels (including online malls, offline stores, mobile applications, social media, third-party platforms, etc.) have generated massive heterogeneous data. These data are usually scattered in different systems, with different formats and standards, forming a serious data island phenomenon, making it difficult for enterprises to realize unified access, fusion analysis and value mining of data. Therefore, as an enterprise-level data sharing and capability reuse platform, data middle platform has gradually become the core infrastructure for enterprises to integrate data resources and support front-end business innovation.

[0003] However, the construction process of the existing data middle platform still faces many challenges. First, the traditional data integration method usually customizes development for specific channels or systems, lacks unified access standards and specifications, resulting in low access efficiency and poor scalability. Second, in the process of multi-source heterogeneous data fusion, data cleaning, conversion, modeling and other links rely heavily on manual experience, which not only is inefficient, but also easily introduces errors, making it difficult to ensure the consistency and reliability of data quality. In addition, the existing middle platform construction method often lacks support for visual management of data assets and agile development, making it difficult for business personnel to quickly understand and utilize data services in the middle platform, thereby affecting the effectiveness of data-enabled business.

[0004] Therefore, there is an urgent need for a systematic and highly automated assisted construction method to help enterprises efficiently and normatively complete the access, integration and management of full-channel data, improve the construction efficiency and quality of data middle platform, and ultimately support enterprise data-driven decision-making and business innovation. SUMMARY

[0005] The present application provides a full-channel data middle platform assisted construction method, comprising: Step 1, access multi-channel data sources, and store the collected metadata into an original data pool after being converted into intermediate data vectors; Step 2, intelligently identify and analyze the metadata in the original data pool in combination with the intermediate data vectors, and generate an assisted processing data set; Step 3, process the metadata in the original data pool into a subject domain data table based on the generated assisted processing data set; Step 4, encapsulate the processed subject domain data table into a data service component with a standard API interface, and register each data service component as a reusable data asset in a data asset directory for unified management.

[0006] The full-channel data middle platform assisted construction method as described above, wherein multi-channel data sources are accessed, and the collected metadata is converted into an intermediate data vector and stored in an original data pool, and the specific steps are as follows: According to the data source information configured by the user, the corresponding data connector is loaded; A temporary connection is established with the target data source by using the loaded data connector, and the metadata therein is automatically collected; The collected metadata is converted into an intermediate data vector and stored in the original data pool.

[0007] The full-channel data middle platform assisted construction method as described above, wherein the metadata in the original data pool is intelligently identified and analyzed in combination with the intermediate data vector, and the specific steps are as follows: Deep features are obtained by fusing the intermediate data vector and the knowledge in the knowledge graph in the field; Based on the deep features, the fields in the original data pool are clustered, and the topic domain clusters are output; A field association subgraph is constructed for each topic domain cluster; The output topic domain clusters and the constructed field association graphs are integrated to obtain the generated auxiliary processing dataset.

[0008] The full-channel data middle platform assisted construction method as described above, wherein the metadata in the original data pool is processed into a topic domain data table based on the generated auxiliary processing dataset, and the specific steps are as follows: The main field of each topic domain cluster is determined by using a field scoring function; Using a cross-domain field parsing function, the field redundancy and conflict between different topic domains are eliminated; The optimal data table structure is dynamically generated for each topic domain, and the standard data definition language script is converted and executed in the target library of the middle platform.

[0009] The application also provides a full-channel data middle platform assisted construction system, comprising: a data source access module, a metadata analysis module, a topic domain data table generation module, and a data service component packaging module; The data source access module is used to access multi-channel data sources, and the collected metadata is converted into an intermediate data vector and stored in an original data pool; The metadata analysis module is used to intelligently identify and analyze the metadata in the original data pool in combination with the intermediate data vector, and generate an auxiliary processing dataset; The topic domain data table generation module is used to process the metadata in the original data pool into a topic domain data table based on the generated auxiliary processing dataset; The data service component packaging module is used for packaging the processed subject domain data table into a data service component with a standard API interface, and registering each data service component as a reusable data asset into a data asset directory for unified management.

[0010] The application has the following beneficial effects: the automation and intelligent level of data middle platform construction is significantly improved, the data quality and consistency are effectively guaranteed through metadata intelligent analysis, dynamic modeling and conflict resolution, and the data island problem is solved; meanwhile, the data table is automatically packaged into a standard reusable API service and is uniformly managed, the agile reuse and efficient management of data assets are realized, the development and operation cost is greatly reduced, and the business rapid innovation is enabled. BRIEF DESCRIPTION OF DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can also be obtained by those skilled in the art based on these drawings.

[0012] Figure 1 It is a full-channel data middle platform auxiliary construction method flow chart provided by the embodiment one of the present application. DETAILED DESCRIPTION

[0013] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some embodiments of the present application, not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0014] Embodiment one

[0015] As shown in the figure, the embodiment one of the present application provides a full-channel data middle platform auxiliary construction method, which comprises: Figure 1 Step S110: access to multi-channel data sources, and store the collected metadata into an intermediate data vector to an original data pool, which is specifically divided into the following sub-steps: Step S111: according to the user configured data source information, load the corresponding data connector; Step S111: according to the user configured data source information, load the corresponding data connector; The system receives data source configuration information input by the user through a graphical interface. The configuration information includes data source type, connection address, authentication credentials, and sampling parameters. Based on the data source type, the system automatically matches and loads the corresponding data connector from a pre-set connector library. The data connector supports multiple data source types, including relational databases, non-relational databases, API interfaces, log files, and message queues.

[0016] Step S112: Establish a temporary connection with the target data source using the loaded data connector and automatically collect the metadata therein; Using the loaded data connector, a temporary connection is established with the target data source based on the provided connection address and authentication credentials, and a connectivity test is performed. After a successful connection, the available data entities in the data source are automatically detected, and their metadata information is collected. The metadata includes, but is not limited to, data table structure, field names, data types, and constraint information.

[0017] Step S113: Convert the collected metadata into an intermediate data vector and persist it to the original data pool; Metadata collected from different data sources is standardized, then uniformly converted into intermediate data vectors and persistently stored in the original data pool. The transformation process from metadata to intermediate data vectors is as follows: ① Construct feature groups for each field of the metadata; The feature group representation of a single field in metadata is as follows: ,in The word vector for the field name. For the one-hot encoded vector of the data type, A multidimensional binary vector representing the constraints. A statistical vector composed of statistical characteristics of the sample data (proportion of unique values, proportion of missing values, etc.).

[0018] ② Input each of the constructed feature groups into the data transformation formula to obtain the transformed intermediate data vector; The data transformation formula is expressed as follows: ,in This is the intermediate data vector after transformation. These are the contribution coefficients of different feature dimensions to the intermediate data vector. These are mapping matrices corresponding to the respective features, obtained through pre-training. The process includes: Construct a sample set consisting of the original fields and the standard target fields; A dual-tower neural network model was built, using data transformation formulas as field encoders; Using contrastive learning as the training paradigm, the optimization objective is to maximize the similarity of positive sample pairs and minimize the similarity of negative sample pairs. The mapping matrix is ​​iteratively optimized using the backpropagation algorithm until the model converges. The mapping matrix obtained from solidified training is used to generate all subsequent intermediate data vectors.

[0019] ③ Associate metadata fields and their transformed intermediate data vectors.

[0020] Step S120: Combine intermediate data vectors to intelligently identify and analyze metadata in the original data pool to generate an auxiliary processing dataset; Before performing intelligent identification and analysis on metadata, it is necessary to pre-build a domain-specific knowledge graph based on industry standard data models, the company's existing data dictionary, and business process documents. The construction process is as follows: ① Extract entity, relation, and attribute metadata from the collected domain information; For structured data, the database metadata (table structure, foreign key constraints, comments) is read directly, and the database tables are automatically mapped to entity types, fields are mapped to attributes, and foreign keys are mapped to relationships. For unstructured or semi-structured data, entity recognition and relationship and attribute extraction are performed based on a pre-trained language model.

[0021] ② After cleaning the extracted three-dimensional data, store it in the native graph database to form a domain knowledge graph; Semantic similarity is used to determine whether records from different data sources point to the same entity. If they come from the same entity and have multiple conflicting attribute values, a confidence strategy is formulated based on factors such as the reliability of the data source and timestamps, automatically selecting the most reliable value; other non-conflicting attribute values ​​are merged. After processing, the data is stored in a native graph database to form a domain-specific knowledge graph.

[0022] The metadata in the original data pool is intelligently identified and analyzed by combining intermediate data vectors to generate an auxiliary processing dataset, which is divided into the following sub-steps: Step S121: Merge the intermediate data vectors and the knowledge in the domain knowledge graph to obtain deep features; First, using field i as the query entity, we retrieve its adjacent subgraph in the domain knowledge graph and generate a semantic embedding vector through a graph attention network; then, we use a lightweight Transformer encoder to embed the intermediate data vector. Contextual semantics are extracted to obtain a context vector; then, multilayer perceptron is used to fuse the context vector and the semantic embedding vector to obtain the deep features of field i. .

[0023] Step S122: Cluster the fields in the original data pool based on deep features to output topic domain clusters; For each field i, it is treated as a potential positive sample along with other fields from the same data source, and as a hard negative sample along with fields from different sources but with similar names. A clustering-oriented encoder is trained using contrastive learning loss, which clusters similar fields in the vector space and separates dissimilar fields. The optimal number of clusters k is dynamically determined, and the output topic domain clusters C = {C1, C2, ..., C} are obtained. k}

[0024] Step S123: Construct a field association subgraph for each subject domain cluster; Using fields within a single topic domain cluster as nodes, edge weights Through the formula: Calculate and construct a field association subgraph, where i and j represent any field in a single subject domain cluster, and These are the depth features of fields i and j, respectively. This is the cosine similarity calculation function. This is a co-occurrence frequency calculation function used to count the frequency with which fields i and j appear together in actual business data (such as a single response, Jason). This is a naming similarity calculation function used to calculate the string similarity between the names of fields i and j. These are adjustable weighting coefficients.

[0025] To preserve cross-domain relationships between fields, a global field relationship graph needs to be built for all fields, constructed in the same way as the subgraph.

[0026] Step S124: Integrate the output topic domain clusters with the constructed field association graph to obtain the generated auxiliary processing dataset; The generated auxiliary processing dataset includes a list of subject domains, a list of fields under each domain, a global field relationship graph, and field relationship subgraphs under each domain.

[0027] Step S130: Based on the generated auxiliary processing dataset, process the metadata in the original data pool into a subject domain data table; Based on the generated auxiliary processing dataset, the metadata in the original data pool is automatically and intelligently constructed into subject domain data tables, which is divided into the following sub-steps: Step S131: Use the field scoring function to determine the main field of each subject domain cluster; The field scoring function is used to calculate the score of each field within a subject domain cluster, and the top 20% of fields with the highest scores are selected as the main field set for that subject domain, used to construct the core structure of the data table; the field scoring function... Represented as: Where i represents any field within the current subject domain cluster, This indicates that field i is in the global field association graph. The degree in the middle, This represents the edge weights of fields i and j within the subgraph associated with the fields of the current topic domain. , Let j be the set of adjacent fields within the field association subgraph. This indicates the total number of fields in the adjacent field set. Represents the deep feature vector of field i The cosine similarity between the semantic vector of the entity E corresponding to the current topic domain in the domain knowledge graph and the semantic vector of the entity E. This is an adjustable parameter.

[0028] Step S132: Use cross-domain field resolution functions to eliminate field redundancy and conflicts between different subject domains; To avoid field redundancy and conflicts between data tables of different subject domains, this application constructs a cross-domain field parsing function to determine the subject domain to which a field existing in multiple subject domain clusters ultimately belongs. Represented as: ,in For subject area indexing, It is the collection of all subject domain clusters containing field i. For field i in the subject domain The rating in the middle, For field i, pair of subject domains The specificity of field i, i.e., the relationship between field i and the subject domain. The average association strength of the main field set This is a weighting factor.

[0029] Field i was ultimately divided into Within a subject domain, only one soft link (foreign key association) is retained in other subject domains, thereby achieving both the uniqueness of physical storage and the completeness of logical association.

[0030] Step S133: Dynamically generate the optimal data table structure for each subject area, convert it into a standard data definition language script, and then execute it in the target library of the middle platform; Using the selected set of primary fields as the seed table structure, calculate the target value of each candidate field (other fields not included in the seed table structure) in the current subject domain cluster after adding it to the seed table structure. Select the candidate field with the smallest target value and add it to the seed table structure. Then, calculate the target value of each candidate field after adding it to the current seed table structure again, and select the candidate field with the smallest target value again. Repeat this process until the preset number of fields is reached, and output the current seed table structure as the final data table structure of the current subject domain.

[0031] Function for calculating the target value Represented as: ,in For the current seed table structure, Returns the average association strength between field i and all fields in the main field set P. Assign the edge weights between fields i and j in the field association subgraph of the current topic domain. is the regularization coefficient.

[0032] Using custom rules or templates, the output topic domain data table structure is converted into a DDL script for the middleware target library. After execution, the corresponding physical table will be automatically created in the library.

[0033] Step S140: Encapsulate the processed subject domain data table into a data service component with a standard API interface, and register each data service component as a reusable data asset in the data asset catalog for unified management; Define a standard RESTful API interface for each generated subject domain data table, including but not limited to common data operation interfaces such as single query, batch query, pagination query, and conditional filtering; the input parameters and output format (JSON / XML) of the API follow the predefined specifications; then, encapsulate the subject domain data table and its corresponding API interface into an independent data service component, publish it to the data platform's runtime environment, and provide access addresses to the outside world; the published data service component is registered in the data asset catalog as a reusable data asset to achieve unified monitoring, version management, and access control, ensuring the controllability and security of data assets.

[0034] Example 2

[0035] This application provides a full-channel data middle platform auxiliary construction system, including: a data source access module, a metadata analysis module, a subject domain data table generation module, and a data service component encapsulation module; (1) Data source access module, used to access multiple data sources, convert the collected metadata into intermediate data vectors and store them in the original data pool; specifically including: data connector loading submodule, metadata collection submodule, and metadata conversion submodule; 1. The data connector loading submodule is used to load the corresponding data connector based on the data source information configured by the user. 2. Metadata collection submodule, used to establish a temporary connection with the target data source using the loaded data connector, and automatically collect the metadata therein; 3. Metadata Transformation Submodule: This module is used to transform the collected metadata into intermediate data vectors and persistently store them in the original data pool.

[0036] (2) Metadata analysis module, which is used to intelligently identify and analyze the metadata in the original data pool by combining intermediate data vectors, and generate auxiliary processing datasets; specifically including: domain knowledge graph construction submodule, deep feature generation submodule, topic domain cluster output submodule, and field association graph construction submodule; 1. Domain-specific knowledge graph construction submodule, used to construct a domain-specific knowledge graph based on data information within the business domain; 2. Deep Feature Generation Submodule, used to fuse intermediate data vectors and knowledge from the domain knowledge graph to obtain deep features; 3. The topic domain cluster output submodule is used to cluster fields in the original data pool based on deep features and output topic domain clusters; 4. Field Association Graph Construction Submodule: This module is used to construct a global field association graph and to build a field association subgraph for each subject domain cluster.

[0037] (3) Subject domain data table generation module, which is used to process the metadata in the original data pool into subject domain data tables based on the generated auxiliary processing dataset; specifically including: main field determination submodule, redundancy elimination submodule, physical table creation submodule; 1. The main field determination submodule is used to determine the main field of each subject domain cluster using field scoring functions; 2. Redundancy elimination submodule, used to eliminate field redundancy and conflicts between different subject domains using cross-domain field resolution functions; 3. The physical table creation submodule is used to dynamically generate the optimal data table structure for each subject domain, convert it into a standard data definition language script, and then execute it in the target library of the middle platform.

[0038] (4) Data service component encapsulation module, which is used to encapsulate the processed subject domain data table into a data service component with a standard API interface, and register each data service component as a reusable data asset in the data asset catalog for unified management.

[0039] Corresponding to the above embodiments, the present invention provides a computer storage medium, including: at least one memory and at least one processor; The memory is used to store one or more program instructions; A processor is used to run one or more program instructions to execute a method for building an omnichannel data platform.

[0040] Corresponding to the above embodiments, this embodiment of the invention provides a computer-readable storage medium containing one or more program instructions, which are executed by a processor to provide a method for assisting in the construction of an omnichannel data platform.

[0041] The embodiments disclosed in this invention provide a computer-readable storage medium storing computer program instructions, which, when executed on a computer, cause the computer to perform the aforementioned method for assisting in the construction of an omnichannel data platform.

[0042] In this embodiment of the invention, the processor can be an integrated circuit chip with signal processing capabilities. The processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0043] The various methods, steps, and logic diagrams disclosed in the embodiments of this invention can be implemented or executed. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this invention can be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. The processor reads information from the storage medium and, in conjunction with its hardware, completes the steps of the above methods.

[0044] The storage medium can be memory, such as volatile memory or non-volatile memory, or may include both volatile and non-volatile memory.

[0045] Among them, non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory.

[0046] Volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (Synchlink DRAM, SLDRAM), and direct memory bus RAM (DRRAM).

[0047] The storage media described in the embodiments of the present invention are intended to include, but are not limited to, these and any other suitable types of memory.

[0048] Those skilled in the art will recognize that, in one or more of the examples above, the functions described in this invention can be implemented using a combination of hardware and software. When applied as software, the corresponding functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transmission of computer programs from one place to another. Storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0049] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made on the basis of the technical solution of the present invention should be included within the scope of protection of the present invention.

Claims

1. A method for assisting in the construction of an omnichannel data platform, characterized in that, include: Step 1: Connect to multiple data sources, convert the collected metadata into intermediate data vectors, and then store them in the original data pool; Step 2: Combine intermediate data vectors to intelligently identify and analyze metadata in the original data pool to generate auxiliary processing datasets; Step 3: Based on the generated auxiliary processing dataset, process the metadata in the original data pool into subject domain data tables; Step 4: Encapsulate the processed subject domain data tables into data service components with standard API interfaces, and register each data service component as a reusable data asset in the data asset catalog for unified management.

2. The method for assisting in the construction of an omnichannel data platform according to claim 1, characterized in that, Accessing multiple data sources and converting the collected metadata into intermediate data vectors before storing them in the raw data pool involves the following sub-steps: Load the corresponding data connector based on the user-configured data source information; The loaded data connector establishes a temporary connection with the target data source and automatically collects its metadata. The collected metadata is transformed into intermediate data vectors and persistently stored in the original data pool.

3. The method for assisting in the construction of an omnichannel data platform according to claim 2, characterized in that, The collected metadata is transformed into an intermediate data vector, which is divided into the following sub-steps: Build feature groups for each field of the metadata; Each of the constructed feature groups is input into the data transformation formula to obtain the transformed intermediate data vector; Associate metadata fields and their transformed intermediate data vectors.

4. The method for assisting in the construction of an omnichannel data platform according to claim 3, characterized in that, The process of intelligently identifying and analyzing metadata in the original data pool by combining intermediate data vectors involves the following sub-steps: Deep features are obtained by fusing intermediate data vectors and knowledge from domain-specific knowledge graphs; Clustering of fields in the original data pool based on deep features outputs topic domain clusters; Construct a field association subgraph for each subject domain cluster; By integrating the output subject domain clusters with the constructed field association graph, a dataset for auxiliary processing is generated.

5. The method for assisting in the construction of an omnichannel data platform according to claim 4, characterized in that, The construction of the knowledge graph in the aforementioned domain is specifically divided into the following sub-steps: Extract the three metadata elements of entities, relationships, and attributes from the collected domain information; The extracted three-dimensional data are cleaned and stored in a native graph database to form a domain knowledge graph.

6. The method for assisting in the construction of an omnichannel data platform according to claim 5, characterized in that, Based on the generated auxiliary processing dataset, the metadata in the original data pool is processed into subject domain data tables, which is divided into the following sub-steps: Use field scoring functions to determine the main fields for each topic domain cluster; Use cross-domain field resolution functions to eliminate field redundancy and conflicts between different subject domains; The optimal data table structure is dynamically generated for each subject area, converted into a standard data definition language script, and then executed in the target library of the middle platform.

7. A system for assisting in the construction of an omnichannel data platform, characterized in that, include: Data source access module, metadata analysis module, subject domain data table generation module, data service component encapsulation module; The data source access module is used to access data sources from multiple channels, and to convert the collected metadata into intermediate data vectors and store them in the raw data pool. The metadata analysis module is used to intelligently identify and analyze the metadata in the original data pool by combining intermediate data vectors, and generate auxiliary processing datasets. The subject domain data table generation module is used to process the metadata in the original data pool into subject domain data tables based on the generated auxiliary processing dataset. The data service component encapsulation module is used to encapsulate the processed subject domain data tables into data service components with standard API interfaces, and register each data service component as a reusable data asset in the data asset catalog for unified management.

8. The omnichannel data platform-assisted construction system according to claim 7, characterized in that, The data source access module specifically includes: a data connector loading submodule, a metadata collection submodule, and a metadata transformation submodule; The data connector loading submodule is used to load the corresponding data connector based on the data source information configured by the user. The metadata collection submodule is used to establish a temporary connection with the target data source using the loaded data connector and automatically collect the metadata therein; The metadata transformation submodule is used to transform the collected metadata into intermediate data vectors and persistently store them in the original data pool.

9. The omnichannel data platform assisted construction system according to claim 7, characterized in that, The metadata analysis module specifically includes: a domain knowledge graph construction submodule, a deep feature generation submodule, a topic domain cluster output submodule, and a field association graph construction submodule; The domain-specific knowledge graph construction submodule is used to construct a domain-specific knowledge graph based on data information within the business domain. The deep feature generation submodule is used to fuse intermediate data vectors and knowledge from the domain knowledge graph to obtain deep features; The topic domain cluster output submodule is used to cluster fields in the original data pool based on deep features and output topic domain clusters; The Field Association Graph Construction Submodule is used to construct a global field association graph and to construct a field association subgraph for each subject domain cluster.

10. A computer storage medium, characterized in that, include: At least one memory and at least one processor; Memory, used to store one or more program instructions; A processor for running one or more program instructions to execute a method for assisting in the construction of an omnichannel data platform as described in any one of claims 1-6.

Images