Data access method and device, computer equipment and readable storage medium

A data access and data collection technology, applied in the field of data processing, can solve problems such as poor scalability, high data access costs, and low efficiency

Active Publication Date: 2018-03-27
RUN TECH CO LTD BEIJING
View PDF12 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, the above-mentioned data access work is mainly realized manually. The technical defects of this manual configuration grid transfer strategy are: high data access cost, low efficiency, and poor scalability

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data access method and device, computer equipment and readable storage medium
  • Data access method and device, computer equipment and readable storage medium
  • Data access method and device, computer equipment and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] figure 1 It is a flow chart of a data access method provided by Embodiment 1 of the present invention. This embodiment is applicable to data access, and the method can be executed by a data access device, which can be implemented by software and / or or hardware, and generally can be integrated into computer equipment. The method of this embodiment specifically includes the following steps:

[0032] Step 110, acquiring at least one first field to be mapped corresponding to the first external data set to be accessed.

[0033] In the data access method, the object of access is an external data set. For example: China Mobile needs to access each user's phone information data, SMS data, QQ chat data, WeChat data, etc., each user's phone information data, SMS data, QQ chat data, WeChat data, etc. It is connected to the data set of China Mobile as an external data set. Specifically, if the data of QQ chat is accessed as the first external data set, the external data set of ...

Embodiment 2

[0046] Figure 2a Embodiment 2 of the present invention provides a flow chart of a data access method. This embodiment is optimized based on the foregoing embodiments. In this embodiment, the first field between the first field to be mapped and the standard field is established according to the similarity between the standard field in the first standard data set and the first field to be mapped After the mapping relationship, it also includes: calculating the first field identity corresponding to the first field to be mapped; mapping the first field identity, the first standard data set identity, and the first field mapping relationship Stored in the mapping cache table.

[0047] Such as Figure 2a As shown, the embodiments of the present invention specifically include:

[0048] Step 210, acquiring at least one first field to be mapped corresponding to the first external data set to be accessed.

[0049] Step 220 , according to the word vectors corresponding to each word s...

Embodiment 3

[0081] Figure 3a It is a flow chart of data access provided by Embodiment 3 of the present invention, such as Figure 3a As shown, the specific steps of the data access are as follows:

[0082] Step 310, acquiring at least one second field to be mapped corresponding to the second external data set to be accessed.

[0083] Step 320, calculating a second field identifier corresponding to the second field to be mapped.

[0084] Wherein, the calculation process of the second field ID is the same as the calculation process of the first field ID in Embodiment 2 of the present invention. However, "first" and "second" in any embodiment of the present invention are merely differences and not limitations.

[0085] Step 330, judging whether the second field identifier is stored in the mapping cache table.

[0086] Step 340, if yes, obtain the second standard data set ID corresponding to the second field ID and the second field mapping relationship in the mapping cache table. And ex...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data access method and device, computer equipment and a readable storage medium. At least one first field to be mapped corresponding to a first external dataset to be accessed is acquired; based on a term vector corresponding to each participle in the first fields to be mapped, a dataset vector to be matched corresponding to the first external dataset is obtained; based on the dataset vector to be matched and a dataset sorting model trained in advance, a first standard dataset matched with the first external dataset is determined; based on the similarity between standard fields in the first standard dataset and the first fields to be mapped, first field mapping relationships between the first fields to be mapped and the standard fields are built; based on the first field mapping relationships, the first external dataset is accessed into the first standard dataset. By means of the data access method and device, the computer equipment and the readable storage medium, automatic recommendation of data access and automatic mapping of field levels can be achieved.

Description

technical field [0001] The embodiments of the present invention relate to data processing technologies, and in particular to a data access method, device, computer equipment and readable storage medium. Background technique [0002] In the production process of enterprises, there is a large amount of data access work every day. For example, China Mobile needs to access the data of each user's phone information, SMS data, QQ chat data, WeChat data, etc., and the data format of the access It is often not the same, and enterprises need to invest a lot of time and manpower to configure data storage and transfer strategies in different formats. [0003] At present, the above-mentioned data access work is mainly implemented manually. The technical defects of this manual configuration grid transfer strategy are: high data access cost, low efficiency, and poor scalability. Contents of the invention [0004] The invention provides a data access method, device, computer equipment a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/22G06F16/2255G06F16/258
Inventor 谢永恒李贺火一莽万月亮
Owner RUN TECH CO LTD BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap