Big data exploration and cognition method, device and equipment and computer storage medium

A technology of big data and data source, applied in the direction of digital data information retrieval, computing, electronic digital data processing, etc., can solve problems such as difficult combing or mining, hiding, etc., to reduce running time, improve accuracy, and reduce the number of features Effect

Active Publication Date: 2019-11-12
赵玉德 +1
View PDF20 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to solve the current problem that it is difficult to sort out or mine useful / valuable data hidden in massive data, the purpose of the present invention is to provide a big data exploration and cognition method, device, equipment and computer storage medium

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data exploration and cognition method, device and equipment and computer storage medium
  • Big data exploration and cognition method, device and equipment and computer storage medium
  • Big data exploration and cognition method, device and equipment and computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0075] Such as Figure 1-11 As shown, the big data exploration and recognition method provided in this embodiment may, but is not limited to, include the following steps S101-S106.

[0076] S101. Data source creation and management: Create target data sources that require exploration and cognition, including but not limited to data source types, database server IP addresses, login user names, login passwords, and database names.

[0077]In said step S101, the data source is the data source, which is the source of the data set, and can be data in various business fields, such as CRM (Customer Relationship Management, customer relationship management), ERP (Enterprise Resource Planning, enterprise resource planning), ecommerce (e-commerce), SCM (Supply Chain Management, supply chain management), Legacy and External (historical and external data), ... and so on. These data can be stored in various databases, such as MySQL, Oracle, SQL Server, DB2, Sybase, Hive, PostgreSQL, Terad...

Embodiment 2

[0111] Such as Figure 12 As shown, this embodiment provides a hardware device for implementing the big data exploration and cognition method described in Embodiment 1, including a data source creation and management module, a data set creation and management module, a data table and field configuration module, an exploration Task configuration module, exploration task execution module and exploration result visualization module;

[0112] The data source creation and management module is used for data source creation and management: creating a target data source that needs to be explored and recognized, including the data source type, the IP address of the database server, the login user name, the login password and the database name;

[0113] The data set creation and management module is communicatively connected to the data source creation and management module for data set creation and management: based on the created data source, a data set name is created to contain the ...

Embodiment 3

[0120] Such as Figure 13 and 14 As shown, this embodiment provides a hardware device for implementing the big data exploration and recognition method described in Embodiment 1, including a memory and a processor connected by communication, wherein computer-readable instructions are stored in the memory, and the When the computer-readable instructions are executed by the processor, the processor is made to execute the steps of the method for exploring and recognizing big data as described in Embodiment 1. Such as Figure 13 As shown, the big data exploration and cognitive equipment includes a processor, a memory, and a network interface connected through a system bus, wherein the processor is used to provide computing and control capabilities; the memory includes a non-volatile storage medium and an internal memory , the non-volatile storage medium stores the operating system and the computer-readable instructions, the internal memory provides an environment for the operatio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of data processing and analysis. The invention discloses a big data exploration and cognition method, device and equipment and a computer storage medium. Therefore, in the aspects of big data application engineering, ETL development, data processing, cleaning, integration, analysis modeling and the like, and massive data of various different data sources, the total collection information containing each data table and even each field can be explored and obtained, and the total collection information is automatically displayed in a visual view and table, so that a user obtains comprehensive cognition on the data. At present, many data warehouses, ETL, BI, data mining, machine learning and big data analysis projects are often informed of tiger heads and snakes or failures. The important reason is that the data universal set is inadequate in cognition, has deviation or is generally complete at the beginning, so that the user can be better helped and guided to plan and develop the projects in a targeted and symptomatic way, and the projects are prevented from being ended by tiger snakes or failures as much as possible.

Description

technical field [0001] The invention belongs to the technical field of data processing and analysis, and in particular relates to a big data exploration and cognition method, device, equipment and computer storage medium. Background technique [0002] Big data refers to a collection of data that cannot be captured, managed and processed by conventional software tools within a certain period of time. , high growth rates and diverse information assets. In recent years, with the rapid development of Internet technology, computer technology, and database technology, a large amount of data information has appeared in our daily work and life, and these data information has maintained a high-speed increase at a geometric growth rate, which has led to information volume. The growth rate is far faster than human comprehension, and it is pouring into human life in all directions in waves. Faced with the ever-increasing mass of data, it is currently difficult to manually sort out and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2458G06F16/248
CPCG06F16/2465G06F16/248Y02D10/00
Inventor 赵玉德
Owner 赵玉德
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap