Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Visual ElasticSearch data acquisition method and device

A data acquisition and data technology, applied in structured data retrieval, electronic digital data processing, database management systems, etc., can solve the problems of slow acquisition, low efficiency, single-task execution, etc., to improve efficiency and ease of use. sexual effect

Active Publication Date: 2019-04-16
CHENGDU SEFON SOFTWARE CO LTD
View PDF9 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, data collection is usually completed by third-party plug-ins, which require the use of command lines or complex configurations. The learning cost and usage threshold are high, and only a single task can be executed, and the collection speed is slow and inefficient.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Visual ElasticSearch data acquisition method and device
  • Visual ElasticSearch data acquisition method and device
  • Visual ElasticSearch data acquisition method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] Such as figure 1 As shown, a visual ElasticSearch data collection method is applied to a user terminal communicating with a node server, and the method includes:

[0033] Create visualization components, which include input plug-ins, output plug-ins, and scheduling plug-ins. By visualizing the entire process of data collection, users only need to make simple configurations to start data collection, without the need for abstract and hard-to-remember commands and complex and cumbersome configuration operations. User experience, reduce learning cost and use threshold, the collection process is intelligently controlled by the dispatch center, without manual intervention, and can monitor the collection details in real time.

[0034] Create tasks by associating input plugins, output plugins and scheduling plugins. Each plugin is independent, and a complete task chain consists of input plugins, output plugins and scheduling plugins.

[0035] Configure the input plug-in, the c...

Embodiment 2

[0043] Such as image 3 As shown, a visualized ElasticSearch data collection device, the device includes: a designer and a manager, the designer is used to create tasks through visual components, a complete task chain is composed of three plug-ins: input plug-in, output plug-in and scheduling plug-in, and the visual operation The specific process is: select the plug-in on the designer page, press and hold the left mouse button, drag it into the editing area, double-click the plug-in to edit the detailed configuration information of the plug-in, then point the mouse to one of the plug-ins, hold down the left button and drag to another plug-in Connection association; the manager is used to assign the target running node to the task, and send the created task to the target running node, and the target running node performs data collection according to the configuration information of the input plug-in, output plug-in and scheduling plug-in.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a visual ElasticSearch data acquisition method and device, and the method comprises: building a visual assembly which comprises an input plug-in, an output plug-in, and a scheduling plug-in; creating a task by associating an input plug-in, an output plug-in and a scheduling plug-in; respectively carrying out parameter configuration on the input plug-in, the output plug-in and the scheduling plug-in to obtain an input plug-in configuration file, an output plug-in configuration file and a scheduling plug-in configuration file; configuring running nodes and task strategiesof the tasks; loading a task strategy, and obtaining node information of the target running node; sending a task to the target operation node according to the node information of the target operationnode, so that the target operation node acquires and analyzes the input plug-in configuration file, the output plug-in configuration file and the scheduling plug-in configuration file, and executingdata acquisition. According to the invention, the configuration process is simplified, multi-task and multi-node concurrent acquisition can be realized at the same time, the data acquisition efficiency is effectively improved, and the use cost is reduced.

Description

technical field [0001] The invention relates to the technical field of data collection, in particular to a visualized ElasticSearch data collection method and device. Background technique [0002] ElasticSearch is a Lucene-based search server that provides a distributed multi-user capable full-text search engine based on a RESTful web interface. Elasticsearch is developed in Java and released as open source under the terms of the Apache license. It is currently popular Enterprise-level search engine, designed for cloud computing, can achieve real-time search, stable, reliable, fast, easy to install and use. [0003] There is a prerequisite for efficient search using ElasticSearch, which is to collect data into ElasticSearch first. At present, data collection is usually done using third-party plug-ins, which require the use of command lines or complex configurations. The learning cost and usage threshold are high, and only a single task can be executed, so the collection spe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/25G06F16/242G06F8/34
CPCG06F8/34
Inventor 杨耀王纯斌钟武李森林
Owner CHENGDU SEFON SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com