Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for replacing big data computing job data source based on kubernetes

A data source and big data technology, applied in the computer field, can solve problems such as a large amount of writing algorithm workload, excessive time consumption, and low efficiency of updating data sources, so as to improve the efficiency of updating data sources, improve efficiency, and improve company benefits Effect

Active Publication Date: 2022-06-21
梯度云科技(北京)有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In actual use, there are a large number of big data operation algorithms in the company that need to change the data source continuously. It takes too much time to find the connection information of the new data source among too many data sources, and it needs to be replaced every time the data source is changed. Rewrite the connection information such as the access host address, port, user name, password, certificate, and path of the data source into the algorithm, and there is a large amount of writing algorithm workload, which makes updating the data source inefficient

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for replacing big data computing job data source based on kubernetes

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0031] figure 1 A specific embodiment of a method for replacing a data source of a big data computing job based on Kubernetes of the present invention is shown, including the following steps:

[0032] Step 1: Create a serialized string of a data source connection object for different data source access information, where the serialized string of the data source connection object is a string generated by serialization of a connected data source object created using a programming language. In this embo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a method and device for replacing data sources of big data computing operations based on Kubernetes. By saving different data source connection objects in the form of character strings in configuration resources in Kubernetes container orchestration software, when the number of data sources increases , quickly find the data source to be connected through the query command provided by the Kubernetes container orchestration software. It saves the time of querying the data source to be connected in multiple data sources, and greatly improves the efficiency of querying the data source to be submitted.

Description

technical field [0001] The invention belongs to the field of computer technology, and in particular relates to a method and device for replacing a data source of a big data computing operation based on Kubernetes. Background technique [0002] At present, the big data operation algorithm needs to write all the connection information such as the access host address, port, user name, password, certificate, path, etc. of the data source into the algorithm when connecting to the data source. The connection information of the data source is queried in the data source. On the other hand, the access host address, port, user name, password, certificate, path and other connection information of the new data source need to be rewritten into the algorithm. [0003] In actual use, there are a large number of big data operation algorithms in the company that need to constantly replace data sources. It takes too much time to find out the connection information of new data sources among to...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/2458G06F16/23G06F16/182G06F16/903
CPCG06F16/2474G06F16/23G06F16/90344G06F16/182
Inventor 王伟华刘井山樊宇梅进
Owner 梯度云科技(北京)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com