Hadoop compiling method and device and computer readable storage medium

A compiling method and computer technology, applied in the fields of Hadoop compiling and computer-readable storage media, can solve problems such as Hadoop not being used, and achieve the effect of saving time

Inactive Publication Date: 2021-01-05
SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a Hadoop compiling method, device and computer-readable storage medium, to alleviate the existing open source community in the prior art and not adapting Hadoop, the general native Hadoop is all x86 architecture, so Hadoop It cannot be used directly on non-x86 machines. If you want to use Hadoop on non-x86 machines, you must recompile the technical problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hadoop compiling method and device and computer readable storage medium
  • Hadoop compiling method and device and computer readable storage medium
  • Hadoop compiling method and device and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of them. example. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0036] The terms "comprising" and "having" mentioned in the embodiments of the present invention and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes other unlisted steps or units, or optionally also ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a Hadoop compiling method and device and a computer readable storage medium, belongs to the technical field of big data processing systems, and solves the problems that in the prior art, an open source community does not adapt to Hadoop, and generally native Hadoop is of an x86 architecture, so that Hadoop cannot be directly used on a non-x86 machine, and if the Hadoop needsto be used on the non-x86 machine, the recompilation must be carried out. The method comprises the steps of detecting and identifying a current processor architecture and an operating system; obtaining a compiling environment according to the processor architecture and the operating system; pulling a dependence package required by compiling from a local warehouse; performing Hadoop compiling based on the dependency package, and obtaining the compiling environment according to the processor architecture and the operating system, wherein the method comprises the steps that the compiling environment needed by the processor architecture and the operating system is determined; and judging whether the current environment meets a compiling environment or not, and if not, building the compiling environment by utilizing the script until a processor architecture and an operating system are met.

Description

technical field [0001] The present invention relates to the technical field of big data processing systems, and in particular, to a Hadoop compilation method, device and computer-readable storage medium. Background technique [0002] Hadoop is a distributed system infrastructure developed by the Apache Foundation. Users can develop distributed programs without knowing the underlying details of distribution. Make full use of the power of clusters for high-speed computing and storage. Hadoop implements a distributed file system (Hadoop Distributed File System), one of which is HDFS. HDFS has the characteristics of high fault tolerance and is designed to be deployed on low-cost hardware; and it provides high throughput to access application data, which is suitable for those with large data sets. )s application. HDFS relaxes (relax) POSIX requirements and can access data in the file system in the form of streams (streamingaccess). The core design of the Hadoop framework is:...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/41
CPCG06F8/41
Inventor 吴振伟
Owner SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap