Unlock instant, AI-driven research and patent intelligence for your innovation.

The method of using wlan network to set up a temporary hadoop environment

A network construction and temporary technology, applied in the direction of multi-program device, program control design, instrument, etc., to achieve the effect of fast processing

Active Publication Date: 2019-02-15
NORTHWEST UNIV
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The existing technology does not have a solution that can use such computational redundancy to create more contributions, and this is also a problem worthy of further study

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • The method of using wlan network to set up a temporary hadoop environment
  • The method of using wlan network to set up a temporary hadoop environment
  • The method of using wlan network to set up a temporary hadoop environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0067] First build a Hadoop distributed cluster environment based on the Android system, including 6 Android mobile phones, one as the master, and the other five as slaves; flash the compiled Android system on each mobile phone, and install the pre-installed Android system on the mobile phone. For the wordscount software written, build the Hadoop operating environment according to the operation steps mentioned above, and ensure that the wordscount software is run under the condition that the environment is successfully established, and check the results of the software operation;

[0068] Secondly, according to the user's specific usage scenarios, write an appropriate application program, fully consider the input of data and the display of results, call the underlying MapReduce function for processing during the calculation process, and then install the packaged program on the host, and run the software , to get the returned calculation result, and the displayed calculation tim...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The method of using the WLAN network to set up a temporary Hadoop environment, the steps are: 1) The host computer turns on the WLAN hotspot function, sets the identity of this terminal as Master, and waits for other terminals to connect to this WLAN network; 2) The slave computer connects to the WLAN hotspot, and the slave computer Set as Slave; 3) After the host detects that all slaves are connected to the WLAN network, the host will configure SSH to connect without a password, generate and send the SSH public key to each slave, and wait for the slave to complete the relevant configuration before sending the HDFS command; 4 ) Start Hadoop; 5) Send data and computing conditions to the JobClient process; 6) The JobClient process of the host requests the Job ID from the JobTracker process; 7) Copy the resource files required to run the job to HDFS; 8) The JobTracker of the host receives After arriving at the job, wait for it to be scheduled; 9) The TaskTracker process of the slave machine initiates another process every once in a while, sends a heartbeat to the JobTracker process of the host machine, and obtains the running status of the TaskTracker machine of the slave machine; the environment is simple to build and is not affected by the network Conditional restrictions, freely configure the characteristics of the master or slave.

Description

technical field [0001] The invention belongs to the technical field of computer information processing, and in particular relates to a method for establishing a temporary Hadoop environment by using a WLAN network. Background technique [0002] With the continuous development of Internet technology, human beings have gradually entered the era of big data. Data resources are becoming the basic elements of economic growth and social development just like production factors such as land, labor, and capital. Any industry and field will generate valuable data, and the statistics, analysis, mining and artificial intelligence of these data will create unexpected value and wealth. Today, the big data engine has become the core driving force for organizational innovation, industrial upgrading, economic and social development, and the modernization of national governance capabilities. [0003] Hadoop is an open source distributed computing platform managed by the Apache organization ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/50G06F9/48
CPCG06F9/4416G06F9/5038
Inventor 高岭曹瑞高全力杨建锋王伟杨康
Owner NORTHWEST UNIV