Startup Standalone Hadoop Mode

Startup Standalone Hadoop Mode

Format your HDFS byusing the command before launch Hadoop,

$ bin/hadoopnamenode -format

[JRockit] Localmanagement server started.

13/07/22 21:30:08INFO namenode.NameNode: STARTUP_MSG:

/************************************************************

STARTUP_MSG:Starting NameNode

STARTUP_MSG:   host = retailvm1d/169.193.171.159

STARTUP_MSG:   args = [-format]

STARTUP_MSG:   version = 1.1.2

STARTUP_MSG:   build =https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.1 -r 1440782;compiled by 'hortonfo' on Thu Jan 31 02:03:24 UTC 2013

************************************************************/

13/07/22 21:30:09INFO util.GSet: VM type       = 64-bit

13/07/22 21:30:09INFO util.GSet: 2% max memory = 20.0 MB

13/07/22 21:30:09INFO util.GSet: capacity      = 2^21 =2097152 entries

13/07/22 21:30:09INFO util.GSet: recommended=2097152, actual=2097152

13/07/22 21:30:10INFO namenode.FSNamesystem: fsOwner=yj70978

13/07/22 21:30:10INFO namenode.FSNamesystem: supergroup=supergroup

13/07/22 21:30:10INFO namenode.FSNamesystem: isPermissionEnabled=true

13/07/22 21:30:10INFO namenode.FSNamesystem: dfs.block.invalidate.limit=100

13/07/22 21:30:10INFO namenode.FSNamesystem: isAccessTokenEnabled=falseaccessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)

13/07/22 21:30:10INFO namenode.NameNode: Caching file names occuring more than 10 times

13/07/22 21:30:11INFO common.Storage: Image file of size 113 saved in 0 seconds.

13/07/22 21:30:11INFO namenode.FSEditLog: closing edit log: position=4,editlog=/tmp/hadoop-yj70978/dfs/name/current/edits

13/07/22 21:30:11INFO namenode.FSEditLog: close success: truncate to 4,editlog=/tmp/hadoop-yj70978/dfs/name/current/edits

13/07/22 21:30:12INFO common.Storage: Storage directory /tmp/hadoop-yj70978/dfs/name has beensuccessfully formatted.

13/07/22 21:30:12INFO namenode.NameNode: SHUTDOWN_MSG:

/************************************************************

SHUTDOWN_MSG:Shutting down NameNode at retailvm1d/169.193.171.159

************************************************************/

We can now launchthe daemons by use of the start-all.sh script. The Java jps command will listall daemons to verify the setup was successful.

$ bin/start-all.sh

starting namenode,logging to/home/yj70978/hadoop/hadoop-1.1.2/libexec/../logs/hadoop-yj70978-namenode-retailvm1d.out

localhost:

localhost: You areauthorized to use this System for approved business purposes only.

localhost: Use forany other purpose is prohibited. All transactional records, reports,

localhost: email,software and other data generated by or residing upon this System,

localhost: to theextent permitted by local law, are the property of Citigroup Inc.

localhost: or oneof its subsidiaries or their affiliates

localhost:(individually or collectively ' Citigroup ') and may be used by Citigroup

localhost: for anypurpose authorized and permissible in your country of work.

localhost:Activities on this System are monitored to the extent permitted by local law.

localhost:

localhost:

localhost: PAMAuthentication

localhost:Password:

localhost: startingdatanode, logging to /home/yj70978/hadoop/hadoop-1.1.2/libexec/../logs/hadoop-yj70978-datanode-retailvm1d.out

localhost:

localhost: You areauthorized to use this System for approved business purposes only.

localhost: Use forany other purpose is prohibited. All transactional records, reports,

localhost: email,software and other data generated by or residing upon this System,

localhost: to theextent permitted by local law, are the property of Citigroup Inc.

localhost: or oneof its subsidiaries or their affiliates

localhost: (individuallyor collectively ' Citigroup ') and may be used by Citigroup

localhost: for anypurpose authorized and permissible in your country of work.

localhost:Activities on this System are monitored to the extent permitted by local law.

localhost:

localhost:

localhost: PAMAuthentication

localhost:Password:

localhost: startingsecondarynamenode, logging to/home/yj70978/hadoop/hadoop-1.1.2/libexec/../logs/hadoop-yj70978-secondarynamenode-retailvm1d.out

startingjobtracker, logging to/home/yj70978/hadoop/hadoop-1.1.2/libexec/../logs/hadoop-yj70978-jobtracker-retailvm1d.out

localhost:

localhost: You areauthorized to use this System for approved business purposes only.

localhost: Use forany other purpose is prohibited. All transactional records, reports,

localhost: email,software and other data generated by or residing upon this System,

localhost: to theextent permitted by local law, are the property of Citigroup Inc.

localhost: or oneof its subsidiaries or their affiliates

localhost:(individually or collectively ' Citigroup ') and may be used by Citigroup

localhost: for anypurpose authorized and permissible in your country of work.

localhost:Activities on this System are monitored to the extent permitted by local law.

localhost:

localhost:

localhost: PAMAuthentication

localhost:Password:

localhost: startingtasktracker, logging to/home/yj70978/hadoop/hadoop-1.1.2/libexec/../logs/hadoop-yj70978-tasktracker-retailvm1d.out

When you’vefinished with Hadoop you can shut down the Hadoop daemons by the command

$ ./stop-all.sh

no jobtracker tostop

localhost:

localhost: You areauthorized to use this System for approved business purposes only.

localhost: Use forany other purpose is prohibited. All transactional records, reports,

localhost: email,software and other data generated by or residing upon this System,

localhost: to theextent permitted by local law, are the property of Citigroup Inc.

localhost: or oneof its subsidiaries or their affiliates

localhost:(individually or collectively ' Citigroup ') and may be used by Citigroup

localhost: for anypurpose authorized and permissible in your country of work.

localhost:Activities on this System are monitored to the extent permitted by local law.

localhost:

localhost:

localhost: PAMAuthentication

localhost:Password:

 

localhost: PAMAuthentication

localhost:Password:

localhost: PAMAuthentication

localhost:Password:

localhost: notasktracker to stop

no namenode to stop

localhost:

localhost: You areauthorized to use this System for approved business purposes only.

localhost: Use forany other purpose is prohibited. All transactional records, reports,

localhost: email,software and other data generated by or residing upon this System,

localhost: to theextent permitted by local law, are the property of Citigroup Inc.

localhost: or oneof its subsidiaries or their affiliates

localhost:(individually or collectively ' Citigroup ') and may be used by Citigroup

localhost: for anypurpose authorized and permissible in your country of work.

localhost:Activities on this System are monitored to the extent permitted by local law.

localhost:

localhost:

localhost: PAMAuthentication

localhost:Password:

localhost: nodatanode to stop

localhost:

localhost: You areauthorized to use this System for approved business purposes only.

localhost: Use forany other purpose is prohibited. All transactional records, reports,

localhost: email,software and other data generated by or residing upon this System,

localhost: to theextent permitted by local law, are the property of Citigroup Inc.

localhost: or oneof its subsidiaries or their affiliates

localhost:(individually or collectively ' Citigroup ') and may be used by Citigroup

localhost: for anypurpose authorized and permissible in your country of work.

localhost:Activities on this System are monitored to the extent permitted by local law.

localhost:

localhost:

localhost: PAMAuthentication

localhost:Password:

localhost: PAMAuthentication

localhost:Password:

localhost: nosecondarynamenode to stop

Both standalone andpseudo-distributed modes are for development and debugging purposes. An actualHadoop cluster runs in the third mode, the fully distributed mode.