2 articles tagged with Hadoop

Bash scripts to help manage your Hadoop cluster

Published on Jan 25, 2012 at 7:34 PM MST by Tracey Flanders with (0) comments

When deploying hadoop in your environment its helpful to have scripts to do the work of copying configs around the cluster. Or some that add functionality to your hadoop configuration. For referenece I am using version 0. » read more

Howto: Maintain logfiles on a Hadoop server

Published on Jan 22, 2012 at 12:37 PM MST by Tracey Flanders with (0) comments

If you have ever administered hadoop systems you may have soon realized that log files can become a disk space issue. I ended up created simple crontab jobs that will run nightly to compress and or delete old logfiles.   If the hadoop logs are in /opt/hadoop/logs then we can run the below command. » read more