Do you face problem of over uses of HDFS for datanode, frequently it becomes 100% and hence result in a imbalance cluster, thinking of how to solve this problem, for this what we can do is put a parameter called "dfs.datanode.du.reserved" so this will reserve the non HDFS uses disk space and hence leaving the some space remaining for non HDFS uses and solving disk overuses of HDFS .
All the question that scared me now i am trying to scare them .. so that they cant scare others :)
Monday, January 20, 2014
Hadoop over utilization of Hdfs
Subscribe to:
Post Comments (Atom)
Featured Posts
How to Auto-Terminate Frozen and Hung Apps in Windows
We have all been there. You are in the middle of an important project or a gaming session, and suddenly, your screen freezes. The dreaded ...
-
public struct CoOrds { public int x, y; public CoOrds( int p1, int p2) { x = p1; y = p2; } }
-
Manage timer jobs You can check the status of a timer job and edit the timer job definition. For the general administration of ...
No comments:
Post a Comment
Thank you for Commenting Will reply soon ......