configuration - How to set hadoop cluster priority? -
i starting learn hadoop. have hadoop server , connects 3 clusters node. if run mapreduce job works well. need set priority these clusters.
for example
node1, node2, node3 cluster connect hadoop server. here if run mr job, split , assign job above priority every time. possible?
because cluster nodes have different memory capacity. need set high memory node handle job first.
it's not possible 'weight' servers based on capacity. however, each server can have configuration match it's memory, processor count, etc.
for example, if 1 server has 16 cores , has 8 cores, can configure first server run 12 tasks simultaneously , second run 6. same idea memory.
Comments
Post a Comment