Hadoop: Number of reducer is not equal to what I have set in program
hadoop, java, mapreduce
Solution
Running it in eclipse seems to use the local job runner. It only supports 0 or 1 reducers. If you try to set it to use more than one reducer, it ignores it and just uses one anyway.
Problem
I have set mapred.tasktracker.reduce.tasks.maximum to 10 in `mapred-site.xml`, and I also write `jobConf.setNumReduceTasks(5)` in my job. Everything is ok if I run the job in Shell. But when I run the same job by eclipse, only one reducer was launched. I try to edit Map/Reduce Locations in eclipse, and set `mapred.reduce.tasks` to 10. But that still doesn't work. Is there any other parameters I can adjust in eclipse?