Is it possible to run MapReduce locally, without HDFS and Hadoop cluster?
hadoop, hdfs, mapreduce
Solution
Hadoop runs in 3 modes.
1.local mode
2.psuedo mode
3.distributed mode.
The one you are looking for is the local mode. You can debug your mapreduce code from eclipse before run it in 2 or 3 modes. This step by step guide to run application in local mode helps you a lot to debug your application. Hope it helps!
Problem
Given I develop MapReduce tasks in my Windows system and before moving them to HDFS cluster I would like to run MapReduce locally. I just want to check how do work my mapper logic, inputSplits, Input/Output formats etc. Is it possible?