Adding ec2-user to use hadoop

Question

I have setup AWS EMR. I SSH into master node. I wanted to copy a file into hdfs system. That small line of code in my program which does this is: ``` os.system('/home/hadoop/bin/hdfs dfs -put %s PATH_to_HADOOP' % tmp_output) ``` I want to enter the path to my hdfs file system. I do ``` [ec2-user@ip-172-31-0-185 input]$ /home/hadoop/bin/hdfs dfs -ls / Found 2 items drwxr-xr-x - hadoop supergroup 0 2014-04-14 22:21 /hbase drwxrwx--- - hadoop supergroup 0 2014-04-14 22:19 /tmp ``` I try ``` [ec2-user@ip-172-31-0-185 input]$ /home/hadoop/bin/hdfs dfs -mkdir /tmp/stockmarkets mkdir: Permission denied: user=ec2-user, access=EXECUTE, inode="/tmp":hadoop:supergroup:drwxrwx--- ``` So, to add ec2-user to use hadoop I followed these instructions: http://cloudcelebrity.wordpress.com/2013/06/05/handling-permission-denied-error-on-hdfs/ But after I write (am substituting ubuntu their for ec2-user) ``` sudo adduser ec2-user hadoop ``` instead of getting an add message, I get : ``` Usage: useradd [op…

Accepted Answer

SSH in as hadoop@(publicIP) for Amazon EMR.

From there you can do anything you like with HDFS without having to "su." I just did an mkdir and ran distcp and a streaming job. I do everything as hadoop@, as per the EMR instructions.

Adding ec2-user to use hadoop

Solution

Problem