hdfs dfs -mkdir, No such file or directory

hadoop, hdfs

Solution

It is because the parent directories do not exist yet either. Try `hdfs dfs -mkdir -p /user/Hadoop/twitter_data`. The `-p` flag indicates that all nonexistent directories leading up to the given directory are to be created as well.

As for the question you posed in the comments, simply type into your browser `http://<host name of the namenode>:<port number>/`.

Problem

Hi I am new to hadoop and trying to create directory in hdfs called twitter_data. I have set up my vm on softlayer, installed & started hadoop successfully. This is the commend I am trying to run: hdfs dfs -mkdir hdfs://localhost:9000/user/Hadoop/twitter_data And it keeps returning this error message: ``` /usr/local/hadoop/etc/hadoop/hadoop-env.sh: line 2: ./hadoop-env.sh: Permission denied 16/10/19 19:07:03 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable mkdir: `hdfs://localhost:9000/user/Hadoop/twitter_data': No such file or directory ``` Why does it say there is no such file and directory? I am ordering it to make directory, shouldn't it just create one? I am guessing it must be the permission issue, but I cant resolve it. Please help me hdfs experts. I have been spending too much time on what seems to be a simple matter. Thanks in advance.

Original source