Execution Error: from org.apache.hadoop.hive.ql.exec.DDLTask

Question

I am using the below regex(tab seperated) to parse the data(also tab seperated) which is given. Hive table creation syntax: ``` create table akmlogreg(logdate string, time string, clientip string, method string, uri string, status string, bytes string, TimeTakenMS string, referer string, useragent string, cs_Cookie string) ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.RegexSerDe' WITH SERDEPROPERTIES ( "input.regex" ="([0-9-]+) ([^	]*) ([^	]*) ([^	]*) ([^	]*) ([^	]*) ([^	]*) ([^	]*) (".*"|[^ ]*) (".*"|[^ ]*) ([^
]+)", "output.format.string"="%1$s %2$s %3$s %4$s %5$s %6$s %7$s %8$s %9$s %10$s %11$s"); ``` through this regex i want any comments (lines starting with #) should be removed and select only one row at a time. But this syntax gives error when i try to create the table in hive. My logic behind tab separated regex is that my log data is also tab separated. Can anyone give me a better suggesion or solution by which i can parse this kind of data which is ta…

Accepted Answer

Try this:

```
^([0-9-]+)	([^	]*)	([^	]*)	([^	]*)	([^	]*)	([^	]*)	([^	]*)	([^	]*)	(".*?"|[^ ]*)	(".*?"|[^ ]*)	([^
]+)$
```

Execution Error: from org.apache.hadoop.hive.ql.exec.DDLTask

Solution

Problem