writing a udf in pig kind of like tutorial

Question

I am new to pig.. and am trying to write a udf function. So basically here is the problem statement. I have a dummy data like this.. ``` user_id, movie_id, date_time_stamp ``` So what I am trying to do is this. if the transaction is between ``` 9 am and 11 am --> breakfast and so on ``` So here is my pig script ``` REGISTER path/myudfs.jar in = LOAD 'path/input' USING PigStorage('\u001') AS (user:long,movie:long, time:chararray); result = foreach in GENERATE myudfs.time(time); STORE result INTO 'path/output/time' using PigStorage(','); ``` Now myudf.jar java code is like this ``` public class time extends EvalFunc<String>{ public String exec(Tuple input) throws IOException { if ((input == null) || (input.size() == 0)) return null; try{ String time = (String) input.get(0) ; DateFormat df = new SimpleDateFormat("hh:mm:ss.000"); Date date = df.parse(time); String timeOfDay = getTimeOfDay(date); return timeOfDay; } catch (ParseException e) { //how will I handle when df.parse(time) fails…

Accepted Answer

To find the jar version, open the jar using winzip (or similar) and look for manifest.mf. There should be a line in there that says 'Created-By' and this will give the version of java that was used to build the jar.

This needs to be older or equal to the version of java you are using to build your app. If you are doing this at the command line type:

```
java -version
```

or in eclipse go to

```
project(menu) > properties (menu item) > java build path (in list) > libraries (tab)
```

and take a look at the version that you are using for the JDK/JRE (you may be able to tell this from the directory, if not then go to that directory and do java -version).

Chances are you'll need to update the version of java you have in eclipse.

writing a udf in pig kind of like tutorial

Solution

Problem

Related problems