How do i use cache in kettle pentaho?

kettle, pentaho

Solution

@RFVoltini you are right, maybe we could try to setup a H2 db server for this purpouse: http://type-exit.org/adventures-with-open-source-bi/2011/01/using-an-on-demand-in-memory-sql-database-in-pdi/

other option is using memcached in java : http://sacharya.com/using-memcached-with-java/

Problem

I am processing data, where i get some information from rest api, based on the value of a field. Now, value may repeat for that field and if I already have fetched the data for that value, from REST, i would like to reuse that value and saving an API call (slowest operation in the transformation). is is possible? if yes, how? Regards Ajay

Original source