Pentaho Spoon - Output to multiple files based on field content

pentaho kettle
t_barbz picture t_barbz · May 25, 2011 · Viewed 11.2k times · Source

I have been attempting splitting the results of a pentaho transform into multiple files based on the value of a specific field without any luck.

E.g. a result set containing the following:

SURNAME, FIRSTNAME, COUNTRY

Obama, Barack, USA

Cameron, David, UK

Blair, Tony, UK

Would result in 2 output files being created:

USA.txt - containing Obama's details and UK.txt - containing the other 2 rows

Any pointers would be greatly appreciated.

Answer

Dino picture Dino · May 26, 2011

You can construct a field act as output filename based on Country field. Sent the new constructed field as output filenames in "Text File Output" step.

See the flow screenshot below :

enter image description here

You can also download the solution file from here http://pentaho.phi-integration.com/kettle/kettle-files.

Hope this helps...

Dino

Related questions

Pentaho: How to dynamically add Field (= Column) to OutputRow?

I would like to dynamically add fields (or a new columns) to the resulting output row in Kettle. After spending hours reading through froum posts and he not so well done scripting documentation, I wondered if Stackoverflow would be of …

Read More
Use JSON Input step to process uneven data

I'm trying to process the following with an JSON Input step: {"address":[ {"AddressId":"1_1","Street":"A Street"}, {"AddressId":"1_101","Street":"Another Street"}, {"AddressId":"1_102","Street":"One more street", "Locality":"Buenos Aires"}, {"AddressId":"1_102","Locality":"New York"} ]} However this seems not to be possible: Json …

Read More
Pentaho Kettle: how to pass variable from transformation to another transformation inside job

I have two transformations in the job. In the first trasnformation - I get details about the file. Now I would like to pass this information to the second transformation, I have set variable in the settings parameters of the …

Read More