How can I merge two files in Pentaho Data Integration (Kettle)

pentaho kettle data-integration
japmelian picture japmelian · Apr 7, 2014 · Viewed 7.8k times · Source

I'm working with Pentaho Data Integration (Kettle) and I have a question.

I have two input files file1.txt and file2.txt with the same header:

  • file1.txt

    NAME;AGE
alberto;22
angela;22
madelaine;23

  • file2.txt

    NAME;AGE
carlos;56
fernando;30
ana;16

and I want to merge both files into one, files_together.txt

NAME;AGE
alberto;22
angela;22
madelaine;23
carlos;56
fernando;30
ana;16

I've tried all (I think) and I don't know how to do it. I've been searching in Google, Youtube... with no positive match.

Thank you very much.

Answer

japmelian picture japmelian · Apr 21, 2014

Answer; just put the output of each file you want to merge as input of the final one.

Related questions

Use JSON Input step to process uneven data

I'm trying to process the following with an JSON Input step: {"address":[ {"AddressId":"1_1","Street":"A Street"}, {"AddressId":"1_101","Street":"Another Street"}, {"AddressId":"1_102","Street":"One more street", "Locality":"Buenos Aires"}, {"AddressId":"1_102","Locality":"New York"} ]} However this seems not to be possible: Json …

Read More
Changing a field from String to Int in Pentaho Data Integration

I am taking JSON information from our online API and producing it in a table with DI. I have 4 fields url, deviceId, displacement & timestamp. These are all recorded as Strings but I want them to be Int values, bar …

Read More
pentaho kettle : get row count from stream

I would like to get the total record count from the get rows from result output and then pass it to parent job. Any suggestions ?

Read More