How to select distinct values in a column in Talend

talend
devaki picture devaki · Nov 17, 2013 · Viewed 12.4k times · Source

I am importing an excel file in Talend. I want to select all the distinct values in column "A" and then dump that data into the database. Is it possible to do that with Talend? If not, what are the alternatives available. Any help is appreciated

Answer

Julien Boulay picture Julien Boulay · Nov 17, 2013

Yes you can do that easily with Talend Open Studio.

Create a new job like this one:

enter image description here
You can replace the tOracleOutput component by the component corresponding to your database.
Then parameterize the tAggregateRow component like this :

enter image description here

Distinct values of ColumnA will be transfered to distinctColumnA in the output schema.
You can also get the number of occurences by adding a count of columnB in the operations table.

Related questions

Insert throws SQLCODE: -180, SQLSTATE: 22007 on IBM DB2

I'm using a data integration tool (Talend) to insert some rows on a IBM Db2, but the following command throws an error: INSERT INTO "TOTCHQ" ("CODREM","NUMDOCC8","NOMPES","NUMBAN","CODAGEBN","QTDCHQDL","DATULTOA") VALUES ('3080',99999999999,'FULANO DE TAL',100,'0000',2,…

Read More
How to add third party libraries to Talend project?

How to add third party libraries (jar files) to a Talend project ? One more question is, Each Talend component uses LogFactory, but in my case it is throwing java.lang.NoClassDefFoundError: org.apache.commons.logging.LogFactory at ... with tSetGlobalVar component, …

Read More
Need to Get the current DateTime in the Talend Studio?

I am working the Talend studio tool for data migration. Now I want to set the Current DateTime in the Date field. I get the DateTime from this code TalendDate.getDate("yyyy-MM-dd HH:mm:ss") but it returns String type …

Read More