How to remove duplicate records using Sorter Transformation In the last two post we have seen how to remove duplicate records (Only one column) using Aggregator and Expression. We have identified the duplicate JOB_ID and skipped those rows from loading to target. The same logic CANNOT be done using Sorter Transformation. In sorter we cannot… Continue reading How to remove duplicate records using Sorter Transformation
Tag: Transformations-Lab
How to remove duplicate records using Expression
How to remove duplicate records using Expression In the last post we have used Aggregator Transformation to remove the duplicate records. In this post we will use the Expression transformation to remove the duplicate JOB_ID from the source Flat file. Source – Flat File Target – Oracle Table Key port – JOB_ID Transformations Sorter – To… Continue reading How to remove duplicate records using Expression
How to remove duplicate records Using Aggregator
How to remove duplicate records Using Aggregator There are couple of options available in informatica to remove duplicate records from the source. For Relational Tables 1. Source Qualifier > ‘SELECT DISTINCT’ option 2. Source Qualifier > SQL override (Write your own Query) For Flat files or other sources Sorter > Aggregator Sorter > Expression >… Continue reading How to remove duplicate records Using Aggregator
How to Load only Half of the records from Source table
Load only Half of the records from Source table The requirement is to process only half of the records from the source table. To do this we need to calculate the total number of rows (TOTAL-COUNT) in the source table and then assign ROW-COUNT and exclude the rows if the ROW-COUNT <= (TOTAL-COUNT/2). Let’s design the mapping for this. We… Continue reading How to Load only Half of the records from Source table