Wednesday, June 10, 2015

Tips on increase Fuzzy Grouping analysis Performance in SSIS Integration Servicce

currently i am using the Fuzzy Group Analysis in SSIS to identify the duplicated record in the AS400 Main Frame. I try to summarize couples things that i believe they will help if you need to perform the same task.

1. please select all necessary columns from the file in the subfiles and import them into the sql server.
  this approach will reduce the time on extracting data from AS400.

2. run the fuzzy group analysis against the data from SQL server instead of loading them directly from AS400. this step had save me significant amount of time when i need to analysis more than million rows of records.

3.use IBM i Access for Windows ODBC data driver to increase the data extract performance. it is fast more better than Microsoft Windows Default ODBC driver.

4.Always use the refresh button from the Advance Edit Windows on each component to refresh the data mapping.










No comments:

Post a Comment