All Forums Tools
barani_sachin 141 posts Joined 01/12
03 Feb 2013
Duplicate rows in Fload while loading in a NOPI table?

How does Fload handle loading of duplicate rows in NOPI table in case of a restart?

ThomasNguyen 30 posts Joined 04/09
04 Feb 2013

Barani_sachin,
If there is a DBS restart, FastLoad reloads data from the last checkpoint, it does not effect dupicate rows loading processing. 

ThomasNguyen 30 posts Joined 04/09
05 Feb 2013

Barani_sachin,
What happens on the DBS side is:
The DBS has a special recovery scheme for NoPI table that throws away only duplicates from data that are resent due to a restart. There is no sort on NoPI table and therefore true duplicates from the data source do not get thrown away. This way, true duplicates stay but duplicates from resend are all cleaned up.
Thomas

barani_sachin 141 posts Joined 01/12
07 Feb 2013

Thanks Thomas :)
 
My understandng is :
1) While Floading into the tables with PI the data will be sorted and duplicate rows will be eliminated.
2) While Floading into the tables with NOPI the data will not be sorted, so the restart can be started from the point where it got interupted.
Please correct me if i am wrong...

You must sign in to leave a comment.