All Forums Database
KVB 124 posts Joined 09/12
26 Dec 2013
Inserting to a table incrementally

   What's the best approach to load the target table from the source incrementally.Let's say we have 1 million rows.I need to load the table for every 1 lakh.

Raja_KT 1246 posts Joined 07/09
27 Dec 2013

Hi Bikky,
Tools are always better. But if you dont have tools, then you have to use queries. You can think of this option,keep one table to track load based on identifiable field or fields.Use row_number() and qualify to restrict rows you want and insert the required data.
There may be other ways too.
You have not told the source is (table or file) or some othe DBs etc. 

Raja K Thaw
My wiki:
Street Children suffer not by their fault. We can help them if we want.

dnoeth 4628 posts Joined 11/04
27 Dec 2013

Why do you want to load in bunches of 100.000 rows?
This will be (potentially much) slower than loading all rows in a single step.


M.Saeed Khurram 544 posts Joined 09/12
27 Dec 2013



Can you please tell whether the source is containing 1 million rows and you wnat to pick 100,000 rows according to some criteria?


Or the source will be loaded with 100,000 rows on time to time? just like we do in staging table.


There are multiple incremental loading approaches are available, can you please tell which tool you want to use to accomplish this loading?




You must sign in to leave a comment.