All Forums Database
KVB 124 posts Joined 09/12
26 Dec 2013
Inserting to a table incrementally

Hi
   What's the best approach to load the target table from the source incrementally.Let's say we have 1 million rows.I need to load the table for every 1 lakh.

Raja_KT 1246 posts Joined 07/09
27 Dec 2013

Hi Bikky,
Tools are always better. But if you dont have tools, then you have to use queries. You can think of this option,keep one table to track load based on identifiable field or fields.Use row_number() and qualify to restrict rows you want and insert the required data.
There may be other ways too.
You have not told the source is (table or file) or some othe DBs etc. 
Cheers,
Raja

Raja K Thaw
My wiki: http://en.wikipedia.org/wiki/User:Kt_raj1
Street Children suffer not by their fault. We can help them if we want.

dnoeth 4628 posts Joined 11/04
27 Dec 2013

Why do you want to load in bunches of 100.000 rows?
This will be (potentially much) slower than loading all rows in a single step.

Dieter

M.Saeed Khurram 544 posts Joined 09/12
27 Dec 2013

Bikkey,

 

Can you please tell whether the source is containing 1 million rows and you wnat to pick 100,000 rows according to some criteria?

 

Or the source will be loaded with 100,000 rows on time to time? just like we do in staging table.

 

There are multiple incremental loading approaches are available, can you please tell which tool you want to use to accomplish this loading?

 

 

Khurram

You must sign in to leave a comment.