All Forums UDA
smarty 14 posts Joined 03/09
27 Jan 2012
Collect stats in ETL


I've been workinng on Teradata with the mainframes all through my experience. As per my current project, I had to use Datastage as ETL and I have a question here. 

How do we collect statistics after an MLOAD or a Fastload when we are using ETL. Do we call the UNIX scripts to do this?? 

dnoeth 4628 posts Joined 11/04
29 Jan 2012

Just submit a COLLECT STATS in MLoad between END MLOAD and LOGOFF.

Before BEGIN and after END MLOAD you can submit almost any SQL, see "Teradata SQL Statements" in the MLoad manual.

In Fastload you need to call a BTEQ script.



ulrich 816 posts Joined 09/09
29 Jan 2012

In case you do not deal with mload scripts but call mload via the api I would expect that datastage is offering native SQL api as well where you can call collect stats commands.

I don't know data stage too well but all other ETL tools I saw so far offer these.

feel free to donate bitcoin:12kgAUHFUqvG2sQgaRBXFhCwyf9HXdkGud

Jigar 70 posts Joined 09/11
02 Feb 2012

Many times collect stats are not required on daily basis .If you data doesn't change drastically,you can also consider having a separate fortnightly job collecting stats.

Stefans 38 posts Joined 02/12
21 Feb 2012

You can also collect stats by calling the procedure in the scripts which would also require an one time entry of the DB and tablename into the procedure view name.




ramya123 13 posts Joined 11/11
16 Apr 2012

In TeradataStages under Input tab Before and After tabs are there. You can specify Collect Statistics there. Depending on your requirment you can specify before mload or after mload.




You must sign in to leave a comment.