All Forums Tools
ajaymathe 1 post Joined 02/16
03 May 2016
How to get values from TPT log file?

This is my TPT log file
Teradata Parallel Transporter Version
Job log: /opt/teradata/client/14.00/tbuild/logs/mytest-175.out
Job id is mytest-175, running on xxxxxx
Found CheckPoint file: /opt/teradata/client/14.00/tbuild/checkpoint/ mytestLVCP
This is a restart job; it restarts at step MAIN_STEP.
Teradata Parallel Transporter SQL Selector Operator Version
SQL_SELECTOR: private log specified: selector_log
Teradata Parallel Transporter DataConnector Version
FILE_WRITER Instance 1 directing private log report to 'dataconnector_log-1'.
FILE_WRITER Instance 1 restarting.
FILE_WRITER: TPT19007 DataConnector Consumer operator Instances: 1
FILE_WRITER: TPT19003 ECI operator ID: FILE_WRITER-23162
SQL_SELECTOR: connecting sessions
SQL_SELECTOR: restarting the job
FILE_WRITER: TPT19222 Operator instance 1 processing file '/xxxx/xxxx/xxxxx/files/history/dataset1_201209.csv'.
SQL_SELECTOR: sending SELECT request
SQL_SELECTOR: retrieving data
SQL_SELECTOR: Total Rows Exported:  20
SQL_SELECTOR: finished retrieving data
SQL_SELECTOR: disconnecting sessions
FILE_WRITER: TPT19221 Total files processed: 1.
SQL_SELECTOR: Total processor time used = '0.11 Second(s)'
SQL_SELECTOR: Start : Thu Nov 21 01:05:20 2013
SQL_SELECTOR: End   : Thu Nov 21 01:05:26 2013
Job step MAIN_STEP completed successfully
Job mytest completed successfully
from the above log file I want to make use of certain values.
for example
from this
SQL_SELECTOR: Total Rows Exported:  20
i want to make use of 20 to insert in a db table. Similarly i need to take total processor time used,total files processed etc.,
how to do this ? do i need to parse entire text file or is there any alternative way of doing it? 

feinholz 1234 posts Joined 05/08
03 May 2016

In the log there are several "private" logs (virtual logs). One of them is called TWB_STATUS.
If you look in the TPT documentation (at 14.00 I do not remember if the information is in the Reference Manual or the User Guide), we will show you the layout/schema of the TWB_STATUS log.
You can use the tlogview command (with -f TWB_STATUS) to extract out the contents of that private log. I believe it is formatted as a set of comma-delimited records.
You can then load that data into a Teradata table (even by using TPT). We do have a few customers that do this already.


You must sign in to leave a comment.