Teradata connector Stage in Datastage

Teradata connector Stage in Datastage

The Teradata Connector stage in DataStage allows to read and write records to the Teradata tables. The Teradata Connector stage has many capabilities and Better than earlier Teradata stages.

Teradata API, Teradata Enterprise, Teradata Load and Teradata Multiload stages are depreciated, and the developer must migrate to Teradata connector stage using Connection migration tool.

For Immediate operations such as read, lookup and write, the Teradata connector stage uses CLIv2 interface and TPT Direct API for Bulk operations (the connector utilizes the operators in the TPT for Teradata FastExport, FastLoad and MultiLoad operations.


Teradata Connector properties:

teradata connector stage properties
Teradata connector stage properties

Mostly used properties:

Property Values
Server: Source/Target Server Ip or name
User details:  Username
Password: Teradata Password
Write mode : Insert ,update ,delete ,insert the update,update then insert and delete then insert
Generate SQL Source /target table name
Access Method: Immediate /bulk
Table Name: if yes then stage will automatically generate it at runtime

Configuring the Teradata connector as a source

  • Go to the Properties tab, set the connection properties such as server IP, database, username, table name and password for the Teradata database.
  • You could specify the select SQL statement or set the generate SQL at runtime  to Yes

Configuring the Teradata connector as a target

  • Go to the Properties tab, set the connection properties such as server IP, database, username and password for the Teradata database.
  • Specify the table name of the target table.
  • Set the access method as Immediate or bulk.

Advanced configuration:

Array size

configure the array size in Teradata connector to define the maximum number of rows to transfer in each read or write operation.

Error limit

Set the error threshold to define the maximum number of rows that can be rejected to the first error table.

Error table 1

To set the name of the first error table for the bulk load.

Error table 2

To set the name of the second error table for the bulk load.

Fail on error

Use this property to specify whether to terminate the job or continue processing if

the SQL statement in the parent property fails.

Fail on size mismatch

Specify whether a job fails if the sizes of numeric and string mismatches.

File

specify the name of a  file that contains the SQL statements to run for each input row.

Max buffer size

To set the maximum buffer size

Parallel synchronization

Use this property to specify whether to synchronize parallel reads or writes by using a synchronization table.

Avoiding deadlocks

If multiple updates for a row are not from the same connection, deadlocks might occur while performing immediate writes in parallel mode

To solve this, you must set a partitioning method to ensure that update comes from the same partition.

Configuring the connector to perform lookups (Sparse Lookup)

Go to the Properties tab, set the sparse lookup method in Lookup type field.

Teradata connector Stage in Datastage

Share this post

Leave a Reply