Using components: Amazon Redshift Source

In the Amazon Redshift Source component, you define the parameters and credentials for accessing data in an Amazon Redshift cluster and which fields you will use in your package.

Source settings

Define the parameters for connecting to your database table as follows (for more information, see Allow Xplenty access to my database server):

  • redshift connection - either click the drop-down arrow and select an existing connection, or click (create new) to create a new connection.
  • access mode - select table to extract an entire table/view or query to execute a user query.
  • source table - the table or view name from which the data will be imported.
  • where clause - optional. You can add predicates clauses to the WHERE clause as part of the SQL query that is built in order to get the data from the database. Make sure to omit the keyword WHERE. e.g.:
    • good: prod_category = 1 AND prod_color = 'red'
    • bad: WHERE prod_category = 1 AND prod_color = 'red'
  • or query - type in a SQL query. Make sure to name all columns uniquely and do not change the column orders as their position is important when reading the data.
  • null string - optional. Replace null values in string columns with this value.

Then click the Test Connection button to help check that the connection is good and that the source table exists.

Column mapping

  1. After defining the source settings you can use the green Auto-detect schema button to get the field names and data types or the Preview button to preview the data and fill in the fields manually.
  2. Define the columns you want to extract from the table as follows:
    • Define the column name in the table.
    • Define the alias you will use for the column as a field in the data-flow.
    • Define the data type for the field. Use the following table when matching database data types to Xplenty data types.
Amazon Redshift Xplenty
varchar, nvarchar, text String
smallint, int Integer
bigint Long
decimal, real Float
double precision Double
timestamp, date DateTime

Feedback and Knowledge Base