Creating a workflow

Workflows are packages that allows running sequence of tasks, such as executing SQL query or running a dataflow package. You can define the sequence and the conditions for executing a task, for example- task can be executed only in case that the previous task was completed successfully.

To create a workflow:

  1. On the main menu, click Packages.
  2. Click New package.
  3. Optionally, set a name and/or description
  4. Select workflow option from Type dropdown
  5. Click New Task + button
  6. Choose task
  7. Add additional tasks as required
  8. Connect tasks to create sequence of task execution. Click the connect icon on the dotted line to set the execution condition:
    • On success (default) - task will be executed once the preceding task was executed successfully
    • On failure - task will be executed once the preceding task execution failed
    • On completion - task will be executed once the preceding task completed, regardless to the completion status (failed/succeeded)

Execute SQL task

  1. Select your DB connection
  2. Write the SQL query that should be executed, and select the query result type from Result type dropdown. You can test the query by clicking Test Query
  3. If there are at least two preceding tasks, choose task execution condition:
    • all preceding conditions evaluate to true (AND)
    • one of the preceding conditions evaluate to true (OR)

Run package task

  1. Select the package to run
  2. Optionally, edit package variables If you want to override variable values before running the task.
  3. If there are at least two preceding tasks, choose task execution condition:
    • all preceding conditions evaluate to true (AND)
    • one of the preceding conditions evaluate to true (OR)

Using Variables in Workflows

User variables can be defined at the workflow package level. They can be used in the Execute SQL task within the query in which they'll be substitued for their values. They can also be assigned values by the Execute SQL task.

When setting up a Run package task, workflow package level variables can be used in expressions assigned to the dataflow variables. Note that if both workflow and dataflow variables have the same name, you will still have to assign the workflow variable to the dataflow variable in the Run package task (i.e. the workflow variable will not override an existing task variable). However, if a task dataflow uses a variable that isn't defined at the dataflow level but is assigned a value at the workflow level, the dataflow task will use the workflow variable value.

Feedback and Knowledge Base