Page History
...
Yellowfin offers a way to save your transformed data into a database table via the SQL database output step. To configure this step, you will need to configure a number of different settings in relation to the target database, target table, the type of update that is required, and the fields that will be mapped. This guide explains how to do all of this.
| Anchor | ||||
|---|---|---|---|---|
|
| Warning |
|---|
Warning: Extra caution should be taken when configuring the output step so that any existing source data does not get accidentally overwritten. The output to database step has a variety of options such as dropping tables, truncating (deleting) data, adding new rows, and updating existing data. It is recommended that a test database is used when developing transformation flows. Further, the output step is disabled by default when in edit mode (see Run in Preview Design mode option). |
Understanding the Options
...
- Choose database from the list. Only writeable data sources will be shown.
- Choose a table creation option. Click here to understand the table creation options.
- Continue with the selected process:
- If Use Existing was selected, select a pre-existing table to write data into. Then skip to step 4.
- If Create If Not Exists was selected, then enter a new table name. You can optionally select any table fields that you would like to index (note: indexes are used to improve query performance. If in doubt about this option, please contact your system administrator). Move on to step 4.
- If Drop Existing was selected, then enter a new table name. Skip ahead to step 5.
- If Drop if Metadata Conflicts was selected, then enter a new table name, also specify whether the existing table is to be dropped in case there are more fields in the transformation flow than in the table. Then skip to step 4.
Choose an update type to indicate how the table will be updated. Click here to understand all the options.
Note For Update and Update & Insert options, additional row matching is required. This is done by choosing Join for the identifier or matching field, and then Set to indicate which field to update. If no option is selected, the field will not be used in the join or be updated as part of the flow.
- Switch on the toggle to run this output step in preview design mode. SEE WARNING NOTE.
- Once the configuration is done, click on the Apply button to save these changes.
...