The dbt-redshift Meltano transformer pulls data from dbt Redshift that can then be sent to a destination using a loader.
Other Available Variants
- dbt-labs (default)
Getting Started
Prerequisites
If you haven't already, follow the initial steps of the Getting Started guide:
Installation and configuration
-
Add the dbt-redshift transformer to your project
using
:meltano add
-
Configure the dbt-redshift settings using
:meltano config
meltano add transformer dbt-redshift
meltano config dbt-redshift set --interactive
Next steps
Follow the remaining steps of the Getting Started guide:
If you run into any issues, learn how to get help.
Capabilities
The current capabilities fordbt-redshift
may have been automatically set when originally added to the Hub. Please review the
capabilities when using this transformer. If you find they are out of date, please
consider updating them by making a pull request to the YAML file that defines the
capabilities for this transformer.This plugin has the following capabilities:
You can
override these capabilities or specify additional ones
in your meltano.yml
by adding the capabilities
key.
Settings
The
dbt-redshift
settings that are known to Meltano are documented below. To quickly
find the setting you're looking for, click on any setting name from the list:
project_dir
profiles_dir
auth_method
cluster_id
host
password
user
port
dbname
schema
iam_profile
iam_duration_seconds
autocreate
db_groups
keepalives_idle
search_path
sslmode
ra3_node
You can
override these settings or specify additional ones
in your meltano.yml
by adding the settings
key.
Please consider adding any settings you have defined locally to this definition on MeltanoHub by making a pull request to the YAML file that defines the settings for this plugin.
Project Directory (project_dir)
-
Environment variable:
DBT_REDSHIFT_PROJECT_DIR
-
Default Value:
$MELTANO_PROJECT_ROOT/transform
Profiles Directory (profiles_dir)
-
Environment variable:
DBT_REDSHIFT_PROFILES_DIR
-
Default Value:
$MELTANO_PROJECT_ROOT/transform/profiles/redshift
Authentication Method (auth_method)
-
Environment variable:
DBT_REDSHIFT_AUTH_METHOD
The auth method to use (to use iam, set to "iam". Omit to use password-based auth.)
Cluster ID (cluster_id)
-
Environment variable:
DBT_REDSHIFT_CLUSTER_ID
The cluster id.
Host (host)
-
Environment variable:
DBT_REDSHIFT_HOST
The host for the cluster.
Password (password)
-
Environment variable:
DBT_REDSHIFT_PASSWORD
The password, if using password-based auth.
User (user)
-
Environment variable:
DBT_REDSHIFT_USER
The user to connect as.
Port (port)
-
Environment variable:
DBT_REDSHIFT_PORT
The port to connect to.
Database (dbname)
-
Environment variable:
DBT_REDSHIFT_DBNAME
The name of the db to connect to.
Schema (schema)
-
Environment variable:
DBT_REDSHIFT_SCHEMA
The schema to use.
IAM Profile (iam_profile)
-
Environment variable:
DBT_REDSHIFT_IAM_PROFILE
The IAM profile to use.
IAM Duration Seconds (iam_duration_seconds)
-
Environment variable:
DBT_REDSHIFT_IAM_DURATION_SECONDS
Duration of the IAM session.
Autocreate (autocreate)
-
Environment variable:
DBT_REDSHIFT_AUTOCREATE
Whether or not to automatically create entities.
Databse Groups (db_groups)
-
Environment variable:
DBT_REDSHIFT_DB_GROUPS
Database groups to use.
Keep Alives Idle (keepalives_idle)
-
Environment variable:
DBT_REDSHIFT_KEEPALIVES_IDLE
Seconds between TCP keepalive packets
Search Path (search_path)
-
Environment variable:
DBT_REDSHIFT_SEARCH_PATH
The search path to use (use of this setting is not recommended)
SSL Mode (sslmode)
-
Environment variable:
DBT_REDSHIFT_SSLMODE
SSL MOde used to connect to Redshift.
RA3 Node (ra3_node)
-
Environment variable:
DBT_REDSHIFT_RA3_NODE
Enables cross-database sources.
Something missing?
This page is generated from a YAML file that you can contribute changes to.
Edit it on GitHub!Looking for help?
#plugins-general
channel.
Install
meltano add transformer dbt-redshift
Maintenance Status
Meltano Stats
Keywords