dbt Redshift

dbt-redshift from dbt-labs

The dbt-redshift Meltano transformer pulls data from dbt Redshift that can then be sent to a destination using a loader.

Other Available Variants

  • dbt-labs (default)

Getting Started

Prerequisites

If you haven't already, follow the initial steps of the Getting Started guide:

  1. Install Meltano
  2. Create your Meltano project

Installation and configuration

  1. Add the dbt-redshift transformer to your project using
    meltano add
    :
  2. meltano add transformer dbt-redshift
  3. Configure the dbt-redshift settings using
    meltano config
    :
  4. meltano config dbt-redshift set --interactive

Next steps

If you run into any issues, learn how to get help.

Capabilities

The current capabilities for
dbt-redshift
may have been automatically set when originally added to the Hub. Please review the capabilities when using this transformer. If you find they are out of date, please consider updating them by making a pull request to the YAML file that defines the capabilities for this transformer.

This plugin has the following capabilities:

    You can override these capabilities or specify additional ones in your meltano.yml by adding the capabilities key.

    Settings

    The dbt-redshift settings that are known to Meltano are documented below. To quickly find the setting you're looking for, click on any setting name from the list:

    You can override these settings or specify additional ones in your meltano.yml by adding the settings key.

    Please consider adding any settings you have defined locally to this definition on MeltanoHub by making a pull request to the YAML file that defines the settings for this plugin.

    Project Directory (project_dir)

    • Environment variable: DBT_REDSHIFT_PROJECT_DIR
    • Default Value: $MELTANO_PROJECT_ROOT/transform
    [No description provided.]

    Profiles Directory (profiles_dir)

    • Environment variable: DBT_REDSHIFT_PROFILES_DIR
    • Default Value: $MELTANO_PROJECT_ROOT/transform/profiles/redshift
    [No description provided.]

    Authentication Method (auth_method)

    • Environment variable: DBT_REDSHIFT_AUTH_METHOD

    The auth method to use (to use iam, set to "iam". Omit to use password-based auth.)

    Cluster ID (cluster_id)

    • Environment variable: DBT_REDSHIFT_CLUSTER_ID

    The cluster id.

    Host (host)

    • Environment variable: DBT_REDSHIFT_HOST

    The host for the cluster.

    Password (password)

    • Environment variable: DBT_REDSHIFT_PASSWORD

    The password, if using password-based auth.

    User (user)

    • Environment variable: DBT_REDSHIFT_USER

    The user to connect as.

    Port (port)

    • Environment variable: DBT_REDSHIFT_PORT

    The port to connect to.

    Database (dbname)

    • Environment variable: DBT_REDSHIFT_DBNAME

    The name of the db to connect to.

    Schema (schema)

    • Environment variable: DBT_REDSHIFT_SCHEMA

    The schema to use.

    IAM Profile (iam_profile)

    • Environment variable: DBT_REDSHIFT_IAM_PROFILE

    The IAM profile to use.

    IAM Duration Seconds (iam_duration_seconds)

    • Environment variable: DBT_REDSHIFT_IAM_DURATION_SECONDS

    Duration of the IAM session.

    Autocreate (autocreate)

    • Environment variable: DBT_REDSHIFT_AUTOCREATE

    Whether or not to automatically create entities.

    Databse Groups (db_groups)

    • Environment variable: DBT_REDSHIFT_DB_GROUPS

    Database groups to use.

    Keep Alives Idle (keepalives_idle)

    • Environment variable: DBT_REDSHIFT_KEEPALIVES_IDLE

    Seconds between TCP keepalive packets

    Search Path (search_path)

    • Environment variable: DBT_REDSHIFT_SEARCH_PATH

    The search path to use (use of this setting is not recommended)

    SSL Mode (sslmode)

    • Environment variable: DBT_REDSHIFT_SSLMODE

    SSL MOde used to connect to Redshift.

    RA3 Node (ra3_node)

    • Environment variable: DBT_REDSHIFT_RA3_NODE

    Enables cross-database sources.

    Something missing?

    This page is generated from a YAML file that you can contribute changes to.

    Edit it on GitHub!

    Looking for help?

    If you're having trouble getting the dbt-redshift transformer to work, look for an existing issue in its repository, file a new issue, or join the Meltano Slack community and ask for help in the
    #plugins-general
    channel.

    Install

    meltano add transformer dbt-redshift

    Maintenance Status

    • Maintenance Status
    • Stars
    • Forks
    • Open Issues
    • Open PRs
    • Contributors
    • License

    Maintainer

    • dbt Labs

    Meltano Stats

    • Total Executions (Last 3 Months)
    • Projects (Last 3 Months)

    Keywords