The dbt-bigquery Meltano transformer pulls data from dbt BigQuery that can then be sent to a destination using a loader.
Other Available Variants
- dbt-labs (default)
Getting Started
Prerequisites
If you haven't already, follow the initial steps of the Getting Started guide:
Installation and configuration
-
Add the dbt-bigquery transformer to your project
using
:meltano add
-
Configure the dbt-bigquery settings using
:meltano config
meltano add transformer dbt-bigquery
meltano config dbt-bigquery set --interactive
Next steps
Follow the remaining steps of the Getting Started guide:
If you run into any issues, learn how to get help.
Capabilities
The current capabilities fordbt-bigquery
may have been automatically set when originally added to the Hub. Please review the
capabilities when using this transformer. If you find they are out of date, please
consider updating them by making a pull request to the YAML file that defines the
capabilities for this transformer.This plugin has the following capabilities:
You can
override these capabilities or specify additional ones
in your meltano.yml
by adding the capabilities
key.
Settings
The
dbt-bigquery
settings that are known to Meltano are documented below. To quickly
find the setting you're looking for, click on any setting name from the list:
You can
override these settings or specify additional ones
in your meltano.yml
by adding the settings
key.
Please consider adding any settings you have defined locally to this definition on MeltanoHub by making a pull request to the YAML file that defines the settings for this plugin.
Project Directory (project_dir)
-
Environment variable:
DBT_BIGQUERY_PROJECT_DIR
-
Default Value:
$MELTANO_PROJECT_ROOT/transform
Profiles Directory (profiles_dir)
-
Environment variable:
DBT_BIGQUERY_PROFILES_DIR
-
Default Value:
$MELTANO_PROJECT_ROOT/transform/profiles/bigquery
Authentication Method (auth_method)
-
Environment variable:
DBT_BIGQUERY_AUTH_METHOD
The auth method to use. One of: "oauth", "oauth-secrets", or "service-account"
Project (project)
-
Environment variable:
DBT_BIGQUERY_PROJECT
The BigQuery project ID.
(dataset)
-
Environment variable:
DBT_BIGQUERY_DATASET
The dataset to use.
Refresh Token (refresh_token)
-
Environment variable:
DBT_BIGQUERY_REFRESH_TOKEN
The refresh token, if authenticating via oauth-secrets method.
Client ID (client_id)
-
Environment variable:
DBT_BIGQUERY_CLIENT_ID
The client id to use, if authenticating via oauth-secrets method.
Client Secret (client_secret)
-
Environment variable:
DBT_BIGQUERY_CLIENT_SECRET
The client secret to use, if authenticating via oauth-secrets method.
Token URI (token_uri)
-
Environment variable:
DBT_BIGQUERY_TOKEN_URI
The token redirect URI
(keyfile)
-
Environment variable:
DBT_BIGQUERY_KEYFILE
The path to the `keyfile.json`` to use, if authenticating via service-account method.
Something missing?
This page is generated from a YAML file that you can contribute changes to.
Edit it on GitHub!Looking for help?
#plugins-general
channel.
Install
meltano add transformer dbt-bigquery
Maintenance Status
Meltano Stats
Keywords