Spike DBT integration with Airflow to scale data integrity

Assign
Data Source
Priority
Status
In progress
Description
Estimated Completion
Tags
Property
Pros
  1. Basically free, no cap on developer limit
  1. Complete ownership of pipelines and deployment environment
  1. No additional server maintenance overhead
  1. Daodash GIT integration possible
Cons
  1. Completely CLI based (no fancy user friendly GUI)
  1. Initial Setup process is time-taking (haven't done this before)
  1. Deployment to other DAOs would require more effort (still need to explore)
  1. Developers require local setup of dbt to test their model before pushing to git
 
 

Spike DBT integration with Airflow to scale data integrity

Assign
Data Source
Priority
Status
In progress
Description
Estimated Completion
Tags
Property
Pros
  1. Basically free, no cap on developer limit
  1. Complete ownership of pipelines and deployment environment
  1. No additional server maintenance overhead
  1. Daodash GIT integration possible
Cons
  1. Completely CLI based (no fancy user friendly GUI)
  1. Initial Setup process is time-taking (haven't done this before)
  1. Deployment to other DAOs would require more effort (still need to explore)
  1. Developers require local setup of dbt to test their model before pushing to git