Grai Blog
  • Home
  • Slack
  • About
Sign in Subscribe
Edward Louth

Edward Louth

Data engineer, runner, founder @grai.io. You can find me wandering the WeWorks of London.
London, UK
https://grai.io
Extracting Data Lineage from BigQuery Logs: A Guide
Seize the Grai

Extracting Data Lineage from BigQuery Logs: A Guide

Extracting data lineage from a data warehouse like BigQuery can be complicated because unlike traditional relational databases we rarely have foreign keys or database constraints to fall back upon. Complicating the picture even further, common data workflows like ELT (Extract, Load, Transform) incentivize users to duplicate data making it difficult
Aug 1, 2023 3 min read
Enhancing dbt Tests

Enhancing dbt Tests

Grai allows many pipeline tests, including those defined in dbt, to be run anywhere else in the data stack. This feature allows us to validate that changes to upstream data assets, like your production database, won't break data pipelines, BI dashboards, or APIs all as part of a pull request.
Jul 28, 2023 6 min read
Page 1 of 1
Grai Blog © 2023
  • Sign up
Powered by Ghost