dbt Explained
dbt: The Data Engineer's Superhero Sidekick Let’s face it: writing SQL is fun… until you’re juggling 47 versions of the same query, hunting down broken dashboards, or explaining to your…
Building Your First DAG with Apache Airflow
Apache Airflow is a powerful platform for orchestrating complex workflows. After learning the Fundamentals and installing Airflow with Docker, it’s time to dive into one of its most essential features…
Warehouses, Lakes, and Lakehouse
The modern data ecosystem is like a real estate market for your bytes except instead of bidding wars, we’ve got schema-on-write vs. schema-on-read drama. Let’s break down the contenders: Data Warehouses, Data Lakes, Lakehouses, and crack open…
Installing Apache Airflow with Docker
Apache Airflow is a powerful workflow orchestration tool used for scheduling, monitoring, and managing complex workflows. Read my previous blog on the Fundamentals of Apache Airflow. Installing Airflow can sometimes…
Fundamentals of Apache Airflow
Modern data workflows involve numerous interconnected tasks, dependencies, and schedules. Manually managing these workflows or using basic schedulers like cron jobs quickly becomes inefficient as complexity grows. This is where…
Data Chaos: Where Did It Go Wrong This Time?
I hear Data Catalog, Data Discovery, Data Observability, and Data Governance thrown around almost every day. But when these terms are used loosely, it reminds me of that iconic line from The Princess Bride: "You keep…
Anatomy of Modern Data Stack
I’ve spent countless hours exploring new data tools, only to find myself overwhelmed by the sheer number of options - many promising to solve the same problems in slightly different…
Evolution of BI in 2024
I wrote a blog defining Business Intelligence (BI) back in 2021. So what is BI in 2024? It is still not mind-reading, but close enough. However, everyone defines it differently,…
What is Amazon Redshift?
Data warehousing is not a new concept as it is about multiple processes stitched together to consolidate data from several data sources, store them in a common format, and transform…
Building Your First Report and Dashboard in Power BI: A Step-by-Step Guide
Introduction Embark on your Power BI journey by creating a stunning report and dashboard that bring your data to life! In this article, I'll walk you through each step -…