Blog – AnilDataBI

Warehouses, Lakes, and Lakehouse

By Anil Thapa February 18, 2025Data Storage

The modern data ecosystem is like a real estate market for your bytes except instead of bidding wars, we’ve got schema-on-write vs. schema-on-read drama. Let’s break down the contenders: Data Warehouses, Data Lakes, Lakehouses, and crack open…

Installing Apache Airflow with Docker

By Anil Thapa February 17, 2025Data Engineering

Apache Airflow is a powerful workflow orchestration tool used for scheduling, monitoring, and managing complex workflows. Read my previous blog on the Fundamentals of Apache Airflow. Installing Airflow can sometimes…

Fundamentals of Apache Airflow

By Anil Thapa January 17, 2025Data Engineering

Modern data workflows involve numerous interconnected tasks, dependencies, and schedules. Manually managing these workflows or using basic schedulers like cron jobs quickly becomes inefficient as complexity grows. This is where…

Data Chaos: Where Did It Go Wrong This Time?

By Anil Thapa January 12, 2025Data Stack

I hear Data Catalog, Data Discovery, Data Observability, and Data Governance thrown around almost every day. But when these terms are used loosely, it reminds me of that iconic line from The Princess Bride: "You keep…

Anatomy of Modern Data Stack

By Anil Thapa March 12, 2024Data Stack

I’ve spent countless hours exploring new data tools, only to find myself overwhelmed by the sheer number of options - many promising to solve the same problems in slightly different…

Evolution of BI in 2024

By Anil Thapa February 18, 2024Data Stack

I wrote a blog defining Business Intelligence (BI) back in 2021. So what is BI in 2024? It is still not mind-reading, but close enough. However, everyone defines it differently,…

What is Amazon Redshift?

By Anil Thapa May 13, 2023Data Storage

Data warehousing is not a new concept as it is about multiple processes stitched together to consolidate data from several data sources, store them in a common format, and transform…

A Guide to Snowflake Data Cloud Platform

By Anil Thapa April 8, 2023Data Storage

Traditional data warehouses faced challenges with storing large volumes of data and providing faster and more efficient analytical queries. Things are changing with modern cloud warehouse solutions where the storage…

A Guide to Azure Synapse Analytics Architecture

By Anil Thapa March 12, 2023Data Storage

Digital transformation is critical in today's age to stay competitive. This requires a powerful data management strategy to oversee data integrity & quality, security, and integration with all different data…

Is it time to move to Azure?

By Anil Thapa May 15, 2022Data Storage

Let's jump on the cool kids' bandwagon and move to the cloud. Seriously, you do not want to be the only one doing backups, patching, and worrying about EOL support…