The Architect

Modern cloud, data, and AI architecture

Discover

Latest Articles

Navigating the Data Revolution: The Pinnacle of Data Science in 2023

Introduction The realm of Data Science continues to expand with the advent of cutting-edge technologies and methodologies. The year 2023 has seen remarkable growth and evolution in data-driven practices, paving...

Exploring the Horizon: AI Advancements in 2023

Introduction Artificial Intelligence (AI) continues to evolve, opening new realms of possibilities across various sectors. 2023 has witnessed some groundbreaking advancements in AI, shaping a future where machines not only...

in - DevOps   Data Engineering   Cloud Computing

Navigating Continuous Data Pipelines: An Extensive Look into CI/CD with Azure DevOps, dbt, Airflow, GCS, and BigQuery

Introduction Continuous Integration and Continuous Deployment (CI/CD) serve as the backbone of modern data engineering, enabling seamless and reliable data pipelines. This article embarks on an extensive exploration of CI/CD implementation, employing Azure DevOps, dbt, Airflow (via Cloud Composer), Google...