Explore my thoughts, tutorials, and insights on software development
Subcategory
Showing posts for the Data Engineering subcategory within Data Technologies. Select another category or subcategory to update the list.
This slides are a summarized course for Apache Airflow (Concept, Methdology and Use Cases)
In the modern data stack, managing complex dependencies is a critical engineering challenge. This article explores how Apache Airflow has emerged as the industry standard for programmatic workflow orchestration using Directed Acyclic Graphs (DAGs). By adopting a "Configuration as Code" philosophy, teams can apply software engineering best practices—such as version control and CI/CD—directly to their data infrastructure.
Selecting a database is no longer just a technical choice—it is a strategic decision that dictates a system's ability to scale, recover, and evolve. This guide provides engineering leaders with a high-level framework for understanding NoSQL architectural patterns. It covers the shift from vertical to horizontal scaling, the practical implications of the CAP Theorem, and how to choose between Key-Value, Document, Wide-Column, and Graph models to meet specific business objectives.