Blog
Michal Milosz

Latest blog posts by Michal Milosz

Latest blog posts

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
No blog posts found.
Data Engineering
11
min read

Azure Data Factory or Apache Airflow: Which Orchestration Tool Reigns Supreme?

This article delves into the key features, strengths, and limitations of both Azure Data Factory and Apache Airflow.
Read more
Databricks
9
min read

Managing Large Data Sets in Databricks

Optimize large datasets in Databricks with Partitioning, Z-Ordering, Auto Optimize, Delta Lake Vacuum, Caching, and Cost Monitoring for better performance.
Read more
Data Engineering
12
min read

Configuring the Celery Kubernetes

Learn how to configure the Celery Kubernetes Executor in Airflow 2.0, combining the benefits of Celery and Kubernetes Executors for efficient task management and resource optimization.
Read more
Data Engineering
7
min read

The Future of Data Engineering – Trends to Watch in 2025

Read more
Data Engineering
6
min read

Data Warehouse vs. Data Lake vs Lakehouse: A Comprehensive Comparison of Data Management Approaches

Read more
DevOps
min read

How to spin up to 1000 parallel Airflow 2.0 tasks in 5 minutes from nothing with the CeleryExecutor and Kubernetes

Read more
Data Science
min read

Stream Processing vs. Batch Processing - A Practical Guide to Data Processing

Read more
Data Science
min read

Microservices in Data Engineering: How to Break a Monolith into Smaller Parts

Read more
Data Science
min read

From Excel to Data Lake: The Evolution of Data Storage in a Modern Organization

Read more
Data Science
min read

Lakehouse Federation in Databricks: A Practical Guide

Read more