Blog

Big data, big impact. Insights from the Experts

Explore how cutting-edge data solutions are revolutionizing decision-making and tranforming businesses worldwide.

Featured blog posts

Data Engineering
June 13, 2025
Michal Milosz
16
min read

Designing Scalable Data Pipelines: Batch, Streaming, and Layered Architectures

Discover the strengths and uses of three key data architectures - find out how they work and which one fits your needs best
Read more
Generative AI
4
min read

Beyond Text Generation: Unpacking the Power of AI Agents vs. Pure LLMs

Read more
Data Engineering
10
min read

The Power of Orchestration: Managing Complex Workflows in Databricks

Read more
DevOps
11
min read

Azure Data Factory or Apache Airflow: Which Orchestration Tool Reigns Supreme?

Read more

Latest blog posts

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
No blog posts found.
Data Engineering
16
min read

Designing Scalable Data Pipelines: Batch, Streaming, and Layered Architectures

Discover the strengths and uses of three key data architectures - find out how they work and which one fits your needs best
Read more
Generative AI
4
min read

Beyond Text Generation: Unpacking the Power of AI Agents vs. Pure LLMs

Understand the Power of AI Agents vs. Pure LLMs
Read more
Data Engineering
10
min read

The Power of Orchestration: Managing Complex Workflows in Databricks

Master Databricks workflow orchestration – automate tasks, integrate Airflow & ADF, and optimize pipelines. Boost efficiency with dynamic scheduling!
Read more
DevOps
11
min read

Azure Data Factory or Apache Airflow: Which Orchestration Tool Reigns Supreme?

Compare Azure Data Factory vs Apache Airflow: key features, strengths, and limitations for data orchestration. Choose the best tool for your workflow needs.
Read more
Databricks
9
min read

Managing Large Data Sets in Databricks

Optimize large datasets in Databricks with Partitioning, Z-Ordering, Auto Optimize, Delta Lake Vacuum, Caching, and Cost Monitoring for better performance.
Read more
Data Engineering
12
min read

Configuring the Celery Kubernetes

Configure the Celery Kubernetes Executor in Airflow 2.0 to combine Celery's scalability with Kubernetes' resource optimization for efficient workflows.
Read more
Cloud Computing
9
min read

Google Cloud Platform AI Notebook JupyterLab

Learn how to increase memory in GCP AI JupyterLab notebooks to prevent kernel crashes caused by out-of-memory errors. This guide explains how to identify memory issues, adjust memory settings, and ensure smooth data analysis in cloud environments.
Read more
Data Engineering
12
min read

What Is A Relational Database?

Explore relational databases, their advantages, disadvantages, and use cases. Learn SQL basics, NoSQL alternatives, and tips for choosing the right database.
Read more
Data Engineering
7
min read

The Future of Data Engineering – Trends to Watch in 2025

Discover the top data engineering trends for 2025, including AI-driven automation, Lakehouse architecture, serverless and edge computing, and sustainable data practices. Embracing these innovations will help organisations optimise data operations and stay ahead in a rapidly changing landscape.
Read more
Data Engineering
6
min read

Data Warehouse vs. Data Lake vs Lakehouse: A Comprehensive Comparison of Data Management Approaches

Read more

Let’s talk and work together

We’ll get back to you within 4 hours on working days (Mon – Fri, 9am – 5pm CET).

Data engineering for cloud-based data processing and storage.
Dominik Radwański
Service Delivery Partner
The Controller of your personal data is DS STREAM sp. z o.o. with its registered office in Warsaw (03-840), at ul. Grochowska 306/308. Your personal data will be processed in order to answer the question and archive the form. More information about the processing of your personal data can be found in the Privacy Policy.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.