Airflow
- Airflow deployment on Virtual Machines, Company on-premises machines with or without Docker, with all kinds of available executors, Kubernetes, Celery, Local, etc.
- Designing and creating Airflow workflows(DAGs), moving current solution(ETL processes/Workflows) to Apache Airflow.
- Investigating and resolving performance, security issues also all kinds of problems that not always are dependent on Airflow , why it was restarted, why Airflow is not starting up, why tasks are not getting executed, why there is high CPU and memory USAGE on Airflow Machine.
- Upgraiding and support AirFlow platform.
- Integrating Airflow with external services, writing custom operators, hooks, fixing bugs in existing ones, integrating with company on-premises authentication services(LDAP, ActiveDirectory, etc.).
- Existing code review whether it is in compliance with Airflow good practices, whether all kinds of Airflow features are used correctly and not replaced by custom unnecessary ones.
