Centralized GCP MLOps Platform for Cost Efficiency and Streamlined Development

Key information

Time Frame

2021 – 2022

Client Industry

FMCG

Cloud Platform

Google Cloud Platform (GCP)

Technologies

GCP, Kubeflow, BigQuery, Kubernetes, Python, Docker, CI/CD with GitHub Actions

Project size

25 consultants

Challenge

The client faced the challenge of developing, deploying, and maintaining multiple ML production-ready use cases across different cloud platforms, leading to inefficiencies in resource consumption and maintenance. They sought a solution that would centralize their ML operations onto a single, scalable platform while streamlining their development and deployment processes through effective CI/CD.

Project Description

Our team embarked on a comprehensive project to centralize the client’s diverse use cases onto GCP. Leveraging the power of GCP’s robust infrastructure and services, we designed and implemented a flexible and scalable solution that accommodated various business operational needs.

Solution

A single production platform which automatically tests, integrates, and deploys new ML algorithms in production as well as model monitoring and retraining.

Key implementations:

  • Automated process of CI/CD that meets organization’s standards and best practices.
  • Auto-ticketing for the operations team when ML pipelines fail (e-mails and tickets).
  • Resource autoscaling and consumptions logging.
  • Model versioning, model monitoring, and model retraining pipelines (triggered if data / concept drift is detected).

Outcome/Benefits

Through strategic utilization of GCP and innovative technologies like Docker, Kubernetes, and CI/CD, we successfully improved and standardized our client’s process of developing, training, productionizing, and maintaining ML models. We delivered a centralized, cost-effective, and agile platform for their business operations. This project stands as a testament to our expertise in MLOps and our commitment to driving innovation and efficiency for our clients in the fast-paced world of FMCG.

Conclusion

Through strategic utilization of Google Cloud Platform and cutting-edge technologies like Docker, Kubernetes, and CI/CD, we successfully addressed our client’s challenges and delivered a centralized, cost-effective, and agile platform for their FMCG operations. This project stands as a testament to our expertise in cloud technology and our commitment to driving innovation and efficiency for our clients in the fast-paced world of FMCG.

We’re available for new projects

Contact us

Contact us to see how we can help you.
We’ll get back to you within 4 hours on working days (Mon – Fri, 9am – 5pm).

Dominik Radwański

Service Delivery Partner

Address

Poland
DS Stream sp. z o.o.
Grochowska 306/308
03-840 Warsaw, Poland

United States of America
DS Stream LLC
1209 Orange St,
Wilmington, DE 19801

    Select subject of application


    The Controller of your personal data is DS Stream sp. z o.o. with its registered office in Warsaw (03-840), at ul. Grochowska 306/308. Your personal data will be processed in order to answer the question and archive the form. More information about the processing of your personal data can be found in the Privacy Policy.