Kubeflow Pipelines

Why would you use Kubeflow Pipelines?

Kubeflow Pipelines is an end-to-end (E2E) orchestration tool to deploy, scale and manage your machine learning systems within Docker containers. You can schedule and compare runs, and examine detailed reports on each run.

Here are the main reasons to use Kubeflow Pipelines:

  • It is cloud-agnostic and can run on any Kubernetes cluster

  • Kubeflow is tailored towards machine learning workflows for model deployment, experiment tracking, and hyperparameter tuning

  • You can re-use components and pipelines to create E2E solutions

The kedro-kubeflow plugin

The kedro-kubeflow plugin from GetInData | Part of Xebia enables you to run a Kedro pipeline on Kubeflow Pipelines. Consult the GitHub repository for kedro-kubeflow for further details, or take a look at the documentation.