DataOps & MLOps

DataOps

• Use dbt for data test, data transformation, documentation
• Use SQLMesh for data test, data transformation, documentation

MLOps

• Use feast for the feature store
• Use mlflow for model training tracking
• Use Kserve for feature serving

Orchestration

• Use Airflow for model orchestrastion

minikube mount /Users/kcl/projects/data:/home/docker/data