KServe provides a K8s CRD for serving ML models on arbitrary frameworks.
kserve’s Readme
kserve resources