Development Environments

[shaneutt]

To support development and testing we need manifests and deployment tools to deploy a Gateway API implementation with the Scheduler attached within a few simple steps. These tools should cover the following deployment scenarios:

• Deploying on Kubernetes In Docker (KIND) cluster with the VLLM simulator
• Deploying on vanilla Kubernetes with VLLM (or the simulator)
• Deploying on OpenShift with VLLM (or the simulator)

These need to have the following capabilities:

• The components needs to be deployable to any namespace (Istio/Envoy GW, EPP/Scheduler, InferencePool, vllm-sim...)
• Remote access (NodePort, kubectl port forward, etc.)

[elevran]

• can deploy to any namespace (Istio/Envoy GW, EPP/Schedular, InferencePool, vllm-sim...)
• being able to access remotely (NodePort, kubectl port forward, etc.)