Add Install Gateway section in Getting Started Latest guide

dharaneeshvrd · dharaneeshvrd · commit 9240af22e36a · 2025-10-23T10:03:59.000+05:30
- Move instructions from the Deploy an Inference Gateway section describing installation of Gateway API CRDs and provider specific GWs

Signed-off-by: Dharaneeshwaran Ravichandran &lt;dharaneeshwaran.ravichandran@ibm.com&gt;
diff --git a/site-src/guides/getting-started-latest.md b/site-src/guides/getting-started-latest.md
@@ -1,3 +1,5 @@
+<!-- If you are updating this getting-started-latest.md guide, please make sure to update the index.md as well -->
+
 # Getting started with an Inference Gateway
 
 !!! warning "Unreleased/main branch"
@@ -41,86 +43,110 @@
 kubectl apply -k https://github.com/kubernetes-sigs/gateway-api-inference-extension/config/crd
 ```
 
-### Deploy the InferencePool and Endpoint Picker Extension
+### Install the Gateway
 
-   Install an InferencePool named `vllm-llama3-8b-instruct` that selects from endpoints with label `app: vllm-llama3-8b-instruct` and listening on port 8000. The Helm install command automatically installs the endpoint-picker, InferencePool along with provider specific resources.
+   Choose one of the following options to install Gateway.
 
-   Set the chart version and then select a tab to follow the provider-specific instructions.
+=== "GKE"
 
-   ```bash
-   export IGW_CHART_VERSION=v0
-   ```
+      Nothing to install here, you can move to the next [section](#deploy-the-inferencepool-and-endpoint-picker-extension)
 
---8<-- "site-src/_includes/epp-latest.md"
+=== "Istio"
 
-### Deploy an Inference Gateway
+      1. Requirements
+         - Gateway API [CRDs](https://gateway-api.sigs.k8s.io/guides/#installing-gateway-api) installed.
 
-   Choose one of the following options to deploy an Inference Gateway.
+      2. Install Istio
 
-=== "GKE"
+         ```
+         TAG=$(curl https://storage.googleapis.com/istio-build/dev/1.28-dev)
+         # on Linux
+         wget https://storage.googleapis.com/istio-build/dev/$TAG/istioctl-$TAG-linux-amd64.tar.gz
+         tar -xvf istioctl-$TAG-linux-amd64.tar.gz
+         # on macOS
+         wget https://storage.googleapis.com/istio-build/dev/$TAG/istioctl-$TAG-osx.tar.gz
+         tar -xvf istioctl-$TAG-osx.tar.gz
+         # on Windows
+         wget https://storage.googleapis.com/istio-build/dev/$TAG/istioctl-$TAG-win.zip
+         unzip istioctl-$TAG-win.zip
 
-      1. Enable the Google Kubernetes Engine API, Compute Engine API, the Network Services API and configure proxy-only subnets when necessary. 
-         See [Deploy Inference Gateways](https://cloud.google.com/kubernetes-engine/docs/how-to/deploy-gke-inference-gateway)
-         for detailed instructions.
+         ./istioctl install --set tag=$TAG --set hub=gcr.io/istio-testing --set values.pilot.env.ENABLE_GATEWAY_API_INFERENCE_EXTENSION=true
+         ```
+
+=== "Kgateway"
 
-      2. Deploy Inference Gateway:
+      1. Requirements
+
+         - Gateway API [CRDs](https://gateway-api.sigs.k8s.io/guides/#installing-gateway-api) installed.
+         - [Helm](https://helm.sh/docs/intro/install/) installed.
+
+      2. Set the Kgateway version and install the Kgateway CRDs.
 
          ```bash
-         kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/gke/gateway.yaml
+         KGTW_VERSION=v2.1.0
+         helm upgrade -i --create-namespace --namespace kgateway-system --version $KGTW_VERSION kgateway-crds oci://cr.kgateway.dev/kgateway-dev/charts/kgateway-crds
          ```
 
-         Confirm that the Gateway was assigned an IP address and reports a `Programmed=True` status:
+      3. Install Kgateway
 
          ```bash
-         $ kubectl get gateway inference-gateway
-         NAME                CLASS               ADDRESS         PROGRAMMED   AGE
-         inference-gateway   inference-gateway   <MY_ADDRESS>    True         22s
+         helm upgrade -i --namespace kgateway-system --version $KGTW_VERSION kgateway oci://cr.kgateway.dev/kgateway-dev/charts/kgateway --set inferenceExtension.enabled=true
          ```
-      3. Deploy the HTTPRoute
+
+=== "Agentgateway"
+
+      1. Requirements
+
+         - Gateway API [CRDs](https://gateway-api.sigs.k8s.io/guides/#installing-gateway-api) installed.
+         - [Helm](https://helm.sh/docs/intro/install/) installed.
+
+      2. Set the Kgateway version and install the Kgateway CRDs.
 
          ```bash
-         kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/gke/httproute.yaml
+         KGTW_VERSION=v2.1.0
+         helm upgrade -i --create-namespace --namespace kgateway-system --version $KGTW_VERSION kgateway-crds oci://cr.kgateway.dev/kgateway-dev/charts/kgateway-crds
          ```
 
-      4. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
+      3. Install Kgateway
 
          ```bash
-         kubectl get httproute llm-route -o yaml
+         helm upgrade -i --namespace kgateway-system --version $KGTW_VERSION kgateway oci://cr.kgateway.dev/kgateway-dev/charts/kgateway --set inferenceExtension.enabled=true --set agentgateway.enabled=true
          ```
 
-=== "Istio"
+### Deploy the InferencePool and Endpoint Picker Extension
 
-      Please note that this feature is currently in an experimental phase and is not intended for production use.
-      The implementation and user experience are subject to changes as we continue to iterate on this project.
+   Install an InferencePool named `vllm-llama3-8b-instruct` that selects from endpoints with label `app: vllm-llama3-8b-instruct` and listening on port 8000. The Helm install command automatically installs the endpoint-picker, InferencePool along with provider specific resources.
+
+   Set the chart version and then select a tab to follow the provider-specific instructions.
 
-      1.  Requirements
+   ```bash
+   export IGW_CHART_VERSION=v0
+   ```
 
-         - Gateway API [CRDs](https://gateway-api.sigs.k8s.io/guides/#installing-gateway-api) installed.
+--8<-- "site-src/_includes/epp-latest.md"
 
-      2. Install Istio
+### Deploy an Inference Gateway
 
-         ```
-         TAG=$(curl https://storage.googleapis.com/istio-build/dev/1.28-dev)
-         # on Linux
-         wget https://storage.googleapis.com/istio-build/dev/$TAG/istioctl-$TAG-linux-amd64.tar.gz
-         tar -xvf istioctl-$TAG-linux-amd64.tar.gz
-         # on macOS
-         wget https://storage.googleapis.com/istio-build/dev/$TAG/istioctl-$TAG-osx.tar.gz
-         tar -xvf istioctl-$TAG-osx.tar.gz
-         # on Windows
-         wget https://storage.googleapis.com/istio-build/dev/$TAG/istioctl-$TAG-win.zip
-         unzip istioctl-$TAG-win.zip
+   Choose one of the following options to deploy an Inference Gateway.
 
-         ./istioctl install --set tag=$TAG --set hub=gcr.io/istio-testing --set values.pilot.env.ENABLE_GATEWAY_API_INFERENCE_EXTENSION=true
-         ```
+=== "GKE"
 
-      3. If your EPP uses secure serving with self-signed certs (default), temporarily bypass TLS verification:
+      1. Enable the Google Kubernetes Engine API, Compute Engine API, the Network Services API and configure proxy-only subnets when necessary. 
+         See [Deploy Inference Gateways](https://cloud.google.com/kubernetes-engine/docs/how-to/deploy-gke-inference-gateway)
+         for detailed instructions.
+
+=== "Istio"
+
+      Please note that this feature is currently in an experimental phase and is not intended for production use.
+      The implementation and user experience are subject to changes as we continue to iterate on this project.
+
+      1. If your EPP uses secure serving with self-signed certs (default), temporarily bypass TLS verification:
 
          ```bash
          kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/istio/destination-rule.yaml
          ```
  
-      4. Deploy Gateway
+      2. Deploy the Inference Gateway
 
          ```bash
          kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/istio/gateway.yaml
@@ -133,13 +159,13 @@ kubectl apply -k https://github.com/kubernetes-sigs/gateway-api-inference-extens
          inference-gateway   inference-gateway   <MY_ADDRESS>    True         22s
          ```
 
-      5. Deploy the HTTPRoute
+      3. Deploy the HTTPRoute
 
          ```bash
          kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/istio/httproute.yaml
          ```
 
-      6. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
+      4. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
 
          ```bash
          kubectl get httproute llm-route -o yaml
@@ -151,25 +177,7 @@ kubectl apply -k https://github.com/kubernetes-sigs/gateway-api-inference-extens
       [conformant](https://github.com/kubernetes-sigs/gateway-api-inference-extension/tree/main/conformance/reports/v1.0.0/gateway/kgateway)
       gateway. Follow these steps to run Kgateway:
 
-      1. Requirements
-
-         - [Helm](https://helm.sh/docs/intro/install/) installed.
-         - Gateway API [CRDs](https://gateway-api.sigs.k8s.io/guides/#installing-gateway-api) installed.
-
-      2. Set the Kgateway version and install the Kgateway CRDs.
-
-         ```bash
-         KGTW_VERSION=v2.2.0-main
-         helm upgrade -i --create-namespace --namespace kgateway-system --version $KGTW_VERSION kgateway-crds oci://cr.kgateway.dev/kgateway-dev/charts/kgateway-crds
-         ```
-
-      3. Install Kgateway
-
-         ```bash
-         helm upgrade -i --namespace kgateway-system --version $KGTW_VERSION kgateway oci://cr.kgateway.dev/kgateway-dev/charts/kgateway --set inferenceExtension.enabled=true
-         ```
-
-      4. Deploy the Gateway
+      1. Deploy the Inference Gateway
 
          ```bash
          kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/kgateway/gateway.yaml
@@ -182,13 +190,13 @@ kubectl apply -k https://github.com/kubernetes-sigs/gateway-api-inference-extens
          inference-gateway   kgateway            <MY_ADDRESS>    True         22s
          ```
 
-      5. Deploy the HTTPRoute
+      2. Deploy the HTTPRoute
 
          ```bash
          kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/kgateway/httproute.yaml
          ```
 
-      6. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
+      3. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
 
          ```bash
          kubectl get httproute llm-route -o yaml
@@ -200,25 +208,7 @@ kubectl apply -k https://github.com/kubernetes-sigs/gateway-api-inference-extens
       Agentgateway integrates with [Kgateway](https://kgateway.dev/) as it's control plane. Follow these steps to run Kgateway with the agentgateway
       data plane:
 
-      1. Requirements
-
-         - [Helm](https://helm.sh/docs/intro/install/) installed.
-         - Gateway API [CRDs](https://gateway-api.sigs.k8s.io/guides/#installing-gateway-api) installed.
-
-      2. Set the Kgateway version and install the Kgateway CRDs.
-
-         ```bash
-         KGTW_VERSION=v2.2.0-main
-         helm upgrade -i --create-namespace --namespace kgateway-system --version $KGTW_VERSION kgateway-crds oci://cr.kgateway.dev/kgateway-dev/charts/kgateway-crds
-         ```
-
-      3. Install Kgateway
-
-         ```bash
-         helm upgrade -i --namespace kgateway-system --version $KGTW_VERSION kgateway oci://cr.kgateway.dev/kgateway-dev/charts/kgateway --set inferenceExtension.enabled=true --set agentgateway.enabled=true
-         ```
-
-      4. Deploy the Gateway
+      1. Deploy the Inference Gateway
 
          ```bash
          kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/agentgateway/gateway.yaml
@@ -231,13 +221,13 @@ kubectl apply -k https://github.com/kubernetes-sigs/gateway-api-inference-extens
          inference-gateway   agentgateway        <MY_ADDRESS>    True         22s
          ```
 
-      5. Deploy the HTTPRoute
+      2. Deploy the HTTPRoute
 
          ```bash
          kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/agentgateway/httproute.yaml
          ```
 
-      6. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
+      3. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
 
          ```bash
          kubectl get httproute llm-route -o yaml
diff --git a/site-src/guides/index.md b/site-src/guides/index.md
@@ -1,3 +1,5 @@
+<!-- If you are updating this index.md guide, please make sure to update the getting-started-latest.md as well -->
+
 # Getting started with an Inference Gateway
 
 --8<-- "site-src/_includes/intro.md"

Original file line number	Diff line number	Diff line change
`@@ -1,3 +1,5 @@`
	`1`	`+<!-- If you are updating this index.md guide, please make sure to update the getting-started-latest.md as well -->`
	`2`	`+`
`1`	`3`	`# Getting started with an Inference Gateway`
`2`	`4`
`3`	`5`	`--8<-- "site-src/_includes/intro.md"`