Skip to content

Commit cbb8928

Browse files
nirrozenbaumnirrozenbaum
authored
quickstart numbering (#1819)
* quickstart numbering Signed-off-by: Nir Rozenbaum <[email protected]> * minor update Signed-off-by: Nir Rozenbaum <[email protected]> --------- Signed-off-by: Nir Rozenbaum <[email protected]>
1 parent 4e01160 commit cbb8928

File tree

2 files changed

+38
-38
lines changed

2 files changed

+38
-38
lines changed

‎site-src/guides/getting-started-latest.md‎

Lines changed: 19 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,7 @@ kubectl apply -k https://github.com/kubernetes-sigs/gateway-api-inference-extens
5656
1. Requirements
5757
- Gateway API [CRDs](https://gateway-api.sigs.k8s.io/guides/#installing-gateway-api) installed.
5858

59-
2. Install Istio
59+
1. Install Istio:
6060

6161
```
6262
TAG=$(curl https://storage.googleapis.com/istio-build/dev/1.28-dev)
@@ -79,14 +79,14 @@ kubectl apply -k https://github.com/kubernetes-sigs/gateway-api-inference-extens
7979

8080
- Gateway API [CRDs](https://gateway-api.sigs.k8s.io/guides/#installing-gateway-api) installed.
8181

82-
2. Set the Kgateway version and install the Kgateway CRDs.
82+
1. Set the Kgateway version and install the Kgateway CRDs:
8383

8484
```bash
8585
KGTW_VERSION=v2.1.0
8686
helm upgrade -i --create-namespace --namespace kgateway-system --version $KGTW_VERSION kgateway-crds oci://cr.kgateway.dev/kgateway-dev/charts/kgateway-crds
8787
```
8888

89-
3. Install Kgateway
89+
1. Install Kgateway:
9090

9191
```bash
9292
helm upgrade -i --namespace kgateway-system --version $KGTW_VERSION kgateway oci://cr.kgateway.dev/kgateway-dev/charts/kgateway --set inferenceExtension.enabled=true
@@ -114,7 +114,7 @@ kubectl apply -k https://github.com/kubernetes-sigs/gateway-api-inference-extens
114114
See [Deploy Inference Gateways](https://cloud.google.com/kubernetes-engine/docs/how-to/deploy-gke-inference-gateway)
115115
for detailed instructions.
116116

117-
2. Deploy the Inference Gateway:
117+
1. Deploy the Inference Gateway:
118118

119119
```bash
120120
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/gke/gateway.yaml
@@ -127,13 +127,13 @@ kubectl apply -k https://github.com/kubernetes-sigs/gateway-api-inference-extens
127127
NAME CLASS ADDRESS PROGRAMMED AGE
128128
inference-gateway inference-gateway <MY_ADDRESS> True 22s
129129
```
130-
3. Deploy the HTTPRoute
130+
1. Deploy the HTTPRoute:
131131

132132
```bash
133133
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/gke/httproute.yaml
134134
```
135135

136-
4. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
136+
1. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
137137

138138
```bash
139139
kubectl get httproute llm-route -o yaml
@@ -144,7 +144,7 @@ kubectl apply -k https://github.com/kubernetes-sigs/gateway-api-inference-extens
144144
Please note that this feature is currently in an experimental phase and is not intended for production use.
145145
The implementation and user experience are subject to changes as we continue to iterate on this project.
146146

147-
1. Deploy the Inference Gateway
147+
1. Deploy the Inference Gateway:
148148

149149
```bash
150150
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/istio/gateway.yaml
@@ -157,13 +157,13 @@ kubectl apply -k https://github.com/kubernetes-sigs/gateway-api-inference-extens
157157
inference-gateway inference-gateway <MY_ADDRESS> True 22s
158158
```
159159

160-
2. Deploy the HTTPRoute
160+
1. Deploy the HTTPRoute:
161161

162162
```bash
163163
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/istio/httproute.yaml
164164
```
165165

166-
3. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
166+
1. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
167167

168168
```bash
169169
kubectl get httproute llm-route -o yaml
@@ -176,7 +176,7 @@ kubectl apply -k https://github.com/kubernetes-sigs/gateway-api-inference-extens
176176
implementation. Kgateway supports Inference Gateway with the [agentgateway](https://agentgateway.dev/) data plane. Follow these steps
177177
to run Kgateway as an Inference Gateway:
178178

179-
1. Deploy the Inference Gateway
179+
1. Deploy the Inference Gateway:
180180

181181
```bash
182182
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/kgateway/gateway.yaml
@@ -187,13 +187,13 @@ kubectl apply -k https://github.com/kubernetes-sigs/gateway-api-inference-extens
187187
kubectl get gateway inference-gateway
188188
```
189189

190-
2. Deploy the HTTPRoute
190+
1. Deploy the HTTPRoute:
191191

192192
```bash
193193
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/kgateway/httproute.yaml
194194
```
195195

196-
3. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
196+
1. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
197197

198198
```bash
199199
kubectl get httproute llm-route -o yaml
@@ -216,7 +216,7 @@ Deploy the sample InferenceObjective which allows you to specify priority of req
216216
The following instructions assume you would like to cleanup ALL resources that were created in this quickstart guide.
217217
Please be careful not to delete resources you'd like to keep.
218218

219-
1. Uninstall the InferencePool, InferenceObjective and model server resources
219+
1. Uninstall the InferencePool, InferenceObjective and model server resources:
220220

221221
```bash
222222
helm uninstall vllm-llama3-8b-instruct
@@ -227,7 +227,7 @@ Deploy the sample InferenceObjective which allows you to specify priority of req
227227
kubectl delete secret hf-token --ignore-not-found
228228
```
229229

230-
1. Uninstall the Gateway API Inference Extension CRDs
230+
1. Uninstall the Gateway API Inference Extension CRDs:
231231

232232
```bash
233233
kubectl delete -k https://github.com/kubernetes-sigs/gateway-api-inference-extension/config/crd --ignore-not-found
@@ -252,13 +252,13 @@ Deploy the sample InferenceObjective which allows you to specify priority of req
252252

253253
The following steps assume you would like to clean up ALL Istio resources that were created in this quickstart guide.
254254

255-
1. Uninstall All Istio resources
255+
1. Uninstall All Istio resources:
256256

257257
```bash
258258
istioctl uninstall -y --purge
259259
```
260260

261-
2. Remove the Istio namespace
261+
1. Remove the Istio namespace:
262262

263263
```bash
264264
kubectl delete ns istio-system
@@ -273,19 +273,19 @@ Deploy the sample InferenceObjective which allows you to specify priority of req
273273

274274
The following steps assume you would like to cleanup ALL Kgateway resources that were created in this quickstart guide.
275275

276-
1. Uninstall Kgateway
276+
1. Uninstall Kgateway:
277277

278278
```bash
279279
helm uninstall kgateway -n kgateway-system
280280
```
281281

282-
2. Uninstall the Kgateway CRDs.
282+
1. Uninstall the Kgateway CRDs:
283283

284284
```bash
285285
helm uninstall kgateway-crds -n kgateway-system
286286
```
287287

288-
3. Remove the Kgateway namespace.
288+
1. Remove the Kgateway namespace:
289289

290290
```bash
291291
kubectl delete ns kgateway-system

‎site-src/guides/index.md‎

Lines changed: 19 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -52,7 +52,7 @@ kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extens
5252
1. Requirements
5353
- Gateway API [CRDs](https://gateway-api.sigs.k8s.io/guides/#installing-gateway-api) installed.
5454

55-
2. Install Istio
55+
1. Install Istio:
5656

5757
```
5858
TAG=$(curl https://storage.googleapis.com/istio-build/dev/1.28-dev)
@@ -75,14 +75,14 @@ kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extens
7575

7676
- Gateway API [CRDs](https://gateway-api.sigs.k8s.io/guides/#installing-gateway-api) installed.
7777

78-
2. Set the Kgateway version and install the Kgateway CRDs.
78+
1. Set the Kgateway version and install the Kgateway CRDs:
7979

8080
```bash
8181
KGTW_VERSION=v2.2.0-main
8282
helm upgrade -i --create-namespace --namespace kgateway-system --version $KGTW_VERSION kgateway-crds oci://cr.kgateway.dev/kgateway-dev/charts/kgateway-crds
8383
```
8484

85-
3. Install Kgateway
85+
1. Install Kgateway:
8686

8787
```bash
8888
helm upgrade -i --namespace kgateway-system --version $KGTW_VERSION kgateway oci://cr.kgateway.dev/kgateway-dev/charts/kgateway --set inferenceExtension.enabled=true
@@ -110,7 +110,7 @@ kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extens
110110
See [Deploy Inference Gateways](https://cloud.google.com/kubernetes-engine/docs/how-to/deploy-gke-inference-gateway)
111111
for detailed instructions.
112112

113-
2. Deploy the Inference Gateway:
113+
1. Deploy the Inference Gateway:
114114

115115
```bash
116116
kubectl apply -f https://raw.githubusercontent.com/kubernetes-sigs/gateway-api-inference-extension/refs/tags/v1.1.0/config/manifests/gateway/gke/gateway.yaml
@@ -123,13 +123,13 @@ kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extens
123123
NAME CLASS ADDRESS PROGRAMMED AGE
124124
inference-gateway inference-gateway <MY_ADDRESS> True 22s
125125
```
126-
3. Deploy the HTTPRoute
126+
1. Deploy the HTTPRoute:
127127

128128
```bash
129129
kubectl apply -f https://raw.githubusercontent.com/kubernetes-sigs/gateway-api-inference-extension/refs/tags/v1.1.0/config/manifests/gateway/gke/httproute.yaml
130130
```
131131

132-
4. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
132+
1. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
133133

134134
```bash
135135
kubectl get httproute llm-route -o yaml
@@ -140,7 +140,7 @@ kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extens
140140
Please note that this feature is currently in an experimental phase and is not intended for production use.
141141
The implementation and user experience are subject to changes as we continue to iterate on this project.
142142

143-
1. Deploy the Inference Gateway
143+
1. Deploy the Inference Gateway:
144144

145145
```bash
146146
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/istio/gateway.yaml
@@ -153,13 +153,13 @@ kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extens
153153
inference-gateway inference-gateway <MY_ADDRESS> True 22s
154154
```
155155

156-
2. Deploy the HTTPRoute
156+
1. Deploy the HTTPRoute:
157157

158158
```bash
159159
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/istio/httproute.yaml
160160
```
161161

162-
3. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
162+
1. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
163163

164164
```bash
165165
kubectl get httproute llm-route -o yaml
@@ -172,7 +172,7 @@ kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extens
172172
implementation. Kgateway supports Inference Gateway with the [agentgateway](https://agentgateway.dev/) data plane. Follow these steps
173173
to run Kgateway as an Inference Gateway:
174174

175-
1. Deploy the Inference Gateway
175+
1. Deploy the Inference Gateway:
176176

177177
```bash
178178
kubectl apply -f https://raw.githubusercontent.com/kubernetes-sigs/gateway-api-inference-extension/refs/tags/v1.1.0/config/manifests/gateway/agentgateway/gateway.yaml
@@ -183,13 +183,13 @@ kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extens
183183
kubectl get gateway inference-gateway
184184
```
185185

186-
2. Deploy the HTTPRoute
186+
1. Deploy the HTTPRoute:
187187

188188
```bash
189189
kubectl apply -f https://raw.githubusercontent.com/kubernetes-sigs/gateway-api-inference-extension/refs/tags/v1.1.0/config/manifests/gateway/agentgateway/httproute.yaml
190190
```
191191

192-
3. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
192+
1. Confirm that the HTTPRoute status conditions include `Accepted=True` and `ResolvedRefs=True`:
193193

194194
```bash
195195
kubectl get httproute llm-route -o yaml
@@ -212,7 +212,7 @@ Deploy the sample InferenceObjective which allows you to specify priority of req
212212
The following instructions assume you would like to cleanup ALL resources that were created in this quickstart guide.
213213
Please be careful not to delete resources you'd like to keep.
214214

215-
1. Uninstall the InferencePool, InferenceObjective and model server resources
215+
1. Uninstall the InferencePool, InferenceObjective and model server resources:
216216

217217
```bash
218218
helm uninstall vllm-llama3-8b-instruct
@@ -223,7 +223,7 @@ Deploy the sample InferenceObjective which allows you to specify priority of req
223223
kubectl delete secret hf-token --ignore-not-found
224224
```
225225

226-
1. Uninstall the Gateway API Inference Extension CRDs
226+
1. Uninstall the Gateway API Inference Extension CRDs:
227227

228228
```bash
229229
kubectl delete -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/releases/download/v1.1.0/manifests.yaml --ignore-not-found
@@ -249,13 +249,13 @@ Deploy the sample InferenceObjective which allows you to specify priority of req
249249

250250
The following steps assume you would like to clean up ALL Istio resources that were created in this quickstart guide.
251251

252-
1. Uninstall All Istio resources
252+
1. Uninstall All Istio resources:
253253

254254
```bash
255255
istioctl uninstall -y --purge
256256
```
257257

258-
2. Remove the Istio namespace
258+
1. Remove the Istio namespace:
259259

260260
```bash
261261
kubectl delete ns istio-system
@@ -270,19 +270,19 @@ Deploy the sample InferenceObjective which allows you to specify priority of req
270270

271271
The following steps assume you would like to cleanup ALL Kgateway resources that were created in this quickstart guide.
272272

273-
1. Uninstall Kgateway
273+
1. Uninstall Kgateway:
274274

275275
```bash
276276
helm uninstall kgateway -n kgateway-system
277277
```
278278

279-
2. Uninstall the Kgateway CRDs.
279+
1. Uninstall the Kgateway CRDs:
280280

281281
```bash
282282
helm uninstall kgateway-crds -n kgateway-system
283283
```
284284

285-
3. Remove the Kgateway namespace.
285+
1. Remove the Kgateway namespace:
286286

287287
```bash
288288
kubectl delete ns kgateway-system

0 commit comments

Comments
 (0)