Skip to content

Commit 0cadcc0

Browse files
committed
Fix support to read EPP plugin config to be read from yaml
1 parent a3f25c0 commit 0cadcc0

File tree

2 files changed

+4
-0
lines changed

2 files changed

+4
-0
lines changed

config/charts/inferencepool/README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -124,6 +124,7 @@ The following table list the configurable parameters of the chart.
124124
| `inferenceExtension.extraServicePorts` | List of additional service ports to expose. Defaults to `[]`. |
125125
| `inferenceExtension.flags` | List of flags which are passed through to endpoint picker. Example flags, enable-pprof, grpc-port etc. Refer [runner.go](https://github.com/kubernetes-sigs/gateway-api-inference-extension/blob/main/cmd/epp/runner/runner.go) for complete list. |
126126
| `inferenceExtension.flags.has-enable-leader-election` | Enable leader election for high availability. When enabled, only one EPP pod (the leader) will be ready to serve traffic. |
127+
| `inferenceExtension.pluginsConfigFile` | Path to custom EPP plugin file |
127128
| `provider.name` | Name of the Inference Gateway implementation being used. Possible values: `gke`. Defaults to `none`. |
128129

129130
## Notes

config/charts/inferencepool/templates/epp-config.yaml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -20,4 +20,7 @@ data:
2020
{{- if (hasKey .Values.inferenceExtension "pluginsCustomConfig") }}
2121
{{- .Values.inferenceExtension.pluginsCustomConfig | toYaml | nindent 2 }}
2222
{{- end }}
23+
{{- if (hasKey .Values.inferenceExtension "pluginsConfigFile")}}
24+
{{- .Files.Get (printf "%s" .Values.inferenceExtension.pluginsConfigFile) | indent 4}}
25+
{{- end}}
2326

0 commit comments

Comments
 (0)