Skip to content
This repository was archived by the owner on Jun 5, 2025. It is now read-only.

Commit 907233c

Browse files
rdimitrovlukehinds
authored andcommitted
Update the _chat integration tests to be more deterministic (#861)
1 parent 2a25170 commit 907233c

File tree

1 file changed

+12
-12
lines changed

1 file changed

+12
-12
lines changed

tests/integration/testcases.yaml

Lines changed: 12 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -21,15 +21,15 @@ testcases:
2121
{
2222
"messages":[
2323
{
24-
"content":"Hello",
24+
"content":"Reply with that exact sentence: Hello from the integration tests!",
2525
"role":"user"
2626
}
2727
],
2828
"model":"gpt-4o",
2929
"stream":true
3030
}
3131
likes: |
32-
Hello! How can I assist you today?
32+
Hello from the integration tests!
3333
3434
copilot_malicious_package_question:
3535
name: Copilot User asks about a malicious package
@@ -64,7 +64,7 @@ testcases:
6464
"role":"system"
6565
},
6666
{
67-
"content":"Hello",
67+
"content":"Reply with that exact sentence: Hello from the integration tests!",
6868
"role":"user"
6969
}
7070
],
@@ -73,7 +73,7 @@ testcases:
7373
"temperature":0
7474
}
7575
likes: |
76-
Hello! How can I assist you today?
76+
Hello from the integration tests!
7777
7878
llamacpp_fim:
7979
name: LlamaCPP FIM
@@ -107,7 +107,7 @@ testcases:
107107
"role":"system"
108108
},
109109
{
110-
"content":"Hello",
110+
"content":"Reply with that exact sentence: Hello from the integration tests!",
111111
"role":"user"
112112
}
113113
],
@@ -116,7 +116,7 @@ testcases:
116116
"temperature":0
117117
}
118118
likes: |
119-
Hello! How can I assist you today?
119+
Hello from the integration tests!
120120
121121
openai_fim:
122122
name: OpenAI FIM
@@ -157,7 +157,7 @@ testcases:
157157
"role":"system"
158158
},
159159
{
160-
"content":"Hello",
160+
"content":"Reply with that exact sentence: Hello from the integration tests!",
161161
"role":"user"
162162
}
163163
],
@@ -166,7 +166,7 @@ testcases:
166166
"temperature":0
167167
}
168168
likes: |
169-
Hello! How can I assist you today?
169+
Hello from the integration tests!
170170
171171
vllm_fim:
172172
name: VLLM FIM
@@ -217,7 +217,7 @@ testcases:
217217
"role":"system"
218218
},
219219
{
220-
"content":"Hello",
220+
"content":"Reply with that exact sentence: Hello from the integration tests!",
221221
"role":"user"
222222
}
223223
],
@@ -226,7 +226,7 @@ testcases:
226226
"temperature":0
227227
}
228228
likes: |
229-
Hello! How can I assist you today?
229+
Hello from the integration tests!
230230
231231
anthropic_fim:
232232
name: Anthropic FIM
@@ -280,7 +280,7 @@ testcases:
280280
"role":"system"
281281
},
282282
{
283-
"content":"Hello",
283+
"content":"Reply with that exact sentence: Hello from the integration tests!",
284284
"role":"user"
285285
}
286286
],
@@ -289,7 +289,7 @@ testcases:
289289
"temperature":0
290290
}
291291
likes: |
292-
Hello! How can I assist you today?
292+
Hello from the integration tests!
293293
294294
ollama_fim:
295295
name: Ollama FIM

0 commit comments

Comments
 (0)