Skip to content

Commit 6c57bc8

Browse files
authored
Qwen3 doc and config tweaks (#10640)
1 parent 910b7a8 commit 6c57bc8

File tree

2 files changed

+4
-1
lines changed

2 files changed

+4
-1
lines changed

examples/models/qwen3/4b_config.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,5 +13,5 @@
1313
"use_hf_rope": true,
1414
"attention_qkv_bias": false,
1515
"use_qk_norm": true,
16-
"qk_norm_before_repo": true
16+
"qk_norm_before_rope": true
1717
}

examples/models/qwen3/README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -25,6 +25,7 @@ python -m examples.models.llama.export_llama \
2525
-X \
2626
--xnnpack-extended-ops \
2727
-qmode 8da4w \
28+
--metadata '{"get_bos_id": 151644, "get_eos_ids":[151645]}' \
2829
--output_name="qwen3-0_6b.pte" \
2930
--verbose
3031
```
@@ -40,6 +41,7 @@ python -m examples.models.llama.export_llama \
4041
-X \
4142
--xnnpack-extended-ops \
4243
-qmode 8da4w \
44+
--metadata '{"get_bos_id": 151644, "get_eos_ids":[151645]}' \
4345
--output_name="qwen3-1_7b.pte" \
4446
--verbose
4547
```
@@ -55,6 +57,7 @@ python -m examples.models.llama.export_llama \
5557
-X \
5658
--xnnpack-extended-ops \
5759
-qmode 8da4w \
60+
--metadata '{"get_bos_id": 151644, "get_eos_ids":[151645]}' \
5861
--output_name="qwen3-4b.pte" \
5962
--verbose
6063
```

0 commit comments

Comments
 (0)