Skip to content

Add arcee model #21296

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 11 commits into from
Jul 22, 2025
Merged

Add arcee model #21296

Show file tree
Hide file tree
Changes from 8 commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
2823d64
Add Arcee (AFM) model support to vLLM
alyosha-swamy Jul 20, 2025
3a047a6
Update arcee.py with code review improvements and syntax fix
alyosha-swamy Jul 20, 2025
0f5be4b
Fix linting issues: line length E501 errors
alyosha-swamy Jul 20, 2025
ac8b421
Fix linting issues: line length E501 errors
alyosha-swamy Jul 20, 2025
d81a460
Address review comments: remove supported_lora_modules and update com…
alyosha-swamy Jul 21, 2025
cb931bd
- Inherit from LlamaForCausalLM for most functionality
alyosha-swamy Jul 21, 2025
9a3c1c1
Add Arcee model support with ReLU^2 activation
alyosha-swamy Jul 21, 2025
942b6af
Set is_available_online=False for ArceeForCausalLM in test registry
alyosha-swamy Jul 21, 2025
42c9084
Improve Arcee model implementation
alyosha-swamy Jul 21, 2025
ca686bc
Fix FMT
jeejeelee Jul 21, 2025
238dba5
Fix dot
jeejeelee Jul 21, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions docs/models/supported_models.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -317,6 +317,7 @@ Specified using `--task generate`.
| Architecture | Models | Example HF Models | [LoRA](../features/lora.md) | [PP](../serving/distributed_serving.md) | [V1](gh-issue:8779) |
|--------------|--------|-------------------|----------------------|---------------------------|---------------------|
| `AquilaForCausalLM` | Aquila, Aquila2 | `BAAI/Aquila-7B`, `BAAI/AquilaChat-7B`, etc. | ✅︎ | ✅︎ | ✅︎ |
| `ArceeForCausalLM` | Arcee (AFM) | `arcee-ai/AFM-4.5B-Base`, etc. | ✅︎ | ✅︎ | ✅︎ |
| `ArcticForCausalLM` | Arctic | `Snowflake/snowflake-arctic-base`, `Snowflake/snowflake-arctic-instruct`, etc. | | ✅︎ | ✅︎ |
| `BaiChuanForCausalLM` | Baichuan2, Baichuan | `baichuan-inc/Baichuan2-13B-Chat`, `baichuan-inc/Baichuan-7B`, etc. | ✅︎ | ✅︎ | ✅︎ |
| `BailingMoeForCausalLM` | Ling | `inclusionAI/Ling-lite-1.5`, `inclusionAI/Ling-plus`, etc. | ✅︎ | ✅︎ | ✅︎ |
Expand Down
1 change: 1 addition & 0 deletions tests/models/registry.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -135,6 +135,7 @@
trust_remote_code=True),
"AquilaForCausalLM": _HfExamplesInfo("BAAI/AquilaChat2-7B",
trust_remote_code=True),
"ArceeForCausalLM": _HfExamplesInfo("arcee-ai/AFM-4.5B-Base", is_available_online=False),

Check failure on line 138 in tests/models/registry.py

View workflow job for this annotation

GitHub Actions / pre-commit

Ruff (E501) 

tests/models/registry.py:138:81: E501 Line too long (93 > 80)
"ArcticForCausalLM": _HfExamplesInfo("Snowflake/snowflake-arctic-instruct",
trust_remote_code=True),
"BaiChuanForCausalLM": _HfExamplesInfo("baichuan-inc/Baichuan-7B",
Expand Down
Loading