Skip to content

Commit a8ce3b5

Browse files
committed
chore: Remove unnecessary files and code related to live_bench and sft_eval tasks
1 parent 6ea976e commit a8ce3b5

File tree

82 files changed

+2
-3027
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

82 files changed

+2
-3027
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -122,7 +122,7 @@ accelerate launch --num_processes=8 -m lmms_eval --model llava --model_args pr
122122
accelerate launch --num_processes=8 -m lmms_eval --model llava --model_args pretrained="liuhaotian/llava-v1.6-34b,conv_template=mistral_direct" --tasks mme,mmbench_en --batch_size 1 --log_samples --log_samples_suffix llava_v1.5_mme_mmbenchen --output_path ./logs/ #
123123

124124
# From a predefined configuration, supporting evaluation of multiple models and datasets
125-
accelerate launch --num_processes=8 -m lmms_eval --config example_eval.yaml
125+
accelerate launch --num_processes=8 -m lmms_eval --config ./miscs/example_eval.yaml
126126
```
127127

128128
# Model Results

lmms_eval/models/__init__.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@
2626
"reka": "Reka",
2727
"llava_onevision": "Llava_OneVision",
2828
"from_log": "FromLog",
29-
"mplugOwlVideo": "mplug_Owl",
29+
"mplug_owl_video": "mplug_Owl",
3030
}
3131

3232
for model_name, model_class in AVAILABLE_MODELS.items():

lmms_eval/models/gemini_model.py

Lines changed: 0 additions & 163 deletions
This file was deleted.

0 commit comments

Comments
 (0)