Skip to content

Commit de835a2

Browse files
committed
compatible for chatglm
1 parent 57c9fa2 commit de835a2

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

mlc_llm/core.py

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -627,6 +627,12 @@ def build_model_from_args(args: argparse.Namespace):
627627
temperature=1.2,
628628
repetition_penalty=0.996,
629629
)
630+
elif args.model_category == "chatglm":
631+
dump_mlc_chat_config(
632+
args,
633+
vocab_size=config["padded_vocab_size"],
634+
max_window_size=model_config.max_sequence_length,
635+
)
630636
else:
631637
dump_mlc_chat_config(
632638
args,

0 commit comments

Comments
 (0)