Skip to content

Commit fb8c6eb

Browse files
authored
cleaner rope_dim assignment
1 parent c5c1d71 commit fb8c6eb

File tree

1 file changed

+1
-4
lines changed

1 file changed

+1
-4
lines changed

convert_hf_to_gguf.py

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -5146,10 +5146,7 @@ def set_vocab(self):
51465146
def set_gguf_parameters(self):
51475147
super().set_gguf_parameters()
51485148
hparams = self.hparams
5149-
if hparams.get("head_dim"):
5150-
rope_dim = hparams["head_dim"]
5151-
else:
5152-
rope_dim = hparams["hidden_size"] // hparams["num_attention_heads"]
5149+
rope_dim = hparams.get("head_dim") or hparams["hidden_size"] // hparams["num_attention_heads"]
51535150

51545151
self.gguf_writer.add_rope_dimension_count(rope_dim)
51555152
self.gguf_writer.add_rope_scaling_type(gguf.RopeScalingType.NONE)

0 commit comments

Comments
 (0)