File tree Expand file tree Collapse file tree 2 files changed +814
-242
lines changed Expand file tree Collapse file tree 2 files changed +814
-242
lines changed Original file line number Diff line number Diff line change @@ -52,6 +52,69 @@ Machine Learning Compilation for Large Language Models (MLC LLM) is a high-perfo
52
52
</tbody >
53
53
</table >
54
54
55
+ ** Prebuilt model support.** MLC LLM supports a wide range of model architectures and variants. We have the following prebuilts which you can
56
+ use off-the-shelf. Visit [ Prebuilt Models] ( https://llm.mlc.ai/docs/prebuilt_models.html ) to see the full list.
57
+
58
+ <table style =" width :100% " >
59
+ <thead >
60
+ <tr>
61
+ <th style="width:40%">Supported Model Architecture</th>
62
+ <th style="width:60%">Model Variants with Prebuilts</th>
63
+ </tr>
64
+ </thead >
65
+ <tbody >
66
+ <tr>
67
+ <td rowspan=8>Llama</td>
68
+ <td>Llama-2</td>
69
+ </tr>
70
+ <tr>
71
+ <td>Code Llama</td>
72
+ </tr>
73
+ <tr>
74
+ <td>Vicuna</td>
75
+ </tr>
76
+ <tr>
77
+ <td>WizardLM</td>
78
+ </tr>
79
+ <tr>
80
+ <td>WizardMath</td>
81
+ </tr>
82
+ <tr>
83
+ <td>OpenOrca Platypus2</td>
84
+ </tr>
85
+ <tr>
86
+ <td>FlagAlpha Llama-2 Chinese</td>
87
+ </tr>
88
+ <tr>
89
+ <td>georgesung Llama-2 Uncensored</td>
90
+ </tr>
91
+ <tr>
92
+ <td>GPT-NeoX</td>
93
+ <td>RedPajama</td>
94
+ </tr>
95
+ <tr>
96
+ <td>GPT-J</td>
97
+ <td></td>
98
+ </tr>
99
+ <tr>
100
+ <td>RWKV</td>
101
+ <td>RWKV-raven</td>
102
+ </tr>
103
+ <tr>
104
+ <td>MiniGPT</td>
105
+ <td></td>
106
+ </tr>
107
+ <tr>
108
+ <td>GPTBigCode</td>
109
+ <td>WizardCoder</td>
110
+ </tr>
111
+ <tr>
112
+ <td>ChatGLM</td>
113
+ <td></td>
114
+ </tr>
115
+ </tbody >
116
+ </table >
117
+
55
118
## News
56
119
57
120
* [ 08/25/2023] CodeLlama support is up.
You can’t perform that action at this time.
0 commit comments