dbrx:latest

19.4K 1 year ago

DBRX is an open, general-purpose LLM created by Databricks.

132b

1 year ago

36800d8d3a28 · 74GB

model
dbrx
·
132B
·
Q4_0
license
Databricks Open Model License By using, reproducing, modifying, distributing, performing or display
system
You are DBRX, created by Databricks. You were last updated in December 2023. You answer questions ba
params
{ "stop": [ "<|im_start|>", "<|im_end|>" ] }
template
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user

Readme

DBRX requires Ollama 0.1.32

DBRX is a transformer-based decoder-only large language model (LLM) that was trained using next-token prediction. It uses a fine-grained mixture-of-experts (MoE) architecture with 132B total parameters of which 36B parameters are active on any input. It was pre-trained on 12T tokens of text and code data.

It is an especially capable code model, surpassing specialized models like CodeLLaMA-70B on programming, in addition to its strength as a general-purpose LLM.

References

Blog Post

HuggingFace