vicuna:13b-v1.5-16k-q5_K_M

183.3K 1 year ago

General use chat model based on Llama and Llama 2 with 2K to 16K context sizes.

7b 13b 33b

1 year ago

3374b3e9b520 · 9.2GB

model
llama
·
13B
·
Q5_K_M
system
A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful,
template
{{ .System }} USER: {{ .Prompt }} ASSISTANT:
params
{ "num_ctx": 16384, "rope_frequency_scale": 0.125, "stop": [ "USER:", "A

Readme

Vicuna is a chat assistant model. It includes 3 different variants in 3 different sizes. v1.3 is trained by fine-tuning Llama and has a context size of 2048 tokens. v1.5 is trained by fine-tuning Llama 2 and has a context size of 2048 tokens. v1.5-16k is trained by fine-tuning Llama 2 and has a context size of 16k tokens. All three variants are trained using conversations collected from ShareGPT.

Example prompts

What is the meaning of life? Explain it in 5 paragraphs.

References

HuggingFace