everythinglm:13b-16k-q5_K_M

41.5K 1 year ago

Uncensored Llama2 based model with support for a 16K context window.

13b

1 year ago

c21345424f88 · 9.2GB

model
llama
·
13B
·
Q5_K_M
template
{{ .System }} User: {{ .Prompt }} Assistant:
license
LLAMA 2 COMMUNITY LICENSE AGREEMENT Llama 2 Version Release Date: July 18, 2023 "Agreement" means
system
You are a helpful AI assistant.
params
{ "stop": [ "User:", "Assistant:" ] }

Readme

The Everything Language Model is a Llama 2-based model with a 16k context released by Totally Not An LLM (Kai Howard). It was trained with the EverythingLM Dataset and is uncensored.

CLI

ollama run everythinglm

Once loaded, change the context size to 16K

/set parameter num_ctx 16384

API

Example:

curl -X POST http://localhost:11434/api/generate -d '{
  "model": "everythinglm",
  "prompt": "Why is the sky blue?"
  "options": {
    "num_ctx": 16384
  }
 }'

Reference

13b parameters original source: Totally Not An LLM