lawr/qwen2:0.5b-instruct-q5-k-m-demo

Index digest

sha256:abeff769630c3172241df9e839b244c48af2a0f33a481779686d3457069bf9e2

OS/ARCH

linux/arm64

Compressed size

388.25 MB

Last pushed

about 2 years by lawr

Type

Image

Manifest digest

sha256:dbfce8f4e489bbb40cccb0735896a31610d1ccbfa57542a9fb5e98310b9dbfce

Image Layers

1LABEL gguf.model.from=Hugging Face0 B

2QUANTIZE --type=Q5_K_M Qwen2-0.5B-Instruct.F16.gguf Qwen2-0.5B-Instruct.Q5_K_M.gguf #388.25 MB

3CAT <<EOF system-prompt.txt # buildkit587 B

4CMD ["-m" "Qwen2-0.5B-Instruct.Q5_K_M.gguf" "-c" "8192"0 B

Command

LABEL gguf.model.from=Hugging Face