Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Is BNB quantization supported?
Added on February 24, 2025 10:26AM
Likes: 0
Replies: 0
MichaelKarpe
Registered Posts: 4 ✭✭
BNB quantization is not mentionned in Running Hugging Face models — Dataiku DSS 13 documentation.
For instance unsloth/Llama-3.3-70B-Instruct-bnb-4bit · Hugging Face.
What 4-bit quantized model do you recommand for Llama 3.3 otherwise?