23 lines
700 B
Plaintext
23 lines
700 B
Plaintext
Convert-to-Quant (ctq) is installed for normal quantizations.
|
|
|
|
For GGUF quantizations, try:
|
|
|
|
hf_to_nvfp4_quant
|
|
gguf_to_nvfp4_quant
|
|
safetensors_to_nvfp4_quant
|
|
hf_to_nvfp4_safetensors
|
|
|
|
Depending on the source material.
|
|
|
|
hf cli command is also installed, eg you can:
|
|
|
|
|
|
hf download coder3101/gemma-4-12B-it-heretic --local-dir gemma-4-12B-it-heretic
|
|
hf_to_nvfp4_gguf -o gemma-4-12B-it-heretic_nvfp4 gemma-4-12B-it-heretic
|
|
|
|
The same directory can be quantized to one ComfyUI NVFP4 safetensors file:
|
|
|
|
hf_to_nvfp4_safetensors -o gemma-4-12B-it-heretic-NVFP4.safetensors gemma-4-12B-it-heretic
|
|
|
|
This would create a NVFP4 GGUF for Ollama/llama.cpp from https://huggingface.co/coder3101/gemma-4-12B-it-heretic
|