fix/improve hf to hf conversions
This commit is contained in:
1 parent
cef832ecb0
commit
416b0e630f
12 files changed
+1885
-17
No files matched your search
+15
-7
@@ -1,11 +1,13 @@
|
||||
Convert-to-Quant (ctq) is installed for normal quantizations.
|
||||
|
||||
For GGUF quantizations, try:
|
||||
For quantizations and conversions, try:
|
||||
|
||||
hf_to_nvfp4_quant
|
||||
gguf_to_nvfp4_quant
|
||||
safetensors_to_nvfp4_quant
|
||||
hf_to_nvfp4_safetensors
|
||||
- hf_to_nvfp4_gguf (Hugging Face to GGUF)
|
||||
- gguf_to_nvfp4_gguf (GGUF to GGUF)
|
||||
- safetensors_to_nvfp4_gguf (ComfyUI safetensors to GGUF)
|
||||
- hf_to_nvfp4_safetensors (Hugging Face to ComfyUI safetensors)
|
||||
- hf_to_nvfp4_hf (Hugging Face to NVFP4 Hugging Face)
|
||||
- gguf_to_nvfp4_hf (GGUF to NVFP4 Hugging Face)
|
||||
|
||||
Depending on the source material.
|
||||
|
||||
@@ -15,8 +17,14 @@ hf cli command is also installed, eg you can:
|
||||
hf download coder3101/gemma-4-12B-it-heretic --local-dir gemma-4-12B-it-heretic
|
||||
hf_to_nvfp4_gguf -o gemma-4-12B-it-heretic_nvfp4 gemma-4-12B-it-heretic
|
||||
|
||||
The same directory can be quantized to one ComfyUI NVFP4 safetensors file:
|
||||
The same directory can be quantized to NVFP4 Hugging Face format:
|
||||
|
||||
hf_to_nvfp4_hf -o gemma-4-12B-it-heretic-NVFP4-HF gemma-4-12B-it-heretic
|
||||
|
||||
Or to one ComfyUI NVFP4 safetensors file:
|
||||
|
||||
hf_to_nvfp4_safetensors -o gemma-4-12B-it-heretic-NVFP4.safetensors gemma-4-12B-it-heretic
|
||||
|
||||
This would create a NVFP4 GGUF for Ollama/llama.cpp from https://huggingface.co/coder3101/gemma-4-12B-it-heretic
|
||||
A GGUF file can also be converted to NVFP4 Hugging Face format:
|
||||
|
||||
gguf_to_nvfp4_hf -o gemma-4-12B-it-heretic-NVFP4-HF gemma-4-12B-it-heretic.gguf
|
||||
Executable
+3
@@ -0,0 +1,3 @@
|
||||
#!/bin/bash
|
||||
python /opt/nvfp4/nvfp4_gguf_quant/gguf_to_nvfp4_hf.py --llama-cpp /opt/nvfp4/llama.cpp --convert-to-quant /opt/nvfp4/convert_to_quant "${@}"
|
||||
|
||||
Executable
+3
@@ -0,0 +1,3 @@
|
||||
#!/bin/bash
|
||||
python /opt/nvfp4/nvfp4_gguf_quant/hf_to_nvfp4_hf.py --llama-cpp /opt/nvfp4/llama.cpp --convert-to-quant /opt/nvfp4/convert_to_quant "${@}"
|
||||
|
||||
Reference in new issue
Block a user