zefie/nvfp4_gguf_quant
1
0 Fork 0
Code Actions Activity

update readme

Browse Source
This commit is contained in:
zefie committed 2026-11-04 16:53:35 -05:00
1 parent be97590146
commit cef832ecb0
1 file changed
+6 -3
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+6 -3
View File
@@ -1,7 +1,8 @@
Convert-to-Quant (`ctq`) is installed for normal quantizations. These scripts require [llama.cpp](https://github.com/ggml-org/llama.cpp) and [Convert-to-Quant](https://github.com/silveroxides/convert_to_quant).
`hf`, the Hugging Face CLI command, and llama.cpp's compiled binaries are also available.
For GGUF quantizations, try: `hf`, the Hugging Face CLI command is also suggested, but not required.
For quantizations or conversions, try:
- `hf_to_nvfp4_quant` (huggingface structure to GGUF) - `hf_to_nvfp4_quant` (huggingface structure to GGUF)
- `gguf_to_nvfp4_quant` (GGUF to GGUF) - `gguf_to_nvfp4_quant` (GGUF to GGUF)
- `safetensors_to_nvfp4_quant` (ComfyUI style safetensors to GGUF (untested)) - `safetensors_to_nvfp4_quant` (ComfyUI style safetensors to GGUF (untested))
@@ -26,3 +27,5 @@ The same directory can be quantized to one ComfyUI NVFP4 safetensors file:
`hf_to_nvfp4_safetensors -o gemma-4-12B-it-heretic-NVFP4.safetensors gemma-4-12B-it-heretic` `hf_to_nvfp4_safetensors -o gemma-4-12B-it-heretic-NVFP4.safetensors gemma-4-12B-it-heretic`
Conversions between formats without quantization is available in the custom commands with `--no-quant`. Conversions between formats without quantization is available in the custom commands with `--no-quant`.
Currently the only supported modes are "Quantize to NVFP4" or "Copy without quantizing" (`--no-quant`). I may add other quantization options in the future.