manfiles and new scripts

man/man1/ollama_nvfp4.1

@@ -0,0 +1,181 @@
+.TH OLLAMA_NVFP4 1 "November 2026" "nvfp4_gguf_quant" "User Commands"
+.SH NAME
+ollama_nvfp4 \- inspect Ollama sha256 model stores and quantize models to NVFP4 GGUF
+.SH SYNOPSIS
+.B ollama_nvfp4
+[\fB\-\-models\fR \fIDIR\fR]
+.I subcommand
+[\fIoptions...\fR]
+.br
+.B ollama_nvfp4
+[\fB\-\-models\fR \fIDIR\fR]
+.B \-\-info
+\fImodel\fR
+[\fIgguf_info_args...\fR]
+.SH DESCRIPTION
+.B ollama_nvfp4
+is a management and quantization utility for local \fBOllama\fR model installations.
+Ollama stores model artifacts as content-addressed blobs (\fIblobs/sha256-<digest>\fR)
+referenced by JSON manifests (\fImanifests/\fR).
+.PP
+.B ollama_nvfp4
+resolves these hashes into human-readable model names, displays model capabilities and
+parameters, exports native GGUF weights alongside reconstructed \fBModelfile\fRs,
+and directly quantizes models to NVIDIA FP4 (NVFP4) format. Quantized models can
+optionally be registered straight back into Ollama's local library.
+.PP
+The generated \fBModelfile\fR preserves the original prompt template, stop sequences,
+system message, renderer, and parser settings so that thinking/reasoning modes and
+generation behavior remain intact.
+.SH GLOBAL OPTIONS
+.TP
+.BI \-\-models " " DIR
+Path to the Ollama models store directory containing \fIblobs/\fR and \fImanifests/\fR.
+If not provided, the location is resolved via the \fBOLLAMA_MODELS\fR environment variable,
+\fI/models/ollama\fR, or \fI~/.ollama/models\fR.
+.TP
+.BR \-h ", " \-\-help
+Show command help and exit.
+.SH SUBCOMMANDS
+.SS list
+.B ollama_nvfp4
+[\fB\-\-models\fR \fIDIR\fR]
+.B list
+[\fB\-\-full\-scan\fR]
+[\fB\-\-ctx\-scan\fR]
+.PP
+Display every manifest in the store as a readable model entry with family, quantization type,
+and capability badges (chat, tool call, thinking, vision).
+.TP
+.B \-\-full\-scan
+Read the underlying GGUF header of each model blob. This is slower on large stores but reveals
+capabilities and vision encoders not declared in manifest metadata.
+.TP
+.B \-\-ctx\-scan
+Scan parameter blobs and report models whose Modelfile explicitly configures \fInum_ctx\fR.
+.SS show
+.B ollama_nvfp4
+[\fB\-\-models\fR \fIDIR\fR]
+.B show
+\fImodel\fR
+.PP
+Display detailed information for a specified model, including manifest layers, sha256 blob
+hashes, component media types, GGUF architecture metadata, context length, and system settings.
+The \fImodel\fR argument can be a full name (e.g. \fIllama3.2:latest\fR) or a unique substring.
+.SS export
+.B ollama_nvfp4
+[\fB\-\-models\fR \fIDIR\fR]
+.B export
+[\fB\-o\fR \fIDIR\fR]
+[\fB\-\-modelfile\-only\fR]
+[\fB\-\-overwrite\fR|\fB\-\-force\fR]
+\fImodel\fR
+.PP
+Export the model's underlying GGUF weight blob and generate a fully configured \fBModelfile\fR
+into the destination directory (default: \fI./<model>\fR).
+.TP
+.BI \-o " " DIR ", " \-\-output " " DIR
+Output directory path.
+.TP
+.B \-\-modelfile\-only
+Write only the Modelfile without copying the GGUF or vision projector blobs.
+.TP
+.BR \-\-overwrite ", " \-\-force
+Replace existing files in the output directory.
+.SS quant
+.B ollama_nvfp4
+[\fB\-\-models\fR \fIDIR\fR]
+.B quant
+[\fB\-o\fR \fIDIR\fR]
+[\fB\-\-name\fR \fINAME\fR]
+[\fB\-\-install\fR]
+[\fB\-\-float\-only\fR]
+[\fB\-\-context\-length\fR \fILEN\fR]
+[\fIquant_opts...\fR]
+\fImodel\fR
+.PP
+Quantize an Ollama model to NVFP4 GGUF format and generate an accompanying Modelfile.
+.TP
+.BI \-o " " DIR ", " \-\-output " " DIR
+Output directory (default: \fI./<model>-NVFP4\fR).
+.TP
+.BI \-\-name " " NAME
+Model tag used when registering with \fB\-\-install\fR (default: \fI<model>:nvfp4\fR).
+.TP
+.B \-\-install
+Automatically register the quantized model back into Ollama using \fIollama create\fR.
+.TP
+.B \-\-float\-only
+Refuse to requantize a model if its source blob is already quantized (e.g. \fIQ4_K_M\fR).
+Quantizing from float16/BF16 produces superior NVFP4 fidelity.
+.TP
+.BI \-\-context\-length " " LEN
+Override maximum context length stored in the GGUF.
+.TP
+.I quant_opts
+All standard learned-rounding and execution options supported by \fBgguf_to_nvfp4_gguf\fR
+are supported: \fB\-\-simple\fR, \fB\-\-optimizer\fR, \fB\-\-lr\fR, \fB\-\-num\-iter\fR,
+\fB\-\-scale\-optimization\fR, \fB\-\-device\fR, \fB\-\-checkpoint\-dir\fR, etc.
+.SS \-\-info
+.B ollama_nvfp4
+[\fB\-\-models\fR \fIDIR\fR]
+.B \-\-info
+\fImodel\fR
+[\fIgguf_info_args...\fR]
+.PP
+Resolve \fImodel\fR to its sha256 GGUF weight blob in the store and invoke
+.BR gguf_info (1)
+directly on the file. Any subsequent flags (such as \fB\-\-metadata\fR or \fB\-\-tensors\fR)
+are forwarded directly to \fBgguf_info\fR.
+.SH ENVIRONMENT VARIABLES
+.TP
+.B OLLAMA_MODELS
+Path to the default Ollama models directory. Overridden by \fB\-\-models\fR.
+.SH EXAMPLES
+.TP
+.B List installed models with capability summary:
+.RS
+.nf
+ollama_nvfp4 list
+.fi
+.RE
+.TP
+.B Inspect detailed manifest and parameters of a model:
+.RS
+.nf
+ollama_nvfp4 show llama3.2:3b
+.fi
+.RE
+.TP
+.B Run gguf_info on an Ollama model's weight blob:
+.RS
+.nf
+ollama_nvfp4 --info llama3.2:3b --metadata
+.fi
+.RE
+.TP
+.B Export a model and its Modelfile:
+.RS
+.nf
+ollama_nvfp4 export llama3.2:3b -o ./llama3-export
+.fi
+.RE
+.TP
+.B Quantize an Ollama FP16 model to NVFP4 and install it:
+.RS
+.nf
+ollama_nvfp4 quant --install llama3.2:3b-instruct-fp16
+.fi
+.RE
+.SH EXIT STATUS
+.TP
+.B 0
+Success.
+.TP
+.B 1
+An error occurred (e.g. model not found, invalid store directory, or quantization failure).
+.SH SEE ALSO
+.BR gguf_info (1),
+.BR gguf_to_nvfp4_gguf (1),
+.BR hf_to_nvfp4_gguf (1)
+