27 lines
942 B
Markdown
27 lines
942 B
Markdown
# Fusion baselines
|
|
|
|
Per-device baselines for `test-fusion`, one CSV per backend (e.g. `MTL.csv`). Rows are
|
|
`arch,moe,mode,label,count`. Regenerate a CSV whenever fusion patterns change.
|
|
|
|
## Update a baseline
|
|
|
|
```sh
|
|
cmake -B build -DCMAKE_BUILD_TYPE=Release -DGGML_METAL=ON # enable the target backend
|
|
cmake --build build --config Release --target test-llama-archs --target test-fusion -j
|
|
|
|
rm -rf build-ci-models && mkdir -p build-ci-models
|
|
./build/bin/test-llama-archs -o build-ci-models
|
|
|
|
./build/bin/test-fusion --models build-ci-models --device MTL0 --record MTL.csv
|
|
```
|
|
|
|
## Validate
|
|
|
|
```sh
|
|
./build/bin/test-fusion --models build-ci-models --device MTL0 --check MTL.csv
|
|
```
|
|
|
|
Non-zero exit means a row differs from the baseline. Use `--model FILE` to run a single
|
|
architecture. `--check` also reports baseline rows that the run no longer produces, so a fusion
|
|
that stops matching fails the run instead of silently dropping out of the CSV.
|