include llama.cpp since there were some edits
This commit is contained in:
1 parent
db7f28d087
commit
8c66990853
3918 files changed
+1640170
-1
No files matched your search
@@ -0,0 +1,26 @@
|
||||
# Fusion baselines
|
||||
|
||||
Per-device baselines for `test-fusion`, one CSV per backend (e.g. `MTL.csv`). Rows are
|
||||
`arch,moe,mode,label,count`. Regenerate a CSV whenever fusion patterns change.
|
||||
|
||||
## Update a baseline
|
||||
|
||||
```sh
|
||||
cmake -B build -DCMAKE_BUILD_TYPE=Release -DGGML_METAL=ON # enable the target backend
|
||||
cmake --build build --config Release --target test-llama-archs --target test-fusion -j
|
||||
|
||||
rm -rf build-ci-models && mkdir -p build-ci-models
|
||||
./build/bin/test-llama-archs -o build-ci-models
|
||||
|
||||
./build/bin/test-fusion --models build-ci-models --device MTL0 --record MTL.csv
|
||||
```
|
||||
|
||||
## Validate
|
||||
|
||||
```sh
|
||||
./build/bin/test-fusion --models build-ci-models --device MTL0 --check MTL.csv
|
||||
```
|
||||
|
||||
Non-zero exit means a row differs from the baseline. Use `--model FILE` to run a single
|
||||
architecture. `--check` also reports baseline rows that the run no longer produces, so a fusion
|
||||
that stops matching fails the run instead of silently dropping out of the CSV.
|
||||
Reference in new issue
Block a user