my-homelab-configs/infra/model-observatory
juvdiaz f49b8b9673 Add model behavior observatory 2026-06-30 13:24:54 -06:00
..
README.md Add model behavior observatory 2026-06-30 13:24:54 -06:00
prompts.tsv Add model behavior observatory 2026-06-30 13:24:54 -06:00

README.md

Model Behavior Observatory

The model observatory tracks local model behavior over time using stable prompts. It can run offline fixture checks or optional live Ollama probes.

Run:

./jeannie model-observe prompts
./jeannie model-observe run --offline
./jeannie model-observe report

Live mode is opt-in:

./jeannie model-observe run --live

Live results are written under ${HOMELAB_STATE_DIR}/model-observatory.