Model Behavior Observatory

The model observatory tracks local model behavior over time using stable prompts. It can run offline fixture checks or optional live Ollama probes.

Run:

./jeannie model-observe prompts
./jeannie model-observe run --offline
./jeannie model-observe report

Live mode is opt-in:

./jeannie model-observe run --live

Live results are written under ${HOMELAB_STATE_DIR}/model-observatory.