forge-smoketest

When this fires

Phase position: SMOKETEST — between CARD_VALIDATOR and PUBLISH. The last automated check before the model goes public.

What it does

1. Reads hf_space URL from state/manifest
2. Polls https://huggingface.co/api/spaces/<id> for runtime.stage == RUNNING (up to 8 min)
3. Verifies <subdomain>.hf.space/ returns HTTP 200
4. Sends probe prompt to Gradio /run/predict:

   {"data": ["What is a dental crown?"]}

5. Parses response and runs degeneration-pattern checks:
   • too short (< 30 chars)
   • triple-word repetition (\b(\w+)\s+\1\s+\1\b)
   • paragraph-level loops (same 40+ char substring repeated 3+ times)
   • GGUF detokenize artifacts (ttiuser, ttiassistant)
6. Falls back to homepage-only check if /run/predict isn't reachable (custom endpoint / auth required)

Inputs

• Reads slm-forge/.runs/<run-id>/state.json for hf_space URL
• Needs HF_TOKEN for private Space access during the gate (Space is still private at this phase)

Outputs

• Writes slm-forge/.runs/<run-id>/smoketest-report.json:

  {"status":"pass","url":"https://...","prompt":"...","response_preview":"..."}

• On fail: exit 1, PUBLISH never runs, repos stay private

Failure modes

Usage

bash slm-forge/skills/forge-smoketest/run.sh <run-id>