agentleFS
yogsoth-aiyogsoth-ai/convergence/skills/dynamic-tracking/SKILL.md

dynamic-tracking

Skill2 starsChanged 6 months agoApache-2.0View on GitHub

Strategy for continuous rating updates using Elo, Glicko-2, TrueSkill 2, and Whole-History Rating for live ranking systems and A/B testing.

The file

Files
SKILL.md

Dynamic Tracking

Purpose

Maintain live rankings that update incrementally as new comparisons arrive. Suitable for ongoing evaluation, A/B testing, and systems where candidates enter/exit over time. Tracks rating uncertainty and temporal dynamics.

When to use

  • Continuous stream of comparisons (not batch)
  • Candidates added/removed over time
  • A/B testing or tournament-style evaluation
  • Need to track rating trajectories and momentum

Budget

ResourceAllocation
Comparisons per update1+ (online update)
Rating recalculationAfter each comparison or micro-batch
Stability windowLast 20-50 comparisons for convergence check
Decay handlingIncrease uncertainty for inactive candidates

State Ledger

candidates: {}          # id → {mu, sigma, last_active, history: []}
comparison_log: []      # [{pair, winner, timestamp, context}]
method: ""              # elo | glicko2 | trueskill2 | whr
parameters: {}          # K-factor, tau, beta, etc.
iteration: 0
window_size: 30
convergence: {stable: false, score: 0.0}

Available Tactics

  • adaptive-pair-selection — select next matchup for maximum information
  • consistency-audit-loop — periodic transitivity audit

Available SOPs

  • pair-selector
  • comparison-executor
  • rating-update
  • convergence-check
  • cycle-detection
  • ranking-synthesis

Execution Guidance

  1. Initialize new candidates with default prior
  2. For each incoming comparison: a. Run comparison-executor (or accept external result) b. Run rating-update with online method c. Every window_size comparisons, run convergence-check
  3. Periodically run cycle-detection on recent window
  4. Increase sigma for candidates inactive > threshold
  5. On demand: run ranking-synthesis for current snapshot

Output Format

current_ranking:
  - {rank: 1, candidate: "...", mu: 1842, sigma: 45, games: 23}
  - {rank: 2, candidate: "...", mu: 1798, sigma: 52, games: 18}
method: glicko2
total_comparisons: 342
last_updated: "2026-05-19T14:30:00Z"
rating_period: 7
top_movers:
  - {candidate: "...", delta: +120, last_5: "WWWLW"}
stability_score: 0.88

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.