Adaptive Pair Selection

Select the next comparison pair by information gain, execute the comparison, update ratings, and check for convergence. Repeats until the ranking stabilizes or the comparison budget is exhausted.

Stages

1. Select — pair-selector identifies the pair whose comparison would most reduce uncertainty
2. Compare — comparison-executor produces a judgment with confidence and reasoning
3. Update — rating-update incorporates the new judgment into the rating model
4. Check — convergence-check determines if ranking has stabilized

Loop stages 1-4 until convergence or budget exhaustion.

Available SOPs

Execution Guidance

• Start with high-uncertainty pairs (largest sigma or most uncertain boundary)
• For small N: may complete all pairs in first pass, then focus on inconsistencies
• For large N: prioritize pairs near rank boundaries (positions k and k+1)
• Track comparison count against budget; exit gracefully if budget hit
• Pass full rating_history to convergence-check (not just latest snapshot)

Minimum Yield

• Global ranking + confidence intervals + convergence curve
• Global ranking with confidence intervals for each position
• Convergence curve showing stability score over iterations
• Comparison log with all judgments made