review-student-prs
Skill17 starsChanged 2 days agoMITView on GitHub
Review and merge student exercise PRs during TP sessions. Arguments: <repo-url> [--class <class-id>] [--timeslot <HH:MM-HH:MM>] [--dry-run]
In this repository19 other files it gives its agents.
- .vibe/AGENTS.mdAGENTS.md
- CLAUDE.mdCLAUDE.md
- adjoint-secretarySkill
- analyze-slidesSkill
- build-notebookSkill
- check-cell-orderSkill
- cleanup-notebooksSkill
- coordinate-adjointSkill
- coordinateSkill
- enrich-notebooksSkill
- execute-notebookSkill
- genai-iterateSkill
- mcp-jupyterSkill
- notebook-helpersSkill
- notebook-patternsSkill
- qc-iterative-improveSkill
- train-modelSkill
- validate-genaiSkill
- verify-notebooksSkill
The file
Show its rules and text
We split this skill into the rules it gives an agent
24 rules. About 0 are common, 22 are distinctive, and 2 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈22
Distinctive · estimate
This author's own choices. Worth a look.
2
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- could be automatic: a setting could enforce it
- Distinctive: line 24
Filter by timeslot: - Only PRs created within the authorized submission window
- Very specific: line 28
If available, match against inscription spreadsheet (G:\Mon Drive\MyIA\Formation\ECE\2026\)
- Distinctive: line 47
Check that exercise cells have been filled (not empty or placeholder)
- Distinctive: line 48
Verify code is syntactically correct
- Distinctive: line 49
Check markdown cells for explanations if required
- Distinctive: line 61
If the exercise cell was solved by uncommenting provided solution code: flag as TRIVIAL
- Distinctive: line 62
If this was due to solutions being provided in comments (our error): accept but note it
- Distinctive: line 63
If the student wrote original code different from any example: mark as ORIGINAL
- Distinctive: line 110
Add brief commentary on the approach used
- Distinctive: line 114
Add a NEW exercise cell after the newly created example
- Distinctive: line 117
Not directly derivable from the example above
- Distinctive: line 120
Add appropriate markdown instructions for the new exercise
- Distinctive: line 123
If multiple students solved the same exercise across PRs:
- Distinctive: line 124
Keep the most pedagogically valuable solution as example
- Distinctive: line 125
Remove redundant examples that don't add new insight
- Distinctive: line 127
Ensure the notebook flow remains coherent
- Distinctive: line 129
If a notebook accumulates too many examples (>3 consecutive examples on same concept):
- Distinctive: line 130
Keep the 2 most distinct/illustrative ones
- Distinctive: line 160
Timing: Run between classes (e.g., noon-2pm) so afternoon class gets fresh exercises
- Distinctive: line 162
Conflict resolution: If two PRs modify the same notebook, merge the first, rebase the second
- Distinctive: line 163
Security: Never execute untrusted code outside the notebook sandbox
- Very specific: line 164
Backup: Create a local branch backup before merging: backup/pre-merge-<date>
- Distinctive: line 165
No force push: All merges are regular merges or fast-forwards
- Distinctive: line 187
No personal data: never copy student names or e-mails from these classeurs into the repository, a PR or a public comment.
≈ “Common” is an estimate: at least 1 in 5 of the 372,429 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Review Student PRs
Review, validate, and intelligently merge student exercise PRs submitted during TP sessions.
Target: $ARGUMENTS
Arguments
repo-url: GitHub repository URL (e.g.,https://github.com/jsboigeECE/2026-ECE-Ing4-Fin-IA-Projet1-Gr01)--class <class-id>: Class identifier (e.g.,Gr01,Gr02,Gr03)--timeslot <HH:MM-HH:MM>: Authorized submission window (e.g.,08:00-12:00). PRs outside this window are flagged--dry-run: Review only, no merge or commit
Process
Phase 1 - Discovery & Identification
- Fetch open PRs from the target repo using
gh pr list - Filter by timeslot - Only PRs created within the authorized submission window
- Identify students:
- Parse PR title/body for student name, group, notebook claimed
- Cross-reference GitHub username with submission account
- If available, match against inscription spreadsheet (
G:\Mon Drive\MyIA\Formation\ECE\2026\)
- Flag anomalies: PRs outside timeslot, duplicate claims on same notebook, unknown accounts
- Check each delivery against the group's reservation (MANDATORY before any conversion in Phase 4, teacher sign-off 2026-11-10). The reservation lists stop two groups from reserving the same exercise; they cannot stop a group from delivering an exercise it did not reserve. For each PR, once the group is identified (step 3) and the delivered notebook and exercise numbers are known, run the private read-only script of the cohort's reservation tools:
conda run -n mcp-jupyter python "G:\Mon Drive\MyIA\Formation\EPF\2027\outils-reservation-tp\verifier_rendu.py" \ --classeur <IA2-Min1|IA2-Min2|MIS|APP3|MIN52> --groupe <Gnn> --carnet <repo path of the notebook> --exercices <1,2,3>rc=0: every delivered exercise is reserved by this group. Proceed.rc=1: at least one exercise isCOLLISION(reserved by another group) orHORS-RESERVATION(reserved by nobody in this notebook). Do not convert that exercise. Record the gap in the report and put the decision to the teacher (user question registry). The script also lists the group's reservations in other notebooks, which shows a renamed notebook or a delivery moved from another notebook.rc=2: the classeur could not be read. This is never an OK: repair the access first.- Also check on
mainthat the delivered exercise is not already a guided example credited to someone else:git show origin/main:<notebook> | grep -o 'Exemple guidé[^"]*'.
Phase 2 - Code Review
For each valid PR:
- Fetch PR diff using
gh pr diff <number> - Identify modified notebooks and changed cells
- Validate exercise completion:
- Check that exercise cells have been filled (not empty or placeholder)
- Verify code is syntactically correct
- Check markdown cells for explanations if required
- Execution validation (MANDATORY - do not skip):
- Checkout PR branch locally
- Execute the modified exercise cell(s) and all prerequisite cells
- For Python notebooks:
python scripts/notebook_tools/notebook_helpers.py execute <path> --verbose - For .NET notebooks: use MCP cell-by-cell execution
- Record execution results (pass/fail, output, errors)
- If cell fails to execute: mark as PARTIAL, note the error
- If error is environment-only (missing package on student machine but code is correct): accept with note
- If error is code logic: mark as INVALID
- Detect copy-paste / uncommenting:
- Compare student's code against the "Exemple guide" in the same notebook
- If the exercise cell was solved by uncommenting provided solution code: flag as TRIVIAL
- If this was due to solutions being provided in comments (our error): accept but note it
- If the student wrote original code different from any example: mark as ORIGINAL
- Quality assessment (per exercise):
- Code correctness (executes without error)
- Code originality (ORIGINAL vs TRIVIAL vs COPY)
- Code quality (reasonable approach, variable naming, structure)
- Explanation quality (if markdown present)
- Score: VALID / PARTIAL / INVALID
Phase 3 - Report Generation
Generate a correction report in reports/corrections/ (gitignored):
reports/corrections/YYYY-MM-DD_<class-id>_review.mdReport format:
# TP Review - <date> - <class-id>
## Summary
- PRs reviewed: N
- Valid exercises: N (+0.5 pts each)
- Partial: N (manual review needed)
- Invalid: N
## Per-Student Results
### <Student Name> (GitHub: @username)
- **PR**: #<number> - <title>
- **Notebook**: <notebook-name>
- **Timeslot**: <created-at> (VALID/LATE)
- **Exercises**:
| Exercise | Status | Score | Notes |
|----------|--------|-------|-------|
| Ex 1 | VALID | +0.5 | Clean implementation |
| Ex 2 | PARTIAL| 0 | Missing explanation |
- **Total bonus**: +X.X pointsPhase 4 - Intelligent Merge
For each VALID exercise whose reservation check (Phase 1, step 5) returned OK, or which the teacher has explicitly cleared (skip if --dry-run):
- Transform exercise result into example:
- The student's completed exercise cell becomes a new example cell
- Rewrite the preceding markdown to frame it as "Example -
<topic>" instead of "Exercise" - Add brief commentary on the approach used
- Preserve the student's code as-is (it's their contribution)
- Create replacement exercise:
- Add a NEW exercise cell after the newly created example
- The new exercise must be:
- Different from the one just solved (not a trivial variant)
- Not directly derivable from the example above
- At a similar difficulty level
- Related to the same topic/concept
- Add appropriate markdown instructions for the new exercise
- Curate redundancy:
- If multiple students solved the same exercise across PRs:
- Keep the most pedagogically valuable solution as example
- Remove redundant examples that don't add new insight
- Credit every correct, independent solution on the kept example, the later one included (co-credit in the example heading, each with its PR number). A redundant solution loses its cell, never its credit.
- Ensure the notebook flow remains coherent
- If the exercise was already converted on
mainfrom another group's delivery (late submission on an older notebook version), apply the same co-credit, in a PR of its own. Then close the student's PR with a comment that names the PR carrying the credit. - If a notebook accumulates too many examples (>3 consecutive examples on same concept):
- Keep the 2 most distinct/illustrative ones
- Remove the others
- Adjust markdown transitions
- If multiple students solved the same exercise across PRs:
- Commit changes:
feat(ece): integrate student exercise <notebook> - <student> (+0.5 bonus) - Exercise result converted to example - New replacement exercise added - Reviewed and validated during TP <date> Co-Authored-By: <Student Name> <student-email-if-available> Co-Authored-By: Claude-Code <noreply@anthropic.com> - Push to the main branch of the target student repository (the
repo-urlargument), after all PRs for the session are processed. That repository's charter governs this push. If the integration lands injsboige/CoursIA, never push tomain: open one PR for the session instead (CLAUDE.md §A,git-workflow.md).
Phase 5 - Cleanup
- Close merged PRs with a comment thanking the student and confirming bonus
- Update the correction report with final merge status
- Summary output to the user with:
- Number of exercises validated
- Bonus points attributed per student
- Any issues requiring manual attention
- List of notebooks updated with new exercises
Important Notes
- Timing: Run between classes (e.g., noon-2pm) so afternoon class gets fresh exercises
- Merge order: Process PRs in submission order (FIFO)
- Conflict resolution: If two PRs modify the same notebook, merge the first, rebase the second
- Security: Never execute untrusted code outside the notebook sandbox
- Backup: Create a local branch backup before merging:
backup/pre-merge-<date> - No force push: All merges are regular merges or fast-forwards
- Report confidentiality: Reports in
reports/corrections/are gitignored, never committed
Notebook Types
| Series | Kernel | Execution Method |
| Probas | .NET C# | MCP cell-by-cell |
| GameTheory | Python (WSL) | papermill or notebook_helpers |
| ML | Mixed (.NET + Python) | Depends on notebook |
Spreadsheet Reference
Student inscriptions and evaluations:
G:\Mon Drive\MyIA\Formation\ECE\2026\- CSV/XLSX files- Match GitHub usernames to student names for bonus attribution
EPF 2026-2027 (private, outside the repository): one Google Sheets classeur per cohort (IA2-Min1, IA2-Min2, MIS, APP3, MIN52).
- Where: the keys are those of the
SHEETSdict inG:\Mon Drive\MyIA\Formation\EPF\2027\outils-reservation-tp\premier-arrive\gsx.py, which reads the local OAuth profile and never copies it. - Tabs: groups (
Groupes P1/Groupes P2, orGroupes),Réservations TP(one row per reserved exercise), and an exercise catalogue. - Tools: they are documented in
outils-reservation-tp\LISEZMOI.md(catalogue refresh, first-come-first-served lists,verifier_rendu.py). - Read-only during class: any write to a student classeur (delivery credit in the teacher table, catalogue refresh) is dry-run on a Drive copy first, never during a session.
- No personal data: never copy student names or e-mails from these classeurs into the repository, a PR or a public comment. GitHub logins the students used themselves are the only credit.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

