Update the analysis
The leaderboard's contamination verdicts come from a Docent rubric (see Trajectory analysis). To refresh it after adding runs:
- You need access to the RustMizan Docent collection.
- Upload the new
.evalfiles to the collection and run the rubric on them. - Fetch the verdicts and commit the result:
This writespython fetch_docent.py # needs DOCENT_API_KEY (or a DOCENT_TOKEN file)data/docent.json; commit it and open a pull request.