Leaderboard

This page contains the assignment leaderboard. The leaderboard is updated as follows. Every five minutes, on the five-minute mark, every assignment not yet past its due date is downloaded according the base URL and assignment number you turned in with Assignment 0. The output is rescored if it changed.

Assignments
Rank Handle #0 #1
AER
#2
model score
#3
Spearman's
#4
BLEU

Legend

A value of -1 indicates that the assignment file was found but contained invalid content.

The light coral line is the default system; it is what you should get if you run the code that was provided for you. The row highlighted with pale golden rod is the baseline you should strive to beat. Typically, this line depicts the effort required to earn a B on the project. Additional points will be rewarded for beating the baseline by a significant amount, and the most points will be awarded for placing at or near the top of the rankings.

The oracle system is a metric-aware composite of the best results from each student submission. It is not possible to beat the oracle, but it gives you an idea of how much improvement there is for your system to find.