Submit your assignments here. Results will be updated immediately.
| Rank | Handle |
#0 Scalar (% N) |
#1 Alignment (AER) |
#2 Model score |
#3 Accuracy |
#4 BLEU |
#5 Accuracy |
|---|---|---|---|---|---|---|---|
| 1 | fallingoffthebeam | 11.000 | 0.123 | -1339.466 | 0.842 | 29.005 | 0.705 |
| 2 | ksk | 2.000 | 0.169 | -1254.000 | 0.785 | 29.080 | 0.690 |
| 3 | matt | -inf | inf | -inf | 0.522 | -inf | 0.666 |
| 4 | HarryTheHB | 5.000 | 0.352 | -1223.265 | 0.512 | 29.212 | 0.643 |
| 5 | baseline | 89.000 | 0.376 | -1316.091 | 0.504 | 28.863 | 0.641 |
| 6 | query | 77.770 | 0.182 | -1266.898 | 0.786 | 28.773 | 0.620 |
| 7 | default | 100.000 | 0.681 | -1439.874 | 0.449 | 27.351 | 0.585 |
| 8 | oracle | -inf | -inf | -1215.561 | -inf | 40.057 | -inf |
| 9 | BersaKAIN | 56.015 | inf | -inf | -inf | 27.952 | -inf |
| 10 | jay | -1.000 | 0.300 | -1286.206 | 0.515 | 26.585 | -inf |
| 11 | rooms_to_let | -inf | inf | -inf | 0.670 | -inf | -inf |
| JaLozR | 7.000 | 0.331 | -inf | 0.516 | -inf | -inf | |
| lièvre | 6.000 | 0.177 | -1298.857 | -inf | -inf | -inf | |
| arnaud.albalat | -inf | inf | -inf | -inf | -inf | -inf | |
| realcaoyuan | -inf | inf | -inf | -inf | -inf | -inf | |
| tdomhan | -inf | inf | -inf | -inf | -inf | -inf | |
| julie.medero | -inf | inf | -inf | -inf | -inf | -inf | |
| nx.niuxiang | -inf | inf | -inf | -inf | -inf | -inf | |
| mfreitag.i6@googlemail.com | -inf | inf | -inf | -inf | -inf | -inf | |
| peterfeng0824 | -inf | inf | -inf | -inf | -inf | -inf | |
| martaruizcostajussa | -inf | inf | -inf | -inf | -inf | -inf | |
| ronaknnathani | -inf | inf | -inf | -inf | -inf | -inf | |
| lluisf | -inf | inf | -inf | -inf | -inf | -inf | |
| njc.xvii | -inf | inf | -inf | -inf | -inf | -inf | |
| kadar.akos | -inf | inf | -inf | -inf | -inf | -inf | |
| anoop.sarkar | -inf | inf | -inf | -inf | -inf | -inf | |
| mtmooc | -inf | inf | -inf | -inf | -inf | -inf | |
| hueseyin.dagaydin | -inf | inf | -inf | -inf | -inf | -inf | |
| nitika.mathur | -inf | inf | -inf | -inf | -inf | -inf | |
| vsnine | -inf | inf | -inf | -inf | -inf | -inf | |
| angelrajan.research | -inf | inf | -inf | -inf | -inf | -inf |
Legend
A value of -1 indicates that the assignment file was found but contained invalid content.
The oracle (best possible), default and baseline (minimum performance for a B) lines are highlighted.