BestOf 2023 · 1
0.803 RMSE
A1 · Daily results
Lowest RMSE wins. Student groups and professor references compete together.
0.803 RMSE
0.816 RMSE
0.830 RMSE
RMSE over time · lower is better.
Drag to zoom; use the toolbar to pan or reset. Dots are evaluations, not GitHub activity. Failed runs leave gaps.
No successful evaluations yet.
Scores use hidden evaluation ratings; the input contains train + test. Accuracy is the percentage of exactly predicted ratings. These measurements support your analysis; code itself is not graded.
Hover or focus the ! icon to read an error. Click it to copy the message.
| Rank | Status | Source | ||||
|---|---|---|---|---|---|---|
| 1 | BestOf 2023 · 1Reference | 0.803 | 0.00 | 41.61 | Success | Frozen reference8b6fb772 |
| 2 | BestOf 2025 · 1Reference | 0.816 | 0.00 | 97.09 | Success | Frozen referenceab53d900 |
| 3 | BestOf 2025 · 2Reference | 0.830 | 0.02 | 4.63 | Success | Frozen reference55d5e886 |
| 4 | AcceleratedAerodynamicsYaris2026 group | 0.831 | 0.03 | 226.63 | Success | Repository64709ee4 |
| 5 | The Outliers2026 group | 0.842 | 0.10 | 7.14 | Success | Repository4db5dbeb |
| 6 | 1p2v2026 group | 0.848 | 0.16 | 6.49 | Success | Repository1b27d218 |
| 7 | DauDau2026 group | 0.849 | 0.10 | 16.32 | Success | Repositorye7ebd674 |
| 8 | rEcommeNderS2026 group | 0.849 | 0.12 | 86.56 | Success | Repositoryfa249c3d |
| 9 | BestOf 2024 · 1Reference | 0.850 | 0.00 | 144.98 | Success | Frozen reference1204cccc |
| 10 | Group 312026 group | 0.852 | 0.13 | 61.60 | Success | Repositoryee4e31ca |
| 11 | ONN2026 group | 0.853 | 0.16 | 3.58 | Success | Repositoryb83a11d0 |
| 12 | data-doodlers2026 group | 0.857 | 0.13 | 3.02 | Success | Repositorybaf7c03c |
| 13 | altf42026 group | 0.859 | 0.01 | 25.18 | Success | Repository9065b111 |
| 14 | BestOf 2023 · 2Reference | 0.860 | 26.17 | 99.82 | Success | Frozen reference2fa4d93a |
| 15 | HBA2026 group | 0.861 | 0.07 | 0.97 | Success | Repositoryc2dc497f |
| 16 | Group 282026 group | 0.863 | 0.00 | 64.21 | Success | Repository47b972db |
| 17 | BestOf 2024 · 2Reference | 0.867 | 25.15 | 40.28 | Success | Frozen reference7869cd93 |
| 18 | ACA2026 group | 0.880 | 0.00 | 4.73 | Success | Repository56188493 |
| 19 | Antoine2026 group | 0.917 | 0.25 | 8.99 | Success | Repository78a23566 |
| 20 | Le groupe du fond : LiS2026 group | 0.995 | 0.01 | 10.55 | Success | Repositoryc41b6755 |
| 21 | BANs2026 group | 1.037 | 0.00 | 0.92 | Success | Repository83e99cff |
| 22 | Blocus2026 group | 1.037 | 0.00 | 0.92 | Success | Repository78b0d19f |
| 23 | Breaking Bias2026 group | 1.037 | 0.00 | 0.97 | Success | Repository6d39ac4d |
| 24 | Gengis GAN2026 group | 1.037 | 0.00 | 0.97 | Success | Repository1126422d |
| 25 | Group2026 group | 1.037 | 0.00 | 1.13 | Success | Repositoryabfe5a2a |
| 26 | Group 132026 group | 1.037 | 0.00 | 1.02 | Success | Repositoryb11eb213 |
| 27 | Group 162026 group | 1.037 | 0.00 | 1.00 | Success | Repository43d7b502 |
| 28 | Group 372026 group | 1.037 | 0.00 | 0.92 | Success | Repository9b3166d9 |
| 29 | Group 42026 group | 1.037 | 0.00 | 1.09 | Success | Repository2ebc552e |
| 30 | Group 72026 group | 1.037 | 0.00 | 0.98 | Success | Repository52600990 |
| 31 | LHOOQ2026 group | 1.037 | 0.00 | 0.92 | Success | Repositorye8c37c6c |
| 32 | La piscine2026 group | 1.037 | 0.00 | 0.93 | Success | Repository4208004d |
| 33 | Le Groupe2026 group | 1.037 | 0.00 | 0.92 | Success | Repositorya7242cd3 |
| 34 | OT dream team2026 group | 1.037 | 0.00 | 1.02 | Success | Repository0df43d2a |
| 35 | Rejoignez@Alexis@Hadrien2026 group | 1.037 | 0.00 | 0.97 | Success | Repository3c2e645b |
| 36 | TinderCEOs2026 group | 1.037 | 0.00 | 1.07 | Success | Repository0fc43ada |
| 37 | UsualGreenSundayEnjoyer2026 group | 1.037 | 0.00 | 1.06 | Success | Repositoryb717a243 |
| 38 | WorksOnMyMachine2026 group | 1.037 | 0.00 | 1.02 | Success | Repository69b31592 |
| 39 | averageReference | 1.037 | 0.00 | 0.90 | Success | Frozen reference |
| 40 | blue2026 group | 1.037 | 0.00 | 1.12 | Success | Repository60e7172d |
| 41 | force-push2026 group | 1.037 | 0.00 | 1.02 | Success | Repository618d11cf |
| 42 | ocaml2026 group | 1.037 | 0.00 | 0.97 | Success | Repositoryfe38654d |
| 43 | umap reborn2026 group | 1.037 | 0.00 | 0.92 | Success | Repository241f46d4 |
| 44 | randomReference | 1.832 | 14.06 | 1.03 | Success | Frozen reference |
| — | AKE2026 group | — | — | — | Error ments, max_rounds=max_rounds) File "/env/lib/python3.13/site-packages/pip/_vendor/resolvelib/resolvers/resolution.py", line 388, in resolve self._add_to_criteria(self.state.criteria, r, parent=None) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/env/lib/python3.13/site-packages/pip/_vendor/resolvelib/resolvers/resolution.py", line 141, in _add_to_criteria if not criterion.candidates: ^^^^^^^^^^^^^^^^^^^^ File "/env/lib/python3.13/site-packages/pip/_vendor/resolvelib/structs.py", line 194, in __bool__ return bool(self._sequence) File "/env/lib/python3.13/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 163, in __bool__ self._bool = any(self) ~~~^^^^^^ File "/env/lib/python3.13/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 147, in <genexpr> return (c for c in iterator if id(c) not in self._incompatible_ids) ^^^^^^^^ File "/env/lib/python3.13/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 37, in _iter_built candidate = func() File "/env/lib/python3.13/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 187, in _make_candidate_from_link base: Optional[BaseCandidate] = self._make_base_candidate_from_link( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ link, template, name, version ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/env/lib/python3.13/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 233, in _make_base_candidate_from_link self._link_candidate_cache[link] = LinkCandidate( ~~~~~~~~~~~~~^ link, ^^^^^ ...<3 lines>... version=version, ^^^^^^^^^^^^^^^^ ) ^ File "/env/lib/python3.13/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 306, in __init__ super().__init__( ~~~~~~~~~~~~~~~~^ link=link, ^^^^^^^^^^ ...<4 lines>... version=version, ^^^^^^^^^^^^^^^^ ) ^ File "/env/lib/python3.13/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 159, in __init__ self.dist = self._prepare() ~~~~~~~~~~~~~^^ File "/env/lib/python3.13/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 236, in _prepare dist = self._prepare_distribution() File "/env/lib/python3.13/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 317, in _prepare_distribution return preparer.prepare_linked_requirement(self._ireq, parallel_builds=True) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/env/lib/python3.13/site-packages/pip/_internal/operations/prepare.py", line 532, in prepare_linked_requirement return self._prepare_linked_requirement(req, parallel_builds) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^ File "/env/lib/python3.13/site-packages/pip/_internal/operations/prepare.py", line 647, in _prepare_linked_requirement dist = _get_prepared_distribution( req, ...<3 lines>... self.check_build_deps, ) File "/env/lib/python3.13/site-packages/pip/_internal/operations/prepare.py", line 71, in _get_prepared_distribution abstract_dist.prepare_distribution_metadata( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ finder, build_isolation, check_build_deps ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/env/lib/python3.13/site-packages/pip/_internal/distributions/sdist.py", line 56, in prepare_distribution_metadata self._install_build_reqs(finder) ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ File "/env/lib/python3.13/site-packages/pip/_internal/distributions/sdist.py", line 126, in _install_build_reqs build_reqs = self._get_build_requires_wheel() File "/env/lib/python3.13/site-packages/pip/_internal/distributions/sdist.py", line 103, in _get_build_requires_wheel return backend.get_requires_for_build_wheel() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/env/lib/python3.13/site-packages/pip/_internal/utils/misc.py", line 702, in get_requires_for_build_wheel return super().get_requires_for_build_wheel(config_settings=cs) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/env/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_impl.py", line 196, in get_requires_for_build_wheel return self._call_hook( ~~~~~~~~~~~~~~~^ "get_requires_for_build_wheel", {"config_settings": config_settings} ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/env/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_impl.py", line 402, in _call_hook raise BackendUnavailable( ...<4 lines>... ) pip._vendor.pyproject_hooks._impl.BackendUnavailable: Cannot import 'setuptools.build_meta' | Repository89a24f92 |
| — | Group 272026 group | — | — | — | Pending | Repository pending |
| — | MassSurveillanceReadyFiltering2026 group | — | — | — | Error execution: RuntimeError: Process exited with code 1. Traceback (most recent call last): File "/work/generate.py", line 11, in <module> from cf.cli import ConvertParametersAction File "/work/cf/__init__.py", line 7, in <module> from .als import ALSMatrixFactorization File "/work/cf/als.py", line 14, in <module> from .baseline import bias_baseline ImportError: cannot import name 'bias_baseline' from 'cf.baseline' (/work/cf/baseline.py) | Repository9dff6d2c |
| — | Matcha2026 group | — | — | — | Pending | Repository pending |
| — | SnapCat2026 group | — | — | — | Error prepare: ValueError: No escaped character | Repositoryf3c45dff |
No matching group.
Run 20261012T030001Z · Execution limit: 1200 s per group. Student runs: 4 CPU threads · 12 GiB host memory · CPU only. Historical references use one A40 GPU when required. Dependency installation time is not included in the reported execution time.