Master IASD · DataLab 2026

MNIST generation

A2 · FID, precision, recall and generated images

Updated 03 November 2026 · 07:37 CETDaily run around 05:00 · Paris time

Podium

Ranked by FID · lower is better. Student groups and professor references compete together.

1
lekoduckhoiraphael-uxyazi-mellissa

DLR

6.83 FID

2
Professor reference

BestOf 2025 · 2

7.49 FID

3
Professor reference

BestOf IASDAPP2026 · 1

7.60 FID

Daily progress

FID over time · lower is better.

Drag to zoom horizontally or vertically; scroll to zoom. Use the toolbar to pan or reset. Dots show evaluations, not GitHub activity. Failed runs leave gaps.

Results

FID ↓ · precision ↑ · recall ↑. P and R are fractions between 0 and 1. The generator architecture must stay fixed.

Hover or focus the ! icon to read an error; click to copy it. Open the image link to inspect the generated digits.

RankStatusSamplesSource
1
lekoduckhoiraphael-uxyazi-mellissa
DLR2026 group
6.830.8780.68275.81CPUSuccess 10 imagesRepositorydadcf693
2
Professor reference
BestOf 2025 · 2Reference
7.490.8640.70376.61A40Success 10 imagesFrozen referencec64582d3
3
Professor reference
BestOf IASDAPP2026 · 1Reference
7.600.8600.60481.64A40Success 10 imagesFrozen reference4c551f37
4
Professor reference
BestOf 2025 · 1Reference
8.310.8020.71763.22A40Success 10 imagesFrozen reference39f46132
5
Professor reference
BestOf IASDAPP2026 · 2Reference
9.660.8820.50575.80A40Success 10 imagesFrozen reference7356859e
6
Professor reference
BestOf Bachelor2024Reference
12.330.8750.661134.92A40Success 10 imagesFrozen reference993c998a
7
MangKaGOmanelwnourceneB
CLM2026 group
16.740.6850.35369.29CPUSuccess 10 imagesRepository1bfaccf7
8
Professor reference
BestOf DL3IASO2026 · 1Reference
16.990.6690.50488.93A40Success 10 imagesFrozen referenceb546a7bb
9
Professor reference
BestOf 2024 · 2Reference
17.440.8040.54180.51A40Success 10 imagesFrozen reference8206b67b
10
Professor reference
BestOf 2024 · 1Reference
18.140.7230.55974.60A40Success 10 imagesFrozen referencec835ac05
11
Professor reference
BestOf 2023 · 1Reference
18.150.5630.22576.31A40Success 10 imagesFrozen reference944272bd
12
Tpiettonaladin20cPuuuu-cr
Group 372026 group
18.170.7260.57766.86CPUSuccess 10 imagesRepositoryc1a2bb49
13
Professor reference
BestOf DL3IASO2026 · 2Reference
18.940.5810.13879.92A40Success 10 imagesFrozen reference0838ee7a
14
aaidoudi91maitsel-gifleogruchociak
Group 242026 group
25.800.5420.22667.48CPUSuccess 10 imagesRepository6dadc6ba
15
Stalko123ZieBerthewandrillebv
GANgnam style2026 group
26.980.5700.28172.26CPUSuccess 10 imagesRepositorydc247bdd
16
Haidar-yousifYanisMrmru5318996810-glitch
3StochasticParrots2026 group
27.120.5260.21683.34CPUSuccess 10 imagesRepository5a0dda42
17
fumseckkalexandrenoel20naomibronstein
jaipasdidéesdenomdegroupe2026 group
28.630.5080.21074.25CPUSuccess 10 imagesRepository9739e087
18
MobinaMhrPaul-Huber7sha098213
Skill issue2026 group
29.680.5290.21474.06CPUSuccess 10 imagesRepositoryf081dcf5
19
KaterinaGalkinaArmandVincenthonganh7263-debug
AKA2026 group
31.940.4720.27071.59CPUSuccess 10 imagesRepository3d5627be
20
Baude04erwanmadMateoDeschildre
CirylGan2026 group
32.330.5390.23466.89CPUSuccess 10 imagesRepository83e1a15e
21
FrodogornHakimTaoufikclemencejin888
Group 172026 group
36.180.4510.21871.30CPUSuccess 10 imagesRepositoryfa0e8ef1
22
Dams0601F1rasssToitoine1
HQHD2026 group
36.500.7120.50277.15CPUSuccess 10 imagesRepositorye93fb326
23
Professor reference
BestOf 2023 · 2Reference
36.950.5170.28775.53A40Success 10 imagesFrozen reference836a496b
24
arthur-oudeyerFalgunyEmarim-boughanm
Klick2026 group
38.920.7170.491411.45CPUSuccess 10 imagesRepository62e9e263
25
quentinRevillonNicolo456noe-mosca
TP2026 group
43.430.7020.49375.15CPUSuccess 10 imagesRepository906cef82
26
LiLinduoNikosKontCenzito
GANsters2026 group
45.760.5870.45068.89CPUSuccess 10 imagesRepository1fef4222
27
Pola03MaryamShiranrcuadro-IASD
Latent Dwellers2026 group
47.200.5780.37868.54CPUSuccess 10 imagesRepositoryeddadb19
28
Professor reference
VanillaGANReference
49.600.4690.16673.65A40Success 10 imagesFrozen reference4b4d8ba1
29
tlabrandeGautierGabrielThaninaSIOUANI
Madeleines2026 group
60.800.5390.00074.16CPUSuccess 10 imagesRepository5c79f766
30
S-Cordeirosyldehaeya-brad
SES_team2026 group
87.720.5280.12368.72CPUSuccess 10 imagesRepository32ede0d6
31
roeyzaw1arielgg46jvshangold
The Ambassadors2026 group
89.300.5760.06677.65CPUSuccess 10 imagesRepository31c12825
32
Mahdi-MarvAugustinBouquillardlorisamorese
Consistent GANaches2026 group
383.440.0000.00072.54CPUSuccess 10 imagesRepository2022f4b7
33
AymericPaponMartinJessenneleopmr
MNISLOP2026 group
383.500.0000.00077.28CPUSuccess 10 imagesRepository1fa813d8
34
Zomack270leonhogJimRam14
DauDauBis2026 group
383.760.0000.00075.66CPUSuccess 10 imagesRepository9593651f
35
f-chen88GuindoAissataIka807
Que la GAN2026 group
383.820.0000.00068.84CPUSuccess 10 imagesRepositoryf0426862
36
hadriennouvel
Data Lab - 22026 group
383.820.0000.00070.68CPUSuccess 10 imagesRepository2b281e11
37
Imane2410Ahmed-ux1502mohamed-meghrous
LaMasIA2026 group
384.040.0000.00071.42CPUSuccess 10 imagesRepository96b56091
38
g4briel-cmdrogejuGitM27
NYBandits2026 group
384.220.0000.00081.35CPUSuccess 10 imagesRepositoryeb1ce2f7
39
romain-oQuentinz12omarbargach
QOR2026 group
384.300.0000.00070.14CPUSuccess 10 imagesRepository7365a8bd
40
JeanGrngValentinJourdanvincentami1
RTFM2026 group
384.390.0000.00066.08CPUSuccess 10 imagesRepositoryd896a99f
41
eoghanCheveteachShaicodeaminesaadi2312
Sbo3a2026 group
384.400.0000.00068.19CPUSuccess 10 imagesRepositoryac0acbeb
42
Group
Group 332026 group
384.550.0000.00070.79CPUSuccess 10 imagesRepository20a10c73
43
yassinemethniClementGPP
blue2026 group
384.660.0000.00070.00CPUSuccess 10 imagesRepositoryb3c8683a
44
Benjamin-WilhelmleroysomerGaspardMalhomme
CreativeConcepts2026 group
384.680.0000.00078.17CPUSuccess 10 imagesRepository90bfb477
45
ComeRochasAlexandDecArthurCommunal2
Lamine Yamal2026 group
385.080.0000.00075.86CPUSuccess 10 imagesRepository39232cfc
—
greglcrNathanDuboissethibacheikh
A22026 group
———68.69CPUError images: ValueError: Expected exactly 10000 PNG images in samples/, found 10001 entries—Repositoryac618d1c
—
lucas3600Frangipanusvictor-jourdan
Bach enjoyers2026 group
———23.64CPUError images: ValueError: Expected exactly 10000 PNG images in samples/, found 1456 entries—Repository0911d386
—
dinoroberdemircctr002Alexis91800
Réveille-toi Canna2026 group
————Error ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.2/57.2 MB 22.5 MB/s eta 0:00:00 Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Installing backend dependencies: started Installing backend dependencies: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'error' error: subprocess-exited-with-error × Preparing metadata (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [53 lines of output] + meson setup /tmp/pip-install-xoxrqhon/scipy_aceba69e798e458b8cac095d967280e6 /tmp/pip-install-xoxrqhon/scipy_aceba69e798e458b8cac095d967280e6/.mesonpy-8a_njv87 -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --native-file=/tmp/pip-install-xoxrqhon/scipy_aceba69e798e458b8cac095d967280e6/.mesonpy-8a_njv87/meson-python-native-file.ini The Meson build system Version: 1.12.1 Source dir: /tmp/pip-install-xoxrqhon/scipy_aceba69e798e458b8cac095d967280e6 Build dir: /tmp/pip-install-xoxrqhon/scipy_aceba69e798e458b8cac095d967280e6/.mesonpy-8a_njv87 Build type: native build Project name: scipy Project version: 1.13.1 C compiler for the host machine: /usr/bin/ccache cc (gcc 14.2.0 "cc (Debian 14.2.0-19) 14.2.0") C linker for the host machine: cc ld.bfd 2.44 C++ compiler for the host machine: /usr/bin/ccache c++ (gcc 14.2.0 "c++ (Debian 14.2.0-19) 14.2.0") C++ linker for the host machine: c++ ld.bfd 2.44 Cython compiler for the host machine: cython (cython 3.0.12) Host machine cpu family: x86_64 Host machine cpu: x86_64 Program python found: YES (/env/bin/python) Found pkg-config: YES (/usr/bin/pkg-config) 1.8.1 Run-time dependency python found: YES 3.13 Program cython found: YES (/tmp/pip-build-env-5shpx971/overlay/bin/cython) Compiler for C supports arguments -Wno-unused-but-set-variable: YES Compiler for C supports arguments -Wno-unused-function: YES Compiler for C supports arguments -Wno-conversion: YES Compiler for C supports arguments -Wno-misleading-indentation: YES Library m found: YES ../meson.build:78:0: ERROR: Unknown compiler(s): [['gfortran'], ['flang-new'], ['flang'], ['nvfortran'], ['pgfortran'], ['ifort'], ['ifx'], ['g95']] The following exception(s) were encountered: Running `gfortran --help` gave "[Errno 2] No such file or directory: 'gfortran'" Running `gfortran --version` gave "[Errno 2] No such file or directory: 'gfortran'" Running `gfortran -V` gave "[Errno 2] No such file or directory: 'gfortran'" Running `flang-new --help` gave "[Errno 2] No such file or directory: 'flang-new'" Running `flang-new --version` gave "[Errno 2] No such file or directory: 'flang-new'" Running `flang-new -V` gave "[Errno 2] No such file or directory: 'flang-new'" Running `flang --help` gave "[Errno 2] No such file or directory: 'flang'" Running `flang --version` gave "[Errno 2] No such file or directory: 'flang'" Running `flang -V` gave "[Errno 2] No such file or directory: 'flang'" Running `nvfortran --help` gave "[Errno 2] No such file or directory: 'nvfortran'" Running `nvfortran --version` gave "[Errno 2] No such file or directory: 'nvfortran'" Running `nvfortran -V` gave "[Errno 2] No such file or directory: 'nvfortran'" Running `pgfortran --help` gave "[Errno 2] No such file or directory: 'pgfortran'" Running `pgfortran --version` gave "[Errno 2] No such file or directory: 'pgfortran'" Running `pgfortran -V` gave "[Errno 2] No such file or directory: 'pgfortran'" Running `ifort --help` gave "[Errno 2] No such file or directory: 'ifort'" Running `ifort --version` gave "[Errno 2] No such file or directory: 'ifort'" Running `ifort -V` gave "[Errno 2] No such file or directory: 'ifort'" Running `ifx --help` gave "[Errno 2] No such file or directory: 'ifx'" Running `ifx --version` gave "[Errno 2] No such file or directory: 'ifx'" Running `ifx -V` gave "[Errno 2] No such file or directory: 'ifx'" Running `g95 --help` gave "[Errno 2] No such file or directory: 'g95'" Running `g95 --version` gave "[Errno 2] No such file or directory: 'g95'" Running `g95 -V` gave "[Errno 2] No such file or directory: 'g95'" A full log can be found at /tmp/pip-install-xoxrqhon/scipy_aceba69e798e458b8cac095d967280e6/.mesonpy-8a_njv87/meson-logs/meson-log.txt [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed × Encountered error while generating package metadata. ╰─> See above for output. note: This is an issue with the package mentioned above, not pip. hint: See above for details. —Repositoryaabc2e8a
—
AlGoRythm3000joao-alcindosalva24IASD
Tung Tung Tung Tung Tung GANur2026 group
————CPUError generation: RuntimeError: Process exited with code 1. Using device: CPU Model Loading... Traceback (most recent call last): File "/work/generate.py", line 33, in <module> model = load_model(model, 'checkpoints', device) File "/work/utils.py", line 62, in load_model ckpt = torch.load(ckpt_path, map_location=device) File "/env/lib/python3.13/site-packages/torch/serialization.py", line 1565, in load with _open_file_like(f, "rb") as opened_file: ~~~~~~~~~~~~~~~^^^^^^^^^ File "/env/lib/python3.13/site-packages/torch/serialization.py", line 795, in _open_file_like return _open_file(name_or_buffer, mode) File "/env/lib/python3.13/site-packages/torch/serialization.py", line 776, in __init__ super().__init__(open(name, mode)) # noqa: SIM115 ~~~~^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: 'checkpoints/G.pth' —Repositoryd3e56ad3
—
Loui0-0EyfelixakselDang
ganberge2026 group
————Error prepare: ValueError: Missing generate.py at repository root—Repository28ba16af

Generated images

10,000 PNG images, 28 × 28 pixels, are required. Historical FID uses Inception features on all images; historical P/R uses VGG features with k=5 and 9,984 images (complete batches of 256). Scores are recomputed; the leaderboard is not a project grade.

Run 20261103T040001Z · Generation limit: 1200 s. Student generation: 4 CPU threads / 12 GiB; historical references may use one A40. Metrics use the evaluator GPU. Time excludes dependency installation and metric computation.