Master IASD · DataLab 2026

MNIST generation

A2 · FID, precision, recall and generated images

Updated 21 October 2026 · 22:18 CESTDaily run around 05:00 · Paris time

Podium

Ranked by FID · lower is better. Student groups and professor references compete together.

1
Professor reference

BestOf 2025 · 2

7.20 FID

2
Professor reference

BestOf IASDAPP2026 · 1

7.24 FID

3
Professor reference

BestOf 2025 · 1

8.41 FID

Daily progress

FID over time · lower is better.

Drag to zoom horizontally or vertically; scroll to zoom. Use the toolbar to pan or reset. Dots show evaluations, not GitHub activity. Failed runs leave gaps.

Results

FID ↓ · precision ↑ · recall ↑. P and R are fractions between 0 and 1. The generator architecture must stay fixed.

Hover or focus the ! icon to read an error; click to copy it. Open the image link to inspect the generated digits.

RankStatusSamplesSource
1
Professor reference
BestOf 2025 · 2Reference
7.200.8680.70571.20A40Success 10 imagesFrozen referencec64582d3
2
Professor reference
BestOf IASDAPP2026 · 1Reference
7.240.8620.62375.11A40Success 10 imagesFrozen reference4c551f37
3
Professor reference
BestOf 2025 · 1Reference
8.410.8070.70880.12A40Success 10 imagesFrozen reference39f46132
4
Professor reference
BestOf IASDAPP2026 · 2Reference
9.660.8790.50571.75A40Success 10 imagesFrozen reference7356859e
5
Professor reference
BestOf Bachelor2024Reference
12.930.8730.661153.77A40Success 10 imagesFrozen reference993c998a
6
Professor reference
BestOf DL3IASO2026 · 1Reference
17.050.6650.47988.44A40Success 10 imagesFrozen referenceb546a7bb
7
Professor reference
BestOf 2024 · 2Reference
17.630.7910.53275.24A40Success 10 imagesFrozen reference8206b67b
8
Professor reference
BestOf 2023 · 1Reference
18.220.5540.25180.00A40Success 10 imagesFrozen reference944272bd
9
Professor reference
BestOf 2024 · 1Reference
18.260.7120.57779.89A40Success 10 imagesFrozen referencec835ac05
10
Professor reference
BestOf DL3IASO2026 · 2Reference
19.350.5750.17978.83A40Success 10 imagesFrozen reference0838ee7a
11
Professor reference
BestOf 2023 · 2Reference
36.260.5210.30879.72A40Success 10 imagesFrozen reference836a496b
12
Professor reference
VanillaGANReference
49.980.4750.16676.20A40Success 10 imagesFrozen reference4b4d8ba1

Generated images

10,000 PNG images, 28 × 28 pixels, are required. Historical FID uses Inception features on all images; historical P/R uses VGG features with k=5 and 9,984 images (complete batches of 256). Scores are recomputed; the leaderboard is not a project grade.

Run 20261021T194213Z · Generation limit: 1200 s. Student generation: 4 CPU threads / 12 GiB; historical references may use one A40. Metrics use the evaluator GPU. Time excludes dependency installation and metric computation.