Skip to content

Course Pass 12: Multimodal

Pass 12 extends the text platform to images and audio. This path is staged from the B14 design; module chapters and checkable module stages arrive when Step C merges and builds B14.

Part of: the course. Needs: Pass 11.

Gate: MS-P12, composed from the multimodal component milestones in B14.

Generated from path.tsv. Track progress locally with practice/bin/ol learn.

StageReadDone when
1Multimodal pass plan
course/design/B14-multimodal.md
You can explain the image, speech, engine, gateway, and operations work planned for Pass 12.
2Convolution as a linear map
Convolution as a linear map
Your implementation of M12.1 passes its course checks.
3Image tensors and layouts
Image tensors and layouts
Your implementation of M12.2 passes its course checks.
4Resampling and interpolation
Resampling and interpolation
Your implementation of M12.3 passes its course checks.
5DFT and FFT
DFT and FFT
Your implementation of M12.4 passes its course checks.
6Sampling, Nyquist, windows, and the STFT
Sampling, Nyquist, windows, and the STFT
Your implementation of M12.5 passes its course checks.
7Mel scale and filterbanks
Mel scale and filterbanks
Your implementation of M12.6 passes its course checks.
8Signals and images problem set
Signals and images problem set: convolution, sampling, Fourier, mel, contrastive losses, and WER
You complete the S-M12 solve set and its check passes.