Skip to main content

Ctrl+K

An Alchemist's Notes on Deep Learning

Numerical Toolkit

Overview of JAX
Building NNs with Flax
The jaxtransformer Library

Training Neural Networks

Why Neural Networks?
Backpropagation
Optimization

Building Blocks

Dense Layers
Activation Functions
Normalization Functions
Residual Networks
Convolutional Layers
Recurrent Layers
Attention
The Transformer

Models

Classifiers
Variational Auto-Encoders
Generative Adversarial Networks
Diffusion and Flow Matching

Misc

Model Agnostic Meta Learning
Learning Rate Scheduling
Second-Order Optimization

Search

Ctrl+K

By Kevin Frans

© Copyright 2023.