Skip to content
Cracked
AI
Problems
Tracks
Learn
JAX
Roadmap
Articles
Leaderboard
Search
Ctrl K
Mode:
JAX
PyTorch
JAX
Python
Rust
C++
PyTorch
JAX
Python
Rust
C++
Log in
Sign up
Problems
Tracks
Learn JAX
Articles
Roadmap
Leaderboard
Set up the runtime
Log in
Sign up
PyTorch
JAX
Python
Rust
C++
Radio
We can't find the internet
Attempting to reconnect
Something went wrong!
Attempting to reconnect
Shazeer 2020 practice problems in JAX
Search problems
Difficulty:
Easy
Medium
Hard
Category & tags
Filters active
Category:
Primitives
Framework
End-to-End
Research
Tag:
shazeer-2020
transformer
training
classification
attention
basics
cnn
generative
activation
metrics
embedding
diffusion
llm
loss
normalization
optimization
causal-lm
ddpm
decoding
neural-network
regression
regularization
vit
bert
decoder
fine-tuning
inference
linear-algebra
mlm
nlp
position-encoding
preprocessing
project
rnn
seq2seq
sequence-model
softmax
tokenization
autograd
convolution
cross-attention
encoder-decoder
gpt
gradient-descent
jax.grad
parameter-efficient
recurrent
rope
self-attention
sgd
training-loop
vae
adam
beam-search
bpe
broadcasting
calibration
distributed
efficiency
ema
feature-engineering
Show more tags
Sort:
Title
Easiest first
Hardest first
Recently added
Showing 1 of 1
Title
Difficulty
Category
Tags
SwiGLU Activation
Medium
Research
swiglu
glu
shazeer-2020
activation
llm