Skip to content
Cracked
AI
Problems
Tracks
Learn PyTorch
Roadmap
Articles
Leaderboard
Search
Ctrl K
Mode:
PyTorch
PyTorch
JAX
Python
Rust
C++
PyTorch
JAX
Python
Rust
C++
Log in
Sign up
Problems
Tracks
Learn PyTorch
Articles
Roadmap
Leaderboard
Set up the runtime
Log in
Sign up
PyTorch
JAX
Python
Rust
C++
Radio
We can't find the internet
Attempting to reconnect
Something went wrong!
Attempting to reconnect
Shazeer 2020 practice problems in PyTorch
Search problems
Difficulty:
Easy
Medium
Hard
Category:
Primitives
Framework
End-to-End
Research
Tag:
shazeer-2020
transformer
training
classification
attention
basics
cnn
generative
activation
metrics
embedding
llm
decoding
diffusion
loss
normalization
optimization
bert
causal-lm
ddpm
mlm
neural-network
regression
regularization
vit
decoder
fine-tuning
inference
linear-algebra
nlp
position-encoding
preprocessing
rnn
seq2seq
sequence-model
softmax
tokenization
autograd
convolution
cross-attention
encoder-decoder
generation
gpt
jax.grad
parameter-efficient
recurrent
rope
self-attention
sgd
training-loop
vae
adam
beam-search
bpe
broadcasting
calibration
distributed
efficiency
ema
feature-engineering
gates
Show more tags
Sort:
Title
Easiest first
Hardest first
Recently added
Clear filters
Showing 1 of 1
Status
Title
Difficulty
Category
Tags
SwiGLU Activation
Medium
Research
swiglu
glu
shazeer-2020
activation
llm