Skip to content
Cracked
AI
Problems
Tracks
Learn
PyTorch
Roadmap
Articles
Leaderboard
Search
Ctrl K
Mode:
PyTorch
PyTorch
JAX
Python
Rust
C++
PyTorch
JAX
Python
Rust
C++
Log in
Sign up
Problems
Tracks
Learn PyTorch
Articles
Roadmap
Leaderboard
Set up the runtime
Log in
Sign up
PyTorch
JAX
Python
Rust
C++
Radio
We can't find the internet
Attempting to reconnect
Something went wrong!
Attempting to reconnect
Glu practice problems in PyTorch
Search problems
Difficulty:
Easy
Medium
Hard
Category & tags
Filters active
Category:
Primitives
Framework
End-to-End
Research
Tag:
glu
transformer
training
classification
attention
basics
cnn
generative
activation
metrics
embedding
llm
decoding
diffusion
loss
normalization
optimization
bert
causal-lm
ddpm
mlm
neural-network
regression
regularization
vit
decoder
fine-tuning
inference
linear-algebra
nlp
position-encoding
preprocessing
project
rnn
seq2seq
sequence-model
softmax
tokenization
autograd
convolution
cross-attention
encoder-decoder
generation
gpt
gradient-descent
jax.grad
parameter-efficient
recurrent
rope
self-attention
sgd
training-loop
vae
adam
beam-search
bpe
broadcasting
calibration
distributed
efficiency
ema
Show more tags
Sort:
Title
Easiest first
Hardest first
Recently added
Showing 1 of 1
Title
Difficulty
Category
Tags
SwiGLU Activation
Medium
Research
swiglu
glu
shazeer-2020
activation
llm