We can't find the internet
Attempting to reconnect
Something went wrong!
Attempting to reconnect
Attention practice problems in JAX
Difficulty:
Category:
Tag:
Showing 13 of 13
| Status | Title | Difficulty | Category | Tags |
|---|---|---|---|---|
| ALiBi Position Bias | Medium | Research |
|
|
| Causal Attention Mask | Easy | Primitives |
|
|
| Causal Self-Attention Block | Medium | End-to-End |
|
|
| Cross-Attention Block | Medium | End-to-End |
|
|
| Efficient Attention with Masking | Hard | Framework |
|
|
| Flash Attention Score Computation | Hard | Research |
|
|
| Grouped-Query Attention | Hard | Research |
|
|
| Implement Positional Encoding | Hard | Primitives |
|
|
| Implement Scaled Dot-Product Attention | Hard | Primitives |
|
|
| Multi-Head Attention Block | Hard | End-to-End |
|
|
| Multi-Query Attention | Medium | Research |
|
|
| Relative Position Encoding | Medium | Research |
|
|
| Transformer Block with RoPE | Hard | End-to-End |
|