Activations

From the classic non-linearities to modern gated activations. End with implementing a custom gradient.

1. 1. ○ Implement ReLU
2. 2. ○ Implement Sigmoid
3. 3. ○ Implement Tanh
4. 4. ○ Implement Leaky ReLU
5. 5. ○ GELU Activation
6. 6. ○ SwiGLU Activation
7. 7. ○ GLU Activation
8. 8. ○ Implement Softmax
9. 9. ○ Custom Activation with Gradient