JAX Performance & Distributed

Your learning sequence

1. 1 Not solved yet.○ jit with static_argnums Practice · Medium
2. 2 Not solved yet.○ jit with static_argnames Practice · Easy
3. 3 Not solved yet.○ jit with donate_argnums Practice · Medium
4. 4 Not solved yet.○ jit with Pytree Input Practice · Easy
5. 5 Not solved yet.○ Explicit device_put Practice · Easy
6. 6 Not solved yet.○ block_until_ready for Sync Practice · Easy
7. 7 Not solved yet.○ Host Roundtrip via device_get Practice · Medium
8. 8 Not solved yet.○ make_jaxpr Inspection Practice · Medium
9. 9 Not solved yet.○ jit Retrace on Shape Change Practice · Medium
10. 10 Not solved yet.○ disable_jit Context Manager Practice · Medium
11. 11 Not solved yet.○ Mesh Creation Practice · Medium
12. 12 Not solved yet.○ PartitionSpec Basics Practice · Medium
13. 13 Not solved yet.○ NamedSharding (Replicated) Practice · Medium
14. 14 Not solved yet.○ shard_map Basics Practice · Hard
15. 15 Not solved yet.○ shard_map with psum Collective Practice · Hard
16. 16 Not solved yet.○ shard_map vs vmap Practice · Hard
17. 17 Not solved yet.○ bfloat16 Mixed Precision Practice · Medium
18. 18 Not solved yet.○ Explicit Dtype Promotion Practice · Easy
19. 19 Not solved yet.○ Elementwise Chains and Fusion Practice · Medium
20. 20 Not solved yet.○ with_sharding_constraint Practice · Hard
21. 21 Not solved yet.○ JIT with Input and Output Sharding Practice · Hard
22. 22 Not solved yet.○ Compilation Cache Key Practice · Medium
23. 23 Not solved yet.○ compilation_cache.set_cache_dir Practice · Medium
24. 24 Not solved yet.○ Shape Polymorphism (Concept) Practice · Medium
25. 25 Not solved yet.○ Multi-Host JAX (Conceptual) Practice · Hard

jax.devices()
jax.default_backend()
jnp.ones(3).devices()