Update README.md
Browse files
README.md
CHANGED
|
@@ -21,12 +21,13 @@ This is a landing page for **Gemma Scope**, a comprehensive, open suite of spars
|
|
| 21 |
- https://huggingface.co/google/gemma-scope-9b-it-res
|
| 22 |
- https://huggingface.co/google/gemma-scope-2b-pt-transcoders
|
| 23 |
|
| 24 |
-
[This tutorial](https://colab.research.google.com/drive/17dQFYUYnuKnP6OwQPH9v_GSYUW5aj-Rp?ts=66a77041) has instructions on how to load the SAEs.
|
| 25 |
|
| 26 |
# Key links:
|
| 27 |
|
| 28 |

|
| 29 |
- Check out the [interactive Gemma Scope demo](https://www.neuronpedia.org/gemma-scope) made by [Neuronpedia](https://www.neuronpedia.org/).
|
|
|
|
| 30 |
- Learn more about Gemma Scope in our [Google DeepMind blog post](https://deepmind.google/discover/blog/gemma-scope-helping-the-safety-community-shed-light-on-the-inner-workings-of-language-models).
|
| 31 |
- Check out our [Google Colab notebook tutorial](https://colab.research.google.com/drive/17dQFYUYnuKnP6OwQPH9v_GSYUW5aj-Rp?ts=66a77041) for how to use Gemma Scope.
|
| 32 |
- Read [the Gemma Scope technical report](https://arxiv.org/abs/2408.05147).
|
|
|
|
| 21 |
- https://huggingface.co/google/gemma-scope-9b-it-res
|
| 22 |
- https://huggingface.co/google/gemma-scope-2b-pt-transcoders
|
| 23 |
|
| 24 |
+
[This tutorial](https://colab.research.google.com/drive/17dQFYUYnuKnP6OwQPH9v_GSYUW5aj-Rp?ts=66a77041) has instructions on how to load the SAEs, and [this tutorial] explains and implements JumpReLU SAE training in PyTorch and JAX.
|
| 25 |
|
| 26 |
# Key links:
|
| 27 |
|
| 28 |

|
| 29 |
- Check out the [interactive Gemma Scope demo](https://www.neuronpedia.org/gemma-scope) made by [Neuronpedia](https://www.neuronpedia.org/).
|
| 30 |
+
- (NEW!) We have a colab notebook tutorial for JumpReLU SAE training in JAX and PyTorch [here](https://colab.research.google.com/drive/1PlFzI_PWGTN9yCQLuBcSuPJUjgHL7GiD).
|
| 31 |
- Learn more about Gemma Scope in our [Google DeepMind blog post](https://deepmind.google/discover/blog/gemma-scope-helping-the-safety-community-shed-light-on-the-inner-workings-of-language-models).
|
| 32 |
- Check out our [Google Colab notebook tutorial](https://colab.research.google.com/drive/17dQFYUYnuKnP6OwQPH9v_GSYUW5aj-Rp?ts=66a77041) for how to use Gemma Scope.
|
| 33 |
- Read [the Gemma Scope technical report](https://arxiv.org/abs/2408.05147).
|