Siirry offline-tilaan Player FM avulla!
Recurrent Neural Networks Learn to Store and Generate Sequences using Non-Linear Representations
Manage episode 435377411 series 3524393
The paper challenges the Linear Representation Hypothesis, showing that gated recurrent neural networks encode token sequences using magnitude rather than direction, suggesting broader interpretability in neural network research.
https://arxiv.org/abs//2408.10920
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1633 jaksoa
Manage episode 435377411 series 3524393
The paper challenges the Linear Representation Hypothesis, showing that gated recurrent neural networks encode token sequences using magnitude rather than direction, suggesting broader interpretability in neural network research.
https://arxiv.org/abs//2408.10920
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1633 jaksoa
Alle afleveringen
×Tervetuloa Player FM:n!
Player FM skannaa verkkoa löytääkseen korkealaatuisia podcasteja, joista voit nauttia juuri nyt. Se on paras podcast-sovellus ja toimii Androidilla, iPhonela, ja verkossa. Rekisteröidy sykronoidaksesi tilaukset laitteiden välillä.