jb55 on Nostr: I imagined it like a Fourier transform. Distilling individual features from a ...
I imagined it like a Fourier transform. Distilling individual features from a combined signal shared between multiple neurons.
The reason you need to do this is the superposition hypothesis: that multiple neurons are encoding more features than just the orthogonal vectors.
Published at
2024-11-20 03:42:32Event JSON
{
"id": "0ef3fa603c0510b40877a6838f44600c336715fe4b0fe3218a1e08dfaf765797",
"pubkey": "32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245",
"created_at": 1732074152,
"kind": 1,
"tags": [
[
"e",
"86c27c56ba6be1d0f4e5f9b0591d41692aa6d853cbb1194dd3ae3e85799fa3a1",
"",
"root"
],
[
"e",
"72b6a866d642272ef385c8005e47d0c0f724bdc70a1adac3f01a58b7a7fca45a",
"",
"reply"
],
[
"p",
"54faff49016392b6f13bcce434e3db42d4e65baac4c815c8896251afd446f0e3"
]
],
"content": "I imagined it like a Fourier transform. Distilling individual features from a combined signal shared between multiple neurons.\n\nThe reason you need to do this is the superposition hypothesis: that multiple neurons are encoding more features than just the orthogonal vectors.",
"sig": "51e30d08f06cbd25b9af962f6eaa0b19d343afc3a70de325e56fbaa6ea5769ba94aa30c52e81b1be5a863a327d773985c936ed852f426737499d48d8467a1a55"
}
