ynniv on Nostr: > The first version is basically telling the CPU: "Hey, I'm going to read this memory ...
> The first version is basically telling the CPU: "Hey, I'm going to read this memory in order, you can prefetch the next cache line." While the second is more like: "Surprise! We're jumping to a random memory location! Again! And again!"
> It's amazing how many performance problems boil down to "stop making the CPU cache sad" 😆​​​​​​​​​​​​​​​​
See? The AI gets it
Published at
2024-11-10 17:52:20Event JSON
{
"id": "f3e2daf49d9cb5bab728c477332b0238e6d0ac889675eeb8dde0ebd4835c59b5",
"pubkey": "576d23dc3db2056d208849462fee358cf9f0f3310a2c63cb6c267a4b9f5848f9",
"created_at": 1731261140,
"kind": 1,
"tags": [
[
"e",
"4dd17a5577dc126a685411d1349b821db85d44c1732945f487d5417f183f117c",
"",
"root"
]
],
"content": "\u003e The first version is basically telling the CPU: \"Hey, I'm going to read this memory in order, you can prefetch the next cache line.\" While the second is more like: \"Surprise! We're jumping to a random memory location! Again! And again!\"\n\n\u003e It's amazing how many performance problems boil down to \"stop making the CPU cache sad\" 😆​​​​​​​​​​​​​​​​\n\nSee? The AI gets it",
"sig": "04e0039848c5b88054ecb97802b202fcdbbde38bdd06cdb3a2284c9344728f23227ba59ad1642440b03d618c4659f27c16f65e664cb7cddc47b093f8720f8339"
}
