Todd A. Jacobs on Nostr: This weekend I learned that #NAS systems like #TrueNAS are less limited by network ...
This weekend I learned that #NAS systems like #TrueNAS are less limited by network bandwidth than by their #SATA backplanes. I'm only getting sustained SATA speeds of 400 MB/s over a 10 Gbps link when running unquantized #LLM models. That's unusable.
I'd expect a 10-wide RAIDZ2 vdev to provide better read performance than that, but apparently not with my current setup. I'm not yet convinced that an #iXsystems SATA enclosure would do any better.
Published at
2025-01-13 00:53:48Event JSON
{
"id": "80106e06f3ecf18ccd9e2aafa99ee7cdf27681339616e1f36e399167271b135b",
"pubkey": "08cb17e1c3e142683a9d11ccf1e9dfae2ec79d7e7d1cfcd73c933f646fcac0d3",
"created_at": 1736729628,
"kind": 1,
"tags": [
[
"t",
"nas"
],
[
"t",
"truenas"
],
[
"t",
"sata"
],
[
"t",
"LLM"
],
[
"t",
"ixsystems"
],
[
"proxy",
"https://ruby.social/users/todd_a_jacobs/statuses/113818312930234612",
"activitypub"
]
],
"content": "This weekend I learned that #NAS systems like #TrueNAS are less limited by network bandwidth than by their #SATA backplanes. I'm only getting sustained SATA speeds of 400 MB/s over a 10 Gbps link when running unquantized #LLM models. That's unusable.\n\nI'd expect a 10-wide RAIDZ2 vdev to provide better read performance than that, but apparently not with my current setup. I'm not yet convinced that an #iXsystems SATA enclosure would do any better.",
"sig": "8d1c3fec5c248742367a29739f823ca32e28bb27c093be54171dc1234a2fcaf48400a8b4426adc4ab77250fb56f800bc129c258339d2eb7c6c39ff1a1c19d62f"
}
