Looks like multiple vendors are seeling these:<p><a href="https://www.gigabyte.com/in/Enterprise/Tower-Server/W775-V10-L01" rel="nofollow">https://www.gigabyte.com/in/Enterprise/Tower-Server/W775-V10...</a><p><a href="https://www.msi.com/Landing/NVIDIA-DGX-STATION" rel="nofollow">https://www.msi.com/Landing/NVIDIA-DGX-STATION</a>
252GB of HBM3e at 100k vs. a multi A6000 96GB setup.
GB300 seem expensive in comparison at ~$100k. Am I missing something?
> a Kensington slot<p>I think you might need a bit more than that at this price point ...
But can it run crysis?
How many arms and legs does one of these cost?
Can I get 32 GB of RAM for a sane price instead?
>> 252GB of HBM3e at 7.1TB/s,<p>So it has only 256GB of actual ”AI” memory making it “useless”/toy for actual real world AI workloads(I.e it can’t replace something like opus 5)
I don't know about "useless" (it seems quite useful to me) but I do feel mislead. It's unified memory in the same way that my current dGPU has unified memory. I guess nvlink-c2c probably (?) doesn't introduce a bottleneck but it's still two distinct arenas with very different performance characteristics.
Should work just fine for MoE models where active set fits into 252GB.
I guess I'm too poor to even know the price
Imagine a beowolf cluster of these!
[dead]
[dead]
Furious<p>What is it with those stupid names?<p>No price, so of course this is not for the smelly working class.