3 comments

  • tombert0 minutes ago
    I have four old 24gb Nvidia cards. They&#x27;re not great but they&#x27;re not useless either. The problem is that I haven&#x27;t really figured out a good way to actually use them.<p>Genuine question; would anyone here recommend any specific motherboard to best utilize these cards?
  • gosub1001 minute ago
    It doesn&#x27;t cover risk. If one or more gpus dies, who pays for it? If you rent, you are guaranteed to be insulated from this risk. But owning, you might not have the best return policy from the vendor. And if you are actually at fault for breaking it, they have every right to deny a return. Or if your apartment is burglarized or catches fire (possibly from overloading the circuit) you are out the entire investment.
  • doctorpangloss13 minutes ago
    &gt; Because of this I got a motherboard with slow GPU interconnect. It’s good for running many small experiments in parallel (which is my main use case) but horrible for any models split across gpus.<p>:( you paid a professional pc builder and you weren&#x27;t told this?
    • CamperBob23 minutes ago
      Consumer motherboards can still make sense, even if you leave some performance on the table. Running an actual 8x GPU server is not something you&#x27;d want to do in an apartment. Imagine the old Lucasfilm &quot;THX&quot; trailer where an unearthly-sounding foghorn whine rises to a sweeping crescendo at reference level, only without the decay at the end.<p>At the time he put this rig together, there weren&#x27;t a lot of open-weight LLMs that could run well on 6x48=288 GB, so it probably wasn&#x27;t a huge loss.<p>Right now I&#x27;m in the process of cramming Blackwell cards into an old DDR4-based Milan server, where the important thing is to be able to run large models at all.
    • ginko9 minutes ago
      Don&#x27;t those Ada 6000 GPUs support NVLink? I think I can even see the cover for the connectors in OP&#x27;s pic.<p>edit: Hm, finding mixed information online on whether that&#x27;s still supported or not. Apparently it was removed in workstation GPUs.
      • mciancia4 minutes ago
        Nope, they don&#x27;t support it. And afair even if they did, you would be limited to connecting only in pairs, not all 6 together