I'd love to visit your house then. You have 768-1400 GB DRAM with 6000 GB/s memo... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

morphle on Jan 29, 2025 | parent | context | favorite | on: Complete hardware and software setup for running D...

I'd love to visit your house then. You have 768-1400 GB DRAM with 6000 GB/s memory bandwidth? Nice house.

In my house I currently have almost 900 GB/S memory bandwidth in aggregate but only 132 GB total DRAM.

rainclouds on Jan 30, 2025 [–]

I’ve got a terabyte of DDR4, and a bunch of old thread rippers. They can take 256 each and 8 channel.

morphle on Jan 30, 2025 | [–]

Yep, that's the right stuff. Now simply cross-connect all the free PCIe lanes of all thread rippers and you have a nice cluster for LLMs.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact