πŸ˜‚

Later this month I have to move a cluster I built from 36 tower PC’s and 100’s of meters of infiniband.

It’s amazing what you can do with a pallet of refurb. πŸ˜‰

Reply to this note

Please Login to reply.

Discussion

Infiniband sounds like Cisco

Mellanox

The cables cost more than the PC’s.

I needed to build a memory fabric and lots of sockets+infiniband was the most scalable way to do it.

Mellanox, crazy expensive cables, infiniband, so Cisco

Actually technically Mellanox was acquired by NVIDIA..

ever since nvidia acquired them

I seem to recall it was pretty expensive tech even before NVIDIA acquired them. I’m sure NVIDIA cranked up the price.

Yeah, cables are $1000s…

Interesting, I have ~100x of these lying around.

100x Mellanox cables? Basically used to connect and train supercomputers? Yeah, pretty sure they are holding value better than the dollar.

Yep, I have probably 500m - 1km of this stuff.

80 GB/s plus all the network cards and two switches.

When did they get that expensive? Bought some for maybe 200 a few years ago

I’ve seen them for $500-$1000 new from Mellanox

Same

I just remember we had to expense like 10 and it was many thousands of dollars, had to get special approvals..

Okay my cables were 100Gb/s, no splitter and definitely not 4m

Still, that’s a ridiculous price for a cable.

Just like the $65k switch