Nostr Web Client

Should work with any NVIDIA card with Cuda drivers. When you say vGPU, what type of setup?

I built and tested it using the 3070 I have at my desk. I’ll go test it on an H200 now and report back.

Thanks for following up. With vGPU it's nvidia grid virtual gpu. So it's a pair of tesla p100s with a "custom" gpu profiles into virtual machines. If you're unfamiliar it requires nvidia proprietary driver distributions to work. All drivers and guest software (usermode executable etc) come packaged together. and I don't see the toolkit bundled with it.

That said I also am unfamiliar with the toolkit on linux. Not sure if it's available through standard dnf distribution channels. Specifically rhel.

Reply to this note

Please Login to reply.

Discussion

Ross 1mo ago 💬 1

Not totally sure about RHEL but I bet we can get it figured out.

When you run nvcc —version does it fail?

RHEL packages appear to be publicly available without any sort of restrictions

https://developer.download.nvidia.com/compute/cuda/repos/rhel8/x86_64/cuda-rhel8.repo

https://developer.download.nvidia.com/compute/cuda/repos/rhel9/x86_64/cuda-rhel9.repo

ChipTuner 1mo ago 💬 1

nvcc is not available on the system. Yeah the other issue is that I'm forced to use a really old driver and older kernel. So the target machine specifically is running rocky 9 with kernel 6.14 on driver 550.163 with cuda 12.4. It looks like the toolkits available from those links you shared require cuda 13 or newer. I think I have to find an old package.

Ross 1mo ago 💬 1

Found this which sounds like it might match your setup

https://developer.download.nvidia.com/compute/cuda/12.4.1/local_installers/cuda-repo-rhel9-12-4-local-12.4.1_550.54.15-1.x86_64.rpm

ChipTuner 1mo ago 💬 1

Thanks for sharing those links, it means I just need to look harder! I've had better luck using the .run self contained files than the rpm packages (I don't think nvidia actually tests them XD)

Ross 1mo ago

You bet, not a problem. If you get them installed all you would need to do is update the makefile to CCAP=60 and set NOSTR_BLOCKS_PER_GRID = 1120 in GPURummage.h