I finally _almost_ got vgpu, mostly working. Man that's a process. Writing a little guide/blog now :)
Discussion
proxmox passthrough is also a pita
I add good luck with passthrough, I honestly didn't have to do anything at all to get it to work. I think I just had to blacklist the host driver and restart the modules. Even with the gpu upgrade, it was plug and play. But getting vgpu working + multi gpu + multi vm + gpu unlocking for custom buffer sizes was an affair. That and finding drivers that actually worked with various kernels Im using in my vms. Fedora obviously being bleeding edge.
maybe it's a vm vs lxc detail? this is my first proxmox box
Not sure, I've never tried to use GPU in lxc. I don't use lxc for anything but highly privileged internal applications. Like internal dns, or my hcp vault cluster. I might have just gotten lucky too XD
planning a 128 core ai box i decided it was time for qubes or proxmox. there's no monitor on it, so proxmox won
got it yeah! I need a new desktop rig, I need to be able to swap between OS in a click, many things I use run on windows, and plenty on linux. WSL was the solution, but I still need to use windows as a base OS which, we all know how that goes. I tried qubes out last night, but it's not for me. I lost access to my keyboard and mouse, read the memes on the support forum, and uninstalled it XD. I need things to work, and don't have time to fiddle, despite my desire to. Long story short, ill be installing Fedora KDE and using remote desktop for my experience I guess. That's why I wanted vgpu.
if you ever get tired of that box feel free to send it my way XD
lol, right? an os where the first step is to find a ps2 keyboard to log in with 🤣
Funny part, I have a ps2 keyboard hooked up at my desk at all times, but I was out in the workshop with an ankle injury so I was mad XD
The v100's are well behaved in general. Generally when it comes to NVIDIA "data center grade" stuff is less painful than cosumer grade stuff.
Other than their licensing system, at least there are ways around it for now.
Yeah. We had worse. I remember when I needed to spoof serials to be able to unlock features with consumer grade hardware. Can't say NVIDIA is my favourite company, but lately they are making so much money that they don't care anymore lol.
Looking forward to it :)