I finally _almost_ got vgpu, mostly working. Man that's a process. Writing a little guide/blog now :)

Reply to this note

Please Login to reply.

Discussion

proxmox passthrough is also a pita

I add good luck with passthrough, I honestly didn't have to do anything at all to get it to work. I think I just had to blacklist the host driver and restart the modules. Even with the gpu upgrade, it was plug and play. But getting vgpu working + multi gpu + multi vm + gpu unlocking for custom buffer sizes was an affair. That and finding drivers that actually worked with various kernels Im using in my vms. Fedora obviously being bleeding edge.

maybe it's a vm vs lxc detail? this is my first proxmox box

Not sure, I've never tried to use GPU in lxc. I don't use lxc for anything but highly privileged internal applications. Like internal dns, or my hcp vault cluster. I might have just gotten lucky too XD

planning a 128 core ai box i decided it was time for qubes or proxmox. there's no monitor on it, so proxmox won

got it yeah! I need a new desktop rig, I need to be able to swap between OS in a click, many things I use run on windows, and plenty on linux. WSL was the solution, but I still need to use windows as a base OS which, we all know how that goes. I tried qubes out last night, but it's not for me. I lost access to my keyboard and mouse, read the memes on the support forum, and uninstalled it XD. I need things to work, and don't have time to fiddle, despite my desire to. Long story short, ill be installing Fedora KDE and using remote desktop for my experience I guess. That's why I wanted vgpu.

if you ever get tired of that box feel free to send it my way XD

lol, right? an os where the first step is to find a ps2 keyboard to log in with 🤣

Funny part, I have a ps2 keyboard hooked up at my desk at all times, but I was out in the workshop with an ankle injury so I was mad XD

also, yeah, it's an indulgent amount of hardware 😁 my excuse is that i need a car to get myself around the singularity 🤞

hey whatever works. I haven't been that enlightened yet XD

goose or claude code. i'm going with "vibe captain" these days

The v100's are well behaved in general. Generally when it comes to NVIDIA "data center grade" stuff is less painful than cosumer grade stuff.

Other than their licensing system, at least there are ways around it for now.

Yeah. We had worse. I remember when I needed to spoof serials to be able to unlock features with consumer grade hardware. Can't say NVIDIA is my favourite company, but lately they are making so much money that they don't care anymore lol.

Yup. The unfortunate part in commercial side of things, is that we need things that work, and work consistently, regardless of the price. So Nvidia wins, until someone can do better.

I'm keeping an eye on Chinese Hardware. Chinese GPUs are slowly happening.

Looking forward to it :)