I don't know shit about shit but went with a 4060ti with 16gb of ram for just dipping my toes in and dropping a fortune. Been running some of the lower parameter R1s and coder models with good speed.
nostr:nprofile1qqstnem9g6aqv3tw6vqaneftcj06frns56lj9q470gdww228vysz8hqpzdmhxue69uhkzmr8duh82arcduhx7mn9qy2hwumn8ghj7etyv4hzumn0wd68ytnvv9hxgqgdwaehxw309ahx7uewd3hkcam28zl what GPU are you running in your AI rig? I am trying to fine tune a model and the lack of adequate VRAM is really making this difficult.
Discussion
No replies yet.