You can probably try RTX3060 as it is one of the best price/performance consumer GPU. It has 12GB VRAM enough to run LLM with some 13B model and under

Reply to this note

Please Login to reply.

Discussion

No replies yet.