Replying to Avatar utxo the webmaster šŸ§‘ā€šŸ’»

My main workstation has a 3090rtx and 64 gb of ram.

Just loading a few models into ram and doing inference and my hardware is already maxed out and lagging

Siigghhh AI is expensive
Avatar
CensorThis 2y ago

Which language(?) are you using?

Reply to this note

Please Login to reply.

Discussion

Avatar
utxo the webmaster šŸ§‘ā€šŸ’» 2y ago

Mix of python and rust

Avatar
CensorThis 2y ago

I guess Iā€™m asking which LLM are you using? Llama etc.

(Iā€™m new to this and learning).

How easy is it to create a non-cloud based AI for personal or company use?

nostr:npub1cmmswlckn82se7f2jeftl6ll4szlc6zzh8hrjyyfm9vm3t2afr7svqlr6f