Replying to Avatar Guy Swann

That's my editing software, python was gobbling up the 36 GB of RAM, but was "idling" during this screenshot, hits about 40 GB when generating. I read that AL generally is super multithreaded, but it hardly ever uses more than 10-15, which I don't quite understand. I don't know enough specificity on when and why more threads is beneficial to know what's going on exactly.
Avatar
Jonathan 2y ago

Python’s memory usage is insane. In the words of Guido van Rossum, “It’s pointers all the way down.”

Something about the inefficiency messes with me. I’ve moved most of my code to Lua or Rust.

Btw, what model are you running?

Reply to this note

Please Login to reply.

Discussion

Avatar
Guy Swann 2y ago

In this picture I'm only running Stable Diffusion with the automatic1111 interface

Avatar
Sir Libre 2y ago

If I remember correctly torch was originally written in Lua, but people seem to like to code in python instead ☹️

Avatar
Jonathan 2y ago

You are remembering correctly. A lot of AI used to be in Lua, including a lot of DeepMind.