Nostr Web Client

With 48GB RAM. The food benchmark takes 38 seconds, but towards the end it uses a bunch of swap. I have about 6 GB of other stuff eating my RAM and didn't try pruning that yet.

With quantize 8 it fits in memory and takes 33 seconds.

Sjors Provoost 1y ago

"Death Star construction" with the default 4 steps took a minute. And no audible fans.

Reply to this note

Please Login to reply.

Discussion

jb55 1y ago

decent... im impressed that these few-step models work so well. the dev model takes like 20-25 diffusion iterations and is much slower... I haven't noticed a huge quality difference.

Sjors Provoost 1y ago

Hard to compare. This one is from the dev model, slightly different prompt, also quantized to 8. Took about 5 minutes.

Sjors Provoost 1y ago

20 steps