I built
I run 30B 22tok/s, 109tok/s not novel,6GB/16GB RAM overcoming llama.cpp
Built by @hn:federicoTXTS · github.com/FedericoTs/quantprobe
2 people want it.
Who's asking for this
Want this too?
IwantIbuild is a demand board for indie builders. Search what you wish existed and find who already shipped it — or post the thing you built and watch the demand for it add up.
Find more tools like this →