Running a 1.5M-Parameter NLP Model in WebAssembly Under 10ms
I got tired of waiting 500ms every time I typed something into my app's command bar. When you just want to type "Algorithms exam tomorrow at 9am" and hit Enter, sending a request to a cloud…