Cache Repeated Answers to Cut LLM Calls in a Small-Business FAQ Bot (Python + SQLite)
DEV · 15.11.2026 · 15:30
Small businesses get the same ten questions all day: opening hours, delivery areas, how to book. Sending each one to a language model is wasted money. A small cache is one of the simplest…