Addy Osmani is promoting Redis’s LangCache as a way to reduce the cost of repeated AI requests. In a post marked #ad, Osmani claims that agents consume roughly four times as many tokens as chat interactions and that semantic caching can reduce API costs by “up to 90%,” according to Redis.
The post presents repeated questions as a major source of token spending in production AI systems. LangCache is described as a managed layer for semantic caching, though the post does not establish whether the quoted savings apply broadly across different workloads.
Several replies questioned how caching would handle requests that depend on changing context. Dipankar Kumar Singh asked whether the approach could “break the prefix” when a model needs to receive previous context again. Mahmoud expressed concern that cached responses could produce poor results by losing relevant context.
Other replies focused on measuring the risks. Mikhail Rogov asked how teams could identify an incorrect semantic cache match, warning that “one wrong match can make that 90% saving expensive.” Punit Sethi similarly asked about observability for evaluating cache quality.
The discussion also distinguished lower token usage from persistent memory. One reply characterized the approach as “the bill version of agents with amnesia,” arguing that caching may reduce costs without giving an agent a lasting model of an individual user. Another commenter emphasized Osmani’s four-times estimate, suggesting that agents repeatedly process the same context across turns.
Source: Addy Osmani on X
