@prxy-official/semantic-cache

Semantic Cache✓ Verified

Returns cached responses for semantically similar (not just identical) requests. Embeds the request, vector-searches past requests, replays the cached response if similarity is above threshold.

cachev1.0.0MITcloudlocal#cache#embeddings#vector-search#latency

Install

# Cloud
PRXY_PIPE=mcp-optimizer,semantic-cache,@prxy-official/semantic-cache

# Local
# Built-in module — ships with the gateway, no install needed
PRXY_PIPE=mcp-optimizer,semantic-cache,@prxy-official/semantic-cache

Add this module to your PRXY_PIPE env var. The order matters — modules run left-to-right on each request.

Configuration

Schema: https://github.com/Ekkos-Technologies-Inc/prxy-monster/blob/main/packages/modules-core/src/semantic-cache.ts

Author

ekkOS Technologies Inc. · @Ekkos-Technologies-Inc