High-Scale Pricing & Search API
150K+ daily queries • 15M+ records • <100ms P95
The Challenge
Searching 15M+ records is error-prone — users misspell names, use partial terms, and search across multiple fields. The API must serve both humans expecting instant responses and automated scripts making 100K+ calls with minimal total runtime.
The Solution
Distributed WebAPI serving 15M+ trading-card records with sub-100ms P95 latency via Elasticsearch.
Real-time CDC pipelines (Debezium/Kafka) stream mutations into Postgres + ES with staged imports and automatic rollback on validation errors.
Role
Lead architect & sole developer — system design, CDC pipelines, performance profiling, observability.
Tech Stack
- 150K+ queries served daily
- 83% reduction in indexing latency
- Zero timeout failures post-migration