Batch GenAI framework at enterprise scale
Architected a batch GenAI framework that processes 50K+ daily call and chat transcripts, extracting churn drivers and risk signals via agentic workflows and surfacing results in a generative chat UI for natural-language search and triage. Cut batch runtime from 6h to 2h and trimmed LLM cost materially through prompt compression, tiered routing, and aggressive caching.
- Python
- LangGraph
- AWS Bedrock
- Postgres
- Redis
- Step Functions