Personalized Agentic RAG System
Adaptive retrieval system with autonomous agents, iterative self-correction, and user memory over domain-specific knowledge bases (LangGraph, LangChain, FAISS).
Portfolio
Language-Guided Navigation Agent
A 0.5B-parameter language model that learns to follow natural-language navigation instructions and answer questions about what it finds - built with an RLHF-style recipe in miniature: LoRA SFT on BFS expert demonstrations, then REINFORCE with a KL penalty against a frozen reference.
RL Research Portfolio
Self-directed reinforcement-learning research: DQN reproductions from scratch, an end-to-end RLHF pipeline for a 0.5B language model, and a learned world model (MLP ensemble) with CEM planning that reaches 100% success on a PyBullet robot arm and stays robust where PPO fails.