MiniInfer
an inference engine built from scratch to understand the machinery behind LLM inference.
kshitij midha
software engineer who likes to understand things by building them.
i work mostly with Java and backend systems, and lately i've been going deeper into systems, machine learning, inference, performance engineering, and the machinery underneath abstractions.
now
- buildingMiniInfer
- learninginference, CUDA, systems
- exploringperformance and low-level software
selected projects
pdfctl
a command-line toolkit for PDF manipulation: merge, split, delete, rotate, and extract text.