Projects, Work, & Experience

I rewrote llama3 inference forward pass and iteratively optimized it using kvcache, faster prefill methods, SDPA, and fused operations. Here are some demos from slow to fast:

Find code here

check out my worklog and code which got over 1000 readers!

emergent language is a relatively new field, and the long-term vision is to have agents communicate in some form close to natural language without any explicit instructions or programming.

I spent most of my time researching evals and metrics for emergent language, as well as some RL using MARLLib, and a little bit of linguistics too. I was part of a publication which was accepted to Autonomous Agents and Multi-Agent Systems journal. Read here.

This was a fully funded summer research internship.

worked on SmartLine, SmartFryer, and SmartEyes. very fun internship because I got to work with all kinds of hardware for the first time and learnt to solder, wire up electricals, and build mechanical prototypes using CAD.

I built the CAN Bus communication system for the robot so each part can communicate with each other before making a move, the weight sensing system to measure the weight of each ingredient, tested different motor profiles to dispense each ingredient smoothly, designed a few contraptions in CAD to hold the machine together and wired up all the electricals.

also led the SmartEyes project, which is a device to detect undercooked meats using thermal imaging.