Projects, Work, & Experience

I rewrote llama3 inference forward pass and iteratively optimized it using kvcache, faster prefill methods, SDPA, and fused operations. Here are some demos from slow to fast:

Find code here

on an NDA so can't say much. but i'm doing an apprenticeship @ Bloomberg.

check out my worklog and code which got over 1000 readers!

emergent language is a relatively new field, and the long-term vision is to have agents communicate in some form close to natural language without any explicit instructions or programming.

I spent most of my time researching evals and metrics for emergent language, as well as some RL using MARLLib, and a little bit of linguistics too. I was part of a publication which was accepted to Autonomous Agents and Multi-Agent Systems journal. Read here.

also had a lot of fun in Germany, explored castles, developed a pretzel addiction, hiked the bavarian alps, became a porsche lover and learned some German :D
and this was a fully funded summer research internship.

worked on SmartLine, SmartFryer, and SmartEyes. very fun internship because I got to work with all kinds of hardware for the first time and learnt to solder, wire up electricals, and build mechanical prototypes using CAD.

I built the CAN Bus communication system for the robot so each part can communicate with each other before making a move, the weight sensing system to measure the weight of each ingredient, tested different motor profiles to dispense each ingredient smoothly, designed a few contraptions in CAD to hold the machine together and wired up all the electricals.

also led the SmartEyes project, which is a device to detect undercooked meats using thermal imaging.

best experience you can give yourself is to travel, with friends, strangers or solo. during this time I also travelled to Portugal, Paris, Italy, Switzerland, Amseterdam, Budapest, Mallorca and more. I've written a series of blogs about my experiences, and a piece on the art of living in Spain.