Projects
Testing Generalization Bounds: How Good Is Theory in Practice?
February 2024Here, I test how the mathematical theory of generalization bounds works in practice.
Language Transformer Implementation
November 2024Here, I implement a decoder-only language model using Pytorch, and I build a trainer to train the model on a shakespeare dataset.
Proximal Policy Optimization Implementation
February 2024Here, I implement PPO and show it working for breakout and cartpole.
Reinforcement Learning from Human Feedback Implementation
November 2024Here, I implement RLHF using my own transformer implementation and a simple policy gradient algorithm.
Computers are learning to do math, but can they learn to think along the way?
March 2024This is an opinion I wrote for the Journal of Undergraduate Science and Technology in Fall 2023. It details computer-assisted proofs from early computers to new technologies like language models.
CNN Classifier
June 2023Here, I use a CNN to classify cats and dogs and integrate it with a Flask web app.