Projects

GitHub Logo
Generalization Bounds Image

Testing Generalization Bounds: How Good Is Theory in Practice?

February 2024

Here, I test how the mathematical theory of generalization bounds works in practice.

Language Transformer Image

Language Transformer Implementation

November 2024

Here, I implement a decoder-only language model using Pytorch, and I build a trainer to train the model on a shakespeare dataset.

PPO Project Image

Proximal Policy Optimization Implementation

February 2024

Here, I implement PPO and show it working for breakout and cartpole.

RLHF Project Image

Reinforcement Learning from Human Feedback Implementation

November 2024

Here, I implement RLHF using my own transformer implementation and a simple policy gradient algorithm.

Opinion Piece Image

Computers are learning to do math, but can they learn to think along the way?

March 2024

This is an opinion I wrote for the Journal of Undergraduate Science and Technology in Fall 2023. It details computer-assisted proofs from early computers to new technologies like language models.

CNN Classifier Image

CNN Classifier

June 2023

Here, I use a CNN to classify cats and dogs and integrate it with a Flask web app.