2024
Gemini 1.5: Unlocking Multimodal Understanding Across Millions of Tokens of Context
Technical Report
AI Researcher
Member of Technical Staff at Anthropic, working on Claude inference and performance.
About
I am a member of technical staff at Anthropic, working on inference. Previously, I was a machine learning engineer at Google, working on Gemini finetuning and inference. Before that, I did my PhD in machine learning at UT Austin, advised by Prof. Mingyuan Zhou, where I did research in backpropagating through discrete variables in deep learning.
In my free time I like to read mostly non-fiction, and on rare occasions interview people about their work. You can watch my interview with Scott Aaronson on LLM watermarking, or read my interview with Richard Dawkins on the future of religion & skepticism.
Selected Publications
2024
Technical Report
2023
Technical Report
2021
NeurIPS: Neural Information Processing Systems
2021
ICML: International Conference on Machine Learning
Member of Technical Staff
Inference and performance for Claude and its safeguards.
Senior Machine Learning Engineer
Gemini finetuning and inference for teams across Alphabet.
PhD in Machine Learning
Dissertation on gradient estimation for discrete variables via dependent Monte Carlo samples. Advised by Prof. Mingyuan Zhou.
Dialogues
LLM Watermarking
A deep dive into the technical and philosophical challenges of watermarking large language model outputs, exploring the intersection of cryptography and AI safety.
Watch InterviewReligion & Skepticism
An exploration of the future of religion and skepticism with one of the world's most influential evolutionary biologists and public intellectuals.
Read InterviewStuff I like