Alek Dimitriev

I’m a senior machine learning engineer at Google, working on Gemini finetuning and inference for teams across Alphabet, including a Nobel prize winner! I’ve been fortunate to work on a wide range of problems, ranging from multimodal capabilities augmentation, to both generative and non-generative tasks like text embedding, to automating model hyperparameters and sharding to improve training and inference efficiency.

In my free time I like to read mostly non-fiction, and on rare occassions interview people about their work. You can watch my interview with Scott Aaronson on LLM watermarking, or read my interview with Richard Dawkins on the future of religion & skepticism.

Before Google, I did my PhD in machine learning at the University of Texas at Austin, advised by Prof. Mingyuan Zhou, where my dissertation was focused on gradient estimation for discrete variables via dependent Monte Carlo samples. I also hold an M.Sc. and B.Sc. in computer science from the University of Ljubljana.

Selected papers:

Gemini 1.5: Unlocking Multimodal Understanding Across Millions of Tokens of Context

Gemini Team

Technical Report, Feb 2024

Bib PDF

@inproceedings{gemini2024v2,
  title = {Gemini 1.5: Unlocking Multimodal Understanding Across Millions of Tokens of Context},
  author = {Team, Gemini},
  booktitle = {Technical Report},
  year = {2024},
  month = feb,
  pdf = {https://arxiv.org/pdf/2403.05530},
  selected = {true},
  bibtex_show = {true}
}

Gemini: A Family of Highly Capable Multimodal Models

Gemini Team

Technical Report, Dec 2023

Bib PDF

@inproceedings{gemini2023v1,
  title = {Gemini: A Family of Highly Capable Multimodal Models},
  author = {Team, Gemini},
  booktitle = {Technical Report},
  year = {2023},
  month = dec,
  pdf = {https://arxiv.org/pdf/2312.11805},
  selected = {true},
  bibtex_show = {true}
}

CARMS: Categorical-Antithetic-REINFORCE Multi-Sample Gradient Estimator

Alek Dimitriev and Mingyuan Zhou

NeurIPS: Neural Information Processing Systems, Dec 2021

Bib PDF Code

@inproceedings{dimitriev2021carms,
  title = {CARMS: Categorical-Antithetic-REINFORCE Multi-Sample Gradient Estimator},
  author = {Dimitriev, Alek and Zhou, Mingyuan},
  booktitle = {NeurIPS: Neural Information Processing Systems},
  volume = {34},
  month = dec,
  year = {2021},
  pdf = {https://arxiv.org/pdf/2110.14002.pdf},
  code = {https://github.com/alekdimi/carms},
  selected = {true},
  bibtex_show = {true}
}

ARMS: Antithetic-REINFORCE-Multi-Sample Gradient for Binary Variables

Alek Dimitriev and Mingyuan Zhou

ICML: International Conference on Machine Learning, Jul 2021

Bib PDF Code

@inproceedings{dimitriev2021arms,
  title = {ARMS: Antithetic-REINFORCE-Multi-Sample Gradient for Binary Variables},
  author = {Dimitriev, Alek and Zhou, Mingyuan},
  booktitle = {ICML: International Conference on Machine Learning},
  pages = {2717--2727},
  year = {2021},
  editor = {Meila, Marina and Zhang, Tong},
  volume = {139},
  series = {Proceedings of Machine Learning Research},
  month = jul,
  publisher = {PMLR},
  pdf = {https://arxiv.org/pdf/2105.14141.pdf},
  url = {https://proceedings.mlr.press/v139/dimitriev21a.html},
  code = {https://github.com/alekdimi/arms},
  selected = {true},
  bibtex_show = {true}
}