Ashish Vaswani
Ashish Vaswani (born 1986) is an Indian computer scientist and artificial intelligence researcher. He is best known as the first author of the seminal 2017 paper "Attention Is All You Need", which introduced the Transformer neural network architecture. This architecture has become the foundational building block for nearly all modern large language models (LLMs), including those powering systems like ChatGPT, BERT, and many others.
Vaswani is the co-founder and CEO of Essential AI, a company focused on building open, powerful AI systems to solve complex real-world challenges.
Early life and education
[edit]Vaswani was born in India in 1986. He spent part of his childhood in Oman before his family moved to Nagpur when he was 15. He developed an early interest in science and mathematics.
He earned a Bachelor's degree in Computer Science and Engineering from the Birla Institute of Technology, Mesra. He later moved to the United States, completing a Master's degree and a Ph.D. in Computer Science at the University of Southern California (USC). His doctoral advisors were Liang Huang and David Chiang. During his Ph.D., he conducted research at the Information Sciences Institute at USC, with a focus on natural language processing and machine translation.
Career
[edit]After completing his Ph.D., Vaswani joined Google Brain, where he worked as a research scientist for more than six years. At Google, he contributed to advancements in natural language processing and deep learning.
In 2017, while at Google Brain, Vaswani led the team that published "Attention Is All You Need." The paper proposed replacing recurrent and convolutional layers with a purely attention-based mechanism, enabling greater parallelism, faster training, and superior performance on sequence transduction tasks such as machine translation.
In 2021–2022, Vaswani co-founded Adept AI with Niki Parmar and other colleagues, focusing on training neural networks to perform practical tasks and actions. He served as Co-Founder and Chief Scientist.
In late 2022/early 2023, Vaswani and Parmar left Adept to found Essential AI. As CEO, Vaswani leads the company in developing frontier AI models with an emphasis on openness, collaboration, and solving humanity's biggest challenges through advanced reasoning systems. Essential AI has raised significant funding and collaborates on hardware platforms such as AMD Instinct GPUs.
Contributions
[edit]Vaswani's primary contribution is the Transformer architecture, which uses self-attention mechanisms to process entire sequences in parallel rather than sequentially. This breakthrough addressed key limitations of previous models (RNNs and LSTMs), dramatically improving scalability and performance.
The Transformer has since been adapted for:
- Natural language processing (NLP)
- Computer vision (Vision Transformers)
- Multimodal tasks
- Image and music generation
- Scientific applications (e.g., DNA sequence analysis)
His earlier work during his Ph.D. included research on unsupervised word alignment for machine translation.
As of 2026, Vaswani continues to advocate for open science approaches in AI development.
Awards and recognition
[edit]- Best Paper Award at the Information Sciences Institute Graduate Research Symposium (2010)
- Best Paper Award at the 25th Army Science Conference (2006)
- S. Chandrasekhar Rising Indian Diaspora Scientist Award
The "Attention Is All You Need" paper has received over 200,000 citations, making it one of the most influential works in modern artificial intelligence.
Personal life
[edit]Vaswani is based in the San Francisco Bay Area. He maintains a relatively low public profile compared to many AI leaders, focusing on technical research and building teams for ambitious challenges.