Ashish Vaswani
Ashish Vaswani is an Indian computer scientist and entrepreneur, best known as the lead author of the 2017 paper that reshaped the landscape of machine learning models forever. Ashish Vaswani is an Indian computer scientist and entrepreneur. He conducted research at Google Brain, co-founded Adept AI, and, as of 2025, was co-founder and chief executive officer of Essential AI. Vaswani is a co-author of the 2017 paper "Attention Is All You Need," which introduced the Transformer neural network architecture.
Before Vaswani and his seven co-authors reimagined sequence modeling, the dominant approach to problems like Neural machine translation relied on recurrent neural networks and their gated cousin, Long short-term memory, often stitched together with Convolutions in elaborate Sequence to sequence learning pipelines. These architectures processed text step by step, a bottleneck that limited parallelism and made long-range dependencies difficult to learn.
The insight credited to the team — with Vaswani himself deeply involved in designing and implementing the first working models — was that Attention mechanisms alone, without any Recurrence or convolutional structure, could outperform the old guard. This gave rise to Self-attention as the sole computational engine of what the paper christened the Transformer.
The consequences rippled outward with startling speed. The Transformer became the backbone of BERT, GPT, GPT-3, T5, and eventually the large language models powering today's AI assistants, as well as non-text domains via the Vision transformer. Techniques like FlashAttention later optimized its core operation, while Mixture of experts and Low-rank adaptation extended its scaling and adaptability.
After his research years, Vaswani moved into entrepreneurship, co-founding Adept AI before launching Essential AI, continuing to chase the next architectural leap in the same spirit of bold simplicity that produced attention-only networks.