Noam Shazeer

E457852

Noam Shazeer is an AI researcher and engineer best known as a co-creator of the Transformer architecture and a key contributor to large-scale neural language models.

All labels observed (1)

Label Occurrences
Noam Shazeer canonical 9

How this entity was disambiguated

Statements (45)

Predicate Object
instanceOf artificial intelligence researcher
computer scientist
person
software engineer
coAuthorOf Attention Is All You Need
Exploring the Limits of Language Modeling
On Layer Normalization in the Transformer Architecture
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
coAuthorWith Aidan N. Gomez
Ashish Vaswani
Illia Polosukhin
Jakob Uszkoreit
Llion Jones
Niki Parmar
Łukasz Kaiser
linked to: Lukasz Kaiser
contributedTo Google’s large-scale language models
Transformer architecture
developed Sparsely-Gated Mixture-of-Experts layer
Switch Transformer architecture
educatedAt Brown University
employer Google
Google Brain
Google Research
fieldOfWork artificial intelligence
large language models
machine learning
natural language processing
gender male
knownFor Mixture-of-Experts models
Sparsely-Gated Mixture-of-Experts layer
Switch Transformer
linked to: Transformer

Tensor Processing Unit software contributions
co-creating the Transformer architecture
contributions to large-scale neural language models
work on attention mechanisms in neural networks
nationality American
notableWork Sparsely-Gated Mixture-of-Experts layer
Switch Transformer model
Transformer architecture
linked to: Transformer
positionHeld research scientist at Google
researchInterest efficient training of large models
neural network architectures
scaling laws for neural networks
sequence modeling

How these facts were elicited

Referenced by (9)

Full triples — surface form annotated when it differs from this entity's canonical label.

Transformer introducedBy Noam Shazeer
Łukasz Kaiser notableStudent Noam Shazeer
subject linked to: Lukasz Kaiser
Łukasz Kaiser collaboratedWith Noam Shazeer
subject linked to: Lukasz Kaiser
T5 introducedBy Noam Shazeer
Attention Is All You Need hasAuthor Noam Shazeer
Ashish Vaswani coAuthorWith Noam Shazeer
Niki Parmar coAuthorWith Noam Shazeer
Jakob Uszkoreit hasCoAuthor Noam Shazeer
Aidan N. Gomez collaboratedWith Noam Shazeer