NLP News

Home
Blog
Archive
About
New
Top
April 2022
PaLM 🌴, DALL-E 2 👨‍🎨, Chinchilla 🐭, Chain-of-thought prompting ⛓💭✍️, Values and Culture in NLP 🏛
Hi all,This newsletter covers PaLM, DALL-E 2, and Chinchilla, chain-of-thought prompting, and the role of values and culture in NLP.This edition is…
 • 
Sebastian Ruder
January 2022
Highlights, new tasks & graph ML in 2021; Safer pre-trained models; Embeddings: Larger ≠ better
Hi all,I hope you've had a good start to the new year. This newsletter covers my and others' highlights of 2021. I also discuss recent pre-trained…
 • 
Sebastian Ruder
November 2021
Pre-training + Massive Multi-tasking, Benchmarking in NLP, EMNLP primer, 🤗 NLP Course, ACL 2021 recap,
Hi all, First off, some personal news: I've moved from DeepMind to Google Research this week. Because of this move, the past months have been quite…
 • 
Sebastian Ruder
August 2021
ICML round-up, Open collaboration, CLIP art, Internet augmentation, New GLUE-style benchmarks
Hi all,This newsletter covers some of my favourite papers from ICML 2021, a discussion of open collaboration, art generated by the CLIP model, how to…
 • 
Sebastian Ruder
July 2021
GitHub Copilot, The Perceiver, Beyond the Transformer, Data augmentation, NL augmenter 🦎 → 🐍, Research communication
Hi all,This newsletter is a bit delayed. I had to skip the last one as I had to take a break after a busy period in the end of May (EMNLP and NeurIPS…
 • 
Sebastian Ruder
May 2021
EACL, ICLR, NAACL papers round-up, Research reality checks, ML on code
Hi there,I've spent the last days catching up on papers—before inevitably falling behind again once ACL papers are released. With EACL just behind us…
 • 
Sebastian Ruder
April 2021
ICLR 2021 Outstanding Papers, Char Wars, Speech-first NLP, Virtual conference ideas
Hi there,I hope you've had the chance to take some time off and relax recently. Here in the UK, things are starting to look up: the weather is getting…
 • 
Sebastian Ruder
March 2021
QA—how did we get here? 🙋‍♀️, Adapting to time ⏳, Data detectives 🕵️‍♀️
Hi all,A struggle for me these days is the lack of human connection and interaction. I think this is especially challenging for students without an…
 • 
Sebastian Ruder
February 2021
IE—how did we get here?, Large LMs, The human side of ML
Hi all,I hope you've had a good start to the new year. This newsletter is a bit delayed due to a confluence of conference deadlines. Whether you're…
 • 
Sebastian Ruder
December 2020
EMNLP 2020 recap, Minimum viable datasets, Efficiency, Roguelikes for RL Research
Hi all,I sincerely hope that this year was an extreme outlier and that 2021 will be again more in-distribution. I hope you have time to relax and spend…
 • 
Sebastian Ruder
November 2020
EMNLP 2020 & ICLR 2021, Toxicity detection, Data augmentation and adversarial examples
Hi all,With EMNLP 2020 coming up next week and ICLR 2021 reviews just out, this newsletter contains a primer on interesting papers for both. In…
 • 
Sebastian Ruder
© 2023 Substack Inc
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing