NLP News

Home
Blog
Support
Archive
About
New
Top
Discussion
🛠 Tool-Augmented LLMs
In this edition, we’ll explore tool use—arguably one of the hottest new capabilities of LLMs. We’ll look at types of tools, benefits of tool use, recent…
 • 
Sebastian Ruder
🤖🗣 Generative Agents, 🏛 Forums for Foundation Models
This newsletter discusses components for building generative agents and publication venues for large language models (LLMs).
 • 
Sebastian Ruder
✨ Flashier Attention, 🤐 Gzip Classifiers
This newsletter discusses attention that enables modeling long sequences and simple but surprisingly competitive classifiers such as based on gzip…
 • 
Sebastian Ruder
11
November 2022
April 2022
PaLM 🌴, DALL-E 2 👨‍🎨, Chinchilla 🐭, Chain-of-thought prompting ⛓💭✍️, Values and Culture in NLP 🏛
Hi all,This newsletter covers PaLM, DALL-E 2, and Chinchilla, chain-of-thought prompting, and the role of values and culture in NLP.This edition is…
 • 
Sebastian Ruder
January 2022
Highlights, new tasks & graph ML in 2021; Safer pre-trained models; Embeddings: Larger ≠ better
Hi all,I hope you've had a good start to the new year. This newsletter covers my and others' highlights of 2021. I also discuss recent pre-trained…
 • 
Sebastian Ruder
November 2021
Pre-training + Massive Multi-tasking, Benchmarking in NLP, EMNLP primer, 🤗 NLP Course, ACL 2021 recap,
Hi all, First off, some personal news: I've moved from DeepMind to Google Research this week. Because of this move, the past months have been quite…
 • 
Sebastian Ruder
August 2021
ICML round-up, Open collaboration, CLIP art, Internet augmentation, New GLUE-style benchmarks
Hi all,This newsletter covers some of my favourite papers from ICML 2021, a discussion of open collaboration, art generated by the CLIP model, how to…
 • 
Sebastian Ruder
July 2021
GitHub Copilot, The Perceiver, Beyond the Transformer, Data augmentation, NL augmenter 🦎 → 🐍, Research communication
Hi all,This newsletter is a bit delayed. I had to skip the last one as I had to take a break after a busy period in the end of May (EMNLP and NeurIPS…
 • 
Sebastian Ruder
May 2021
EACL, ICLR, NAACL papers round-up, Research reality checks, ML on code
Hi there,I've spent the last days catching up on papers—before inevitably falling behind again once ACL papers are released. With EACL just behind us…
 • 
Sebastian Ruder
April 2021
ICLR 2021 Outstanding Papers, Char Wars, Speech-first NLP, Virtual conference ideas
Hi there,I hope you've had the chance to take some time off and relax recently. Here in the UK, things are starting to look up: the weather is getting…
 • 
Sebastian Ruder
March 2021
QA—how did we get here? 🙋‍♀️, Adapting to time ⏳, Data detectives 🕵️‍♀️
Hi all,A struggle for me these days is the lack of human connection and interaction. I think this is especially challenging for students without an…
 • 
Sebastian Ruder
© 2023 Sebastian Ruder
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing