Feb 5, 20221 min readRetrieval-Enhanced Transformer (RETRO)Updated: Feb 10, 2022Augment transformers with retrieval over a database of text passages created by DeepMind.