The virtual ICLR 2021 conference showcases top deep learning research, featuring innovations like Vision Transformers that outperform convolutional networks. Key papers also introduce advances in object detection, language models, and neural link predictors.