DIA 2021 Global Annual Meeting

Massive deep learning language models, such as BERT and GPT-3, have improved the state of the art on nearly every natural language processing task. Microsoft continues to advance this field and believe that better natural language generation can be transformational for a variety of life science applications. Microsoft Project Turing is introducing Turing Natural Language Generation (T-NLG), one of the largest models ever published at 17 billion parameters, which outperforms the state of the art on a variety of benchmarks and excels when applied to practical tasks in life sciences.