A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...
Five years ago, pioneering large language models (LLMs) like GPT and BERT had hundreds of millions of parameters. Today, Megatron-Turing Natural Language Generation (MT-NLP) has 530 billion parameters ...