Matrix multiplications are the central computational operations of deep learning or the special transformer architectures used by large language models such as GPT-3/4 or PaLM.

Researchers claim to have developed a new way to run AI language models more efficiently by eliminating matrix multiplication from the process. This fundamentally redesigns neural network ...