Semiconductor Engineering

Lower Energy, High Performance LLM on FPGA Without Matrix Multiplication

A new technical paper titled “Scalable MatMul-free Language Modeling” was published by UC Santa Cruz, Soochow University, UC Davis, and LuxiTech. “Matrix multiplication (MatMul) typically dominates ...
Ars Technica

Researchers upend AI status quo by eliminating matrix multiplication in LLMs

Researchers claim to have developed a new way to run AI language models more efficiently by eliminating matrix multiplication from the process. This fundamentally redesigns neural network operations ...
VentureBeat

New Transformer architecture could enable powerful LLMs without GPUs

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now Matrix multiplications (MatMul) are the ...
news.ucsc

Researchers run high-performing large language model on the energy needed to power a lightbulb

Large language models such as ChaptGPT have proven to be able to produce remarkably intelligent results, but the energy and monetary costs associated with running these massive algorithms is sky high.