Nvidia’s new technique cuts LLM reasoning costs by 8x without losing accuracy

Nvidia researchers developed dynamic memory sparsification (DMS), a technique that compresses the KV cache in large language models by up to 8x while maintaining reasoning accuracy — and it can be ...

John Carmack proposes fiber-optic loops as high-speed AI cache

The thought experiment began with a number. Single-mode fiber optics can now transmit data at 256 terabits per second over 200 kilometers. Based on that capacity, ...
XDA Developers on MSN

AMD's 3D V-Cache is still the best gaming upgrade money can buy

Almost 4 years on, it's still the game-changer it used to be ...

'Observational memory' cuts AI agent costs 10x and outscores RAG on long-context benchmarks

As AI agents move into production, teams are rethinking memory. Mastra’s open-source observational memory shows how stable ...
Wall Street Journal

The Global Memory-Chip Shortage Will Cost Us All

If you had put all your savings into a few pallets of computer memory chips a year ago, you’d have at least doubled your money by now. And prices are projected to continue their meteoric rise.
Forbes

As AI Eats Up The World’s Chips, Memory Prices Take The Hit

Forbes contributors publish independent expert analyses and insights. Tim Bajarin covers the tech industry’s impact on PC and CE markets. This voice experience is generated by AI. Learn more. This ...
Los Angeles Times

Apple and others hit by surging memory prices

Soaring prices for memory and storage components have turned companies like Sandisk Corp., Micron Technology Inc. and Western Digital Corp. into the hottest stocks in the market over the last year.
The Atlantic

A Different Type of ‘Muscle Memory’

Before Adam Sharples became a molecular physiologist studying muscle memory, he played professional rugby. Over his years as an athlete, he noticed that he and his teammates seemed to return to form ...
CNBC

AI memory is sold out, causing an unprecedented surge in prices

This year, there won't be enough memory to meet worldwide demand because powerful AI chips made by the likes of Nvidia, AMD and Google need so much of it. Prices for computer memory, or RAM, are ...
Ars Technica

High RAM prices mean record-setting profits for Samsung and other memory makers

Supply shortages and big price increases for RAM and storage have been a major drag for enthusiasts and PC builders in recent months. And while we haven’t yet seen large, widespread price increases ...
Fast Company

Why is there a RAM shortage? AI demand and the mad scramble for memory chips could hit where it hurts

The stock prices of RAM and NAND manufacturers surged yesterday, with Micron Technology (Nasdaq: MU) up 10%, Sandisk Corporation (Nasdaq: SNDK) up 27%, Western Digital Corporation (Nasdaq: WDC) up 16% ...
Reuters

Memory chipmakers rise as global supply shortage whets investor appetite

Jan 5 (Reuters) - Shares of the world's top memory chip providers rose on Monday as investors bet on further price gains due to a global supply crunch driven by surging demand for ...