XCENA raises $135M for its computational memory controller

XCENA Inc., a startup with a memory device designed to speed up artificial intelligence clusters, today announced that it has raised $135 million in funding. The Series B round was led by Korean funds ...

Silicon Motion Introduces Advanced AI-Optimized SM2524XT PCIe Gen5 DRAMless SSD Controller for AI PCs

Silicon Motion Technology Corporation (NasdaqGS: SIMO), a global leader in NAND flash controllers for solid-state storage ...
VentureBeat

How attention offloading reduces the costs of LLM inference at scale

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Rearranging the computations and hardware used to serve large language ...
EDN

The hidden bottleneck in LLM inference and the impact on MLPerf benchmarking

Here is how the prefill versus generation split exposes GPU structural inefficiencies in AI processor designs.
XDA Developers on MSN

I tried a new 8B local LLM, and its design might be the biggest shift since DeepSeek R1

Zaya1-8B is a huge shift in LLMs, and the results are impressive.
Semiconductor Engineering

Four-Tier Memory Hierarchy for LLM Reasoning (USC, UW)

A new technical paper, “Not All Thoughts Need HBM: Semantics-Aware Memory Hierarchy for LLM Reasoning,” was published by researchers at USC and University of Wisconsin-Madison. “Reasoning LLMs produce ...

Tensormesh taps Nvidia, AMD and CoreWeave for funding to fix AI model memory problems

Tensormesh Inc. has hit upon a way to make artificial intelligence inference more efficient by eliminating the need for ...
Electronics Weekly

SSD controller for KV Cache-intensive workloads

Silicon Motion Technology, the Taiwanese specialist in NAND flash controller for SSDs, has come up with the SM2524XT, a PCIe ...