Electronic Design

Adding Cache to IPs and SoCs

Cache memory significantly reduces time and power consumption for memory access in systems-on-chip. Technologies like AMBA protocols facilitate cache coherence and efficient data management across CPU ...
CRN

Violin Memory Unveils Cache Appliances For File-Based Data

Scalable memory array developer Violin Memory this week unveiled a new multiterabyte capacity solid-state cache memory system aimed at increasing the storage performance of enterprise applications.
Computer Weekly

CXL in the datacentre: Boosting memory for hungry workloads

Compute Express Link, otherwise known as CXL, is set to revolutionise the datacentre. So, what is it and what are the benefits? Memory management is a key element that enables datacentres to utilise ...
Semiconductor Engineering

Dynamic KV Cache Scheduling in Heterogeneous Memory Systems for LLM Inference (Rensselaer Polytechnic Institute, IBM)

A new technical paper titled “Accelerating LLM Inference via Dynamic KV Cache Placement in Heterogeneous Memory System” was published by researchers at Rensselaer Polytechnic Institute and IBM. “Large ...