TMCnet News
Valkey 9.2 Lowers Cost of AI Workloads On Existing Infrastructure Alongside New Distributed KV Caching CapabilityThe latest release targets three of the largest costs of running at scale: extra memory held in reserve for backups, cross-region network traffic, and memory overhead for large datasets. SAN FRANCISCO, Nov. 19, 2026 /PRNewswire/ -- Valkey, the open source datastore for high-performing systems, today announced the general availability of Valkey 9.2, a release built to help organizations do more with the infrastructure they already have. Version 9.2 is complemented by the launch of distributed KV caching, taking aim at inference costs by providing a large, shared cache across entire GPU fleets. Building on Valkey's core pillars of efficiency and performance, version 9.2 reinforces the project's commitment to scaling enterprise workloads while driving down infrastructure costs.
"A major ethos of Valkey is doing more with less, which means getting more functionality with less hardware." Valkey sits on the hot path of modern applications, powering the caching, queues, and real-time data that users immediately experience. At that scale, every gigabyte of memory and every request sent between regions has associated costs for businesses, whether it's a part of historical operations or a new AI initiative. Valkey 9.2 continues the project's commitment to being efficient by design. "A major ethos of Valkey is doing more with less, which means getting more functionality with less hardware," said Madelyn Olson, Valkey project maintainer and Principal Engineer for AWS in-memory databases. "We designed Valkey 9.2 around this principle to deliver reduced memory overhead, lower cross-region network costs, and worry-free performance. With each release, Valkey continues to prove its value as an exceptionally fast, efficient, and reliable datastore." Distributed KV Caching Maximizes GPU Servers and Minimizes Costs
Path Hash Makes Finding AI Context More Efficient
Historically, taking database snapshots on busy systems caused massive memory spikes – sometimes doubling usage – forcing teams to over-provision and pay for idle memory just to handle backups. Valkey 9.2 prevents this costly penalty by introducing forkless snapshots, which save data using a background thread instead of a separate process. The feature supports:
Replication Compression Lowers Network Costs for Distributed Deployments
Sorted-Set Configuration: Faster Rankings, Less Memory
To see what else is included in Valkey 9.2 or upgrade to the latest version, visit valkey.io. Supporting Quotes "With representation on Valkey's Technical Steering Committee, Alibaba Cloud is committed to advancing Valkey through open collaboration. We are proud to have contributed Path Hash to Valkey 9.2, bringing native support for hierarchical data and expanding what developers can build with Valkey. Drawing on our Tair team's research and practical experience in KV cache for AI inference, we see significant opportunities for Valkey in AI infrastructure. We look forward to working with the community to help Valkey meet the evolving needs of AI workloads and deliver greater value to developers." "Valkey has consistently delivered improved availability, performance and efficiency with each release. Valkey 9.2 is no exception, with forkless saves, hot key detection and even more efficient sorted sets. Momento and AWS have worked closely, and in the open, to advance RDMA for Valkey. It's a great example of the open source ecosystem working! Valkey proves that true open source doesn't lock innovation behind enterprise-license paywalls." "At Multiverse Computing, we help customers scale inference workloads with compressed models that cut cost and latency. We cut both even further and served more prompts on existing GPUs by adding distributed KV caching on Valkey. With Valkey, we processed 50% more requests on the same GPUs within our one-second target for median time to first token. We achieved a 23% reduction in our median time to first token at normal traffic, and a 95% reduction at peak traffic. We also contributed LMCache connector improvements to the open-source community for Valkey that make distributed KV-caching more resilient." "KV cache objects are large and latency-sensitive, which is exactly where traditional networking falls short. With RDMA, Valkey can move multi-megabyte KV chunks directly into GPU-serving nodes with minimal CPU overhead. That makes it a strong shared backend for LMCache deployments where many inference engines need to reuse the same context. More fast, open storage options means users can match their cache tier to their infrastructure instead of the other way around." About Valkey About The Linux Foundation For a list of trademarks of The Linux Foundation, please see its trademark usage page: linuxfoundation.org/trademark-usage. Linux is a registered trademark of Linus Torvalds. Media Contact
SOURCE Valkey
|
