Anyscale Teams With NVIDIA to Supercharge LLM Performance and Efficiency
SAN FRANCISCO, Sept. 18, 2023 (GLOBE NEWSWIRE) -- Ray Summit – Anyscale, the AI infrastructure company built by the creators of Ray, the world’s fastest-growing open-source unified framework for scalable computing, today announced a collaboration with NVIDIA to further boost the performance and efficiency of large language model (LLM) development on Ray and the Anyscale Platform for production AI.
The companies are integrating NVIDIA AI software into Anyscale’s scalable computing platforms, including Ray open source, the Anyscale Platform, and Anyscale Endpoints, announced separately today.
The open-source integrations will bring NVIDIA software, including NVIDIA TensorRT-LLM, NVIDIA Triton Inference Server, and NVIDIA NeMo to Ray to supercharge end-to-end AI development and deployment. Making cutting-edge AI software available via open source democratizes access and dramatically increases the audience of developers that can use this integration.
For production AI, the companies will certify the NVIDIA AI Enterprise software suite for the Anyscale Platform, bringing enterprise-grade security, stability, and support to companies deploying AI. An additional integration with Anyscale Endpoints will bring support for the NVIDIA software to a greatly expanded pool of AI application developers via easy-to-use application programming interfaces.
“Realizing the incredible potential of generative AI requires computing platforms that help developes iterate quickly and save costs when building and tuning LLMs,” said Robert Nishihara, CEO and co-founder of Anyscale. “Our collaboration with NVIDIA will bring even more performance and efficiency to Anyscale’s portfolio so that developers everywhere can create LLMs and generative AI applications with unprecedented speed and efficiency.”
“LLMs are at the heart of today’s generative AI transformation, and the developers creating and customizing these models require full-stack computing with efficient orchestration throughout the AI life cycle,” said Manuvir Das, vice president of Enterprise Computing at NVIDIA. “The combination of NVIDIA AI and Anyscale unites incredible performance with ease of use and the ability to scale rapidly with success.”
NVIDIA AI Acceleration Speeds End-to-End Anyscale Development
The integration delivers numerous benefits for customers and users:
More details are available on the NVIDIA blog.
Contact and press inquiries: [email protected]
Keynote Presentation by Genesys
Grand Opening Reception in Expo Hall