TMCnet News
Anyscale Teams Up With NVIDIA to Scale Generative AI Models Into ProductionSAN FRANCISCO, March 18, 2024 (GLOBE NEWSWIRE) -- Anyscale, the AI infrastructure company built by the creators of Ray, the world’s fastest growing open-source unified framework for scalable computing, today announced a collaboration with NVIDIA to integrate the NVIDIA AI Enterprise software platform into the Anyscale platform, enabling customers to accelerate and scale large language models (LLMs) into a production environment with security, support, and stability. The integration brings support for NVIDIA NIM inference microservices announced at NVIDIA GTC today. Customers will benefit from the combined power of Ray and Anyscale’s managed runtime environment, providing capabilities like container orchestration, observability, and autoscaling, as well as access to NVIDIA AI Enterprise to improve security and LLM performance. Increasingly, AI workloads demand more performance from infrastructure. Dynamically scaling that infrastructure while balancing cost remains a pervasive challenge. Anyscale’s integration with NVIDIA AI Enterprise will enhance the scalability of AI workloads, enabling training and deployment of larger and more complex models and support the optimization of smaller models for specific tasks. Access to NVIDIA’s accelerated computing infrastructure will simplify th deployment and management of distributed machine learning (ML) applications, leading to more efficient resource utilization, faster iteration, and reduced costs. In addition, access to NIM minimizes restrictions and time spent on infrastructure, allowing developers to remain focused on driving innovation forward for their organization. “This enhanced integration with NVIDIA AI Enterprise makes it simpler than ever for customers to get access to cutting-edge infrastructure software and top-of-the-line compute resources to accelerate the production of generative AI models,” said Robert Nishihara, CEO of Anyscale. “As AI becomes a strategic capability, it’s essential to balance performance, scale, and cost while minimizing infrastructure complexity. The ability to tap into the best-of-breed infrastructure, accelerated computing, pre-trained models and tools will be crucial for organizations to stand out and compete. This collaboration is another important step forward in bringing generative AI to more people." "Enterprises need full stack computing to deliver low latency, high performance generative AI," said Justin Boitano, vice president, Enterprise Products at NVIDIA. "The integration of NVIDIA NIM microservices with Anyscale's platform simplifies and accelerates generative AI development and deployment, bringing more efficiency to production AI." Anyscale’s integration with NVIDIA AI Enterprise will deliver multiple benefits for developers, including:
Anyscale is now available to NVIDIA AI Enterprise users at www.anyscale.com/get-started. About Anyscale: Press Contact: [email protected] |