TMCnet News
Galileo Releases the First LLM Evaluation, Experimentation and Observability Platform for Building Trustworthy Production-Ready LLM ApplicationsSAN FRANCISCO, Sept. 19, 2023 (GLOBE NEWSWIRE) -- Galileo, a leading machine learning (ML) company for unstructured data, today announced the general availability of Galileo LLM Studio, a platform for building trustworthy LLM applications and getting them into production faster. The platform has Prompt and Fine-Tune modules and now has a third module, Monitor, that provides a continuous feedback loop for developers and data scientists. All three modules leverage Galileo’s Guardrail Metrics Store where users can find unique evaluation metrics created by Galileo’s research team which enhance developer productivity and provide robust hallucination detection or build their own custom metrics. Galileo will be showcasing LLM Studio at The AI Conference in San Francisco next week: https://aiconference.com/ “Enterprises face multiple challenges in operationalizing generative AI ranging from prompt engineering to managing model performance to quantify the impact of these models. Businesses seeking to translate the foundational large language models that are taking the world by storm into enterprise-ready applications need to take all of these aspects into account,” said Hyoun Park, CEO and Principal Analyst at Amalgam Insights. Founded by former Apple, Google and Uber AI product and engineering leaders, Galileo launched in 2022 with the first ML data intelligence platform for unstructured data which is now being used by startups t the Fortune 500. The platform supports Natural Language Processing (NLP) and Computer Vision (CV) and now LLMs as part of the company’s mission to unlock the value of unstructured data (text, image, speech and more) which accounts for more than 80% of the world’s data today. As organizations of all sizes and across industries begin to consider the potential applications of generative AI, it is more important than ever for organizations to have governance frameworks in place to minimize the risk of LLM hallucinations in a scalable and efficient manner. “There is a strong need for an evaluation toolchain across prompting, fine-tuning and production monitoring to proactively mitigate hallucinations. Galileo’s LLM Studio offers exactly that toolchain. Highly recommend it to all LLM builders!” said Waseem Alshikh, co-founder and CTO of Writer, a leading generative AI platform company. “We’ve spent the last year speaking with enterprises working to bring LLM-based applications to production and three things became radically clear. First, companies of all sizes now have LLM powered applications in production. Second, LLM output evaluation is painfully manual with no guardrails against hallucinations. Third, teams are looking for sophisticated metric-driven monitoring for their applications in production. This need for LLM evaluation, experimentation and observability was core to our latest release,” said Vikram Chatterji, co-founder and CEO of Galileo. Galileo LLM Studio has three modules:
Additional Resources:
About Galileo Media and Analyst Contact: 
|
