Dataiku Broadens LLM Mesh to Enable Multi-LLM Approach Across Cloud and AI Player Ecosystem

New Dataiku LLM Registry fortifies LLM Mesh with added layer of governance to qualify, document, and frame LLM usage


NEW YORK, NY, Aug. 13, 2024 (GLOBE NEWSWIRE) -- NEW YORK, NY - August 13, 2024: Dataiku, the Universal AI Platform, today announced the expansion of its LLM Mesh ecosystem to facilitate secure access to thousands of large language model (LLM) gateways, empowering data and analytics teams to build and deploy GenAI-driven solutions at scale by adopting a multi-LLM strategy. Dataiku is also closing a critical governance gap to ensure regulatory readiness and effective management of LLM technologies across the organization with the LLM Registry, which allows CIOs and their teams to qualify, document, and rationalize which LLMs should or should not be used across use cases. 

In a highly-competitive and volatile LLM ecosystem, Dataiku’s LLM Mesh enables organizations to take a multi-LLM approach, switching out underlying models to power GenAI-driven applications with ease. With the expansion, the LLM Mesh now supports many LLM players, including 15 major cloud and AI vendors like Amazon Web Services (AWS), Databricks, Google Cloud, Snowflake (Arctic), and more.

“Our goal is to help our customers future-proof their GenAI strategies and avoid obsolescence — that said, we provide a balanced approach to developing AI applications, while removing the risk of anchoring a strategy to a single AI provider,” said Florian Douetteau, co-founder and CEO, Dataiku. “The LLM Mesh gives organizations secure access to literally thousands of diverse models for any GenAI use case they’re looking to implement today for a true multi-LLM strategy.” 

LLMs constitute one piece of GenAI applications, and the reality of LLM use in the enterprise is complex, as organizations scale to more sophisticated applications. A multi-LLM approach is essential to account for cost and performance management, privacy and security, and to meet regulatory requirements. Dataiku’s Universal AI Platform supports this comprehensive approach, in addition to supporting traditional analytics and machine learning techniques, which allows enterprises to effectively handle the complete development lifecycle of GenAI applications.

“IDC anticipates a future marked by a variety of model types, each suited to different tasks and scenarios,” said Nancy Gohring, IDC senior research director, AI. “Enterprises are likely to use many models of different sizes and modes, and should ensure they have the ability to quickly evaluate and swap models as new models come to market and use cases evolve.”

As the industry’s only infrastructure-independent vendor, Dataiku decouples the Generative AI application from the service layer as well as provides guardrails around cost, usage, hallucinations, PII, and more. This level of choice and flexibility allows Dataiku to expand on its own integrations at that pace the ecosystem evolves, so that organizations can build and deploy GenAI applications that bring business value instead of augmenting new LLM connections. 

Additional Resources

  • Read the first chapter now of O’Reilly’s newest book on the challenges of using LLMs in the enterprise, “The LLM Mesh: A Practical Guide to Using Generative AI in the Enterprise.”
  • Explore the capabilities of the Dataiku LLM Mesh

About Dataiku
Dataiku is the Universal AI Platform, uniting the technology, teams, and operations needed for companies to build intelligence into their daily operations, from modern analytics to Generative AI. Together, they design, develop and deploy new AI capabilities, at all scales and in all industries. Organizations that use Dataiku enable their people to be extraordinary, creating the AI that will power their company into the future. 

Founded in 2013, Dataiku has proven its ability to continue to develop its founding vision for Everyday AI, and to execute on its growth

Connect with Dataiku through their blog, Twitter/X, LinkedIn, and YouTube.

 

Contact Data