Key Points
- Zoho will develop LLMs for its software services using NVIDIA’s AI platform.
- User privacy is a top priority from the beginning.
- Zoho has invested over $20 million in NVIDIA’s AI technology.
- The company plans to create customized language models for different business needs.
- The collaboration will enhance model performance with NVIDIA GPUs.
Looma News
Zoho Corporation has announced a partnership with NVIDIA to leverage its AI-powered computing platform. This collaboration aims to develop large language models (LLMs) for Zoho’s software services, reaching more than 700,000 customers globally through ManageEngine and Zoho.com.
In the past year, Zoho invested over $10 million in NVIDIA’s AI technology and GPUs, with plans to invest another $10 million next year. This news was shared during the NVIDIA AI Summit in Mumbai.
Focus on User Privacy
Zoho is dedicated to user privacy by building its AI models with privacy rules in mind from the start. This approach helps businesses see quick returns by making the most of NVIDIA’s AI software, which enhances performance and reduces delays.
With more than ten years of AI experience, Zoho has added AI features to over 100 products in its ManageEngine and Zoho divisions. The company’s approach focuses on contextual intelligence, helping users make smart business decisions. Zoho is also working on smaller language models to provide tailored solutions based on different data sizes and specific needs.
Crucially, these LLMs will not use customer data for training, highlighting Zoho’s commitment to user privacy in its AI plans.
Collaboration with NVIDIA
Through this partnership, Zoho will use NVIDIA’s computing platform to speed up its LLMs with NVIDIA Hopper GPUs. The company will also utilize the NVIDIA NeMo platform for custom generative AI, including LLMs and features that work with both vision and speech.
Zoho is testing NVIDIA TensorRT-LLM, which has shown a 60% increase in performance and a 35% reduction in delays compared to older systems. Additionally, Zoho is fine-tuning other tasks, like speech-to-text, on NVIDIA’s powerful computing infrastructure.
Ramprakash Ramamoorthy, Director of AI at Zoho, pointed out that many current LLMs focus on consumer use and don’t offer much for businesses. He emphasized that Zoho aims to create LLMs designed for various business needs, highlighting the importance of context in making AI useful. Vishal Dhupar, Managing Director of Asia South at NVIDIA, supported this view in his comments on the partnership.
