TransCrypts Integrates Meta’s Llama 3.2 via Google Cloud

In July, we announced the addition of Meta’s Llama 3.1 open models to Vertex AI Model Garden. Since then, developers and enterprises have shown tremendous enthusiasm for building with the Llama models. Today, we’re announcing that Llama 3.2, Meta’s new generation of multimodal models, is available on Vertex AI Model Garden.

Llama 3.2 is a new generation of vision and lightweight models that fit on edge devices, tailored for use cases that require more private and personalized AI experiences. With the new models:

• Llama goes multimodal: With Llama 3.2 new 11B and 90B vision LLMs, you will now be able to reason on high-resolution images such as charts, graphs, or image captioning. This unlocks new possibilities such as image-based search and content generation, interactive educational tools and beyond.
• Llama goes small: Llama 3.2 new 1B and 3B lightweight models are designed for seamless integration on mobile and edge devices. With these models, you can build private, personalized AI experiences with minimal latency and resource overhead. Imagine on-device multilingual summarization, information retrieval, and local AI agents — all while preserving user privacy.

The new Llama models prioritize accessibility, efficiency, and privacy, with a focus on responsible innovation and system-level safety.

Vertex AI provides you with a unified AI platform for experimenting with, customizing, and deploying models like Llama 3.2 with ease. The addition of Llama 3.2 to Vertex AI expands our curated collection of over 160 enterprise-ready first-party, open-source, and third-party models in Model Garden — enabling you to select the best models for your needs through our open and flexible AI ecosystem.

• You can easily access the new 90B model in preview here through our Model-as-a-Service (MaaS) offering. With MaaS, you can access the model instantly, tailor it with robust development tools, and deploy with fully managed infrastructure and pay-as-you-go billing. 90B will become generally available in the coming weeks. The 11B vision model will also be available as MaaS in the coming weeks.
• All four Llama 3.2 models are ready for self-service deployment through Vertex AI Model Garden, starting today.

TransCrypts leverages Llama on Google Cloud to bring its AI-powered financial guide, Castello, to thousands of customers:

"Using Llama 3.1 on Google Cloud has been a game-changer for TransCrypts. The performance and cost-efficiency of TPUs allow us to deploy these advanced models at lightning speed, handling complex workloads that would otherwise be out of reach,” said Zain Zaidi, Co-Founder & CEO of TransCrypts. “Google Cloud’s ease in enabling us to effortlessly scale has allowed us to offer our solution, Castello, to tens of thousands of customers in a matter of days.”

‍

Read More

‍