Designing Systems Using Large-Language Models (LLMs)

Large language models (LLMs) are quite common in today’s AI-based systems. However, these models can require substantial computational resources, including powerful GPUs and large memory, both for training and inference. Ensuring reliability can also be tricky, as LLMs require rigorous testing and monitoring. In this session, we will look at managing the LLMs with respect to size and complexity, and scalability, for integration into real-world applications. That includes balancing trade-offs between performance, cost, and user privacy.

This session is part of our “A.I. Day Virtual Conference”. Registration/event page here.