Page 1 of 1

Building Production-Grade LLM Apps

Posted: Thu Mar 07, 2024 9:24 pm
by Eli
Today's workshop is about Building Production-Grade LLM Apps.


This event was live here and on YouTube at 10:00 AM PST



Questions were taken from the audience via Slido.

The workshop addressed the following;
  • What do you need to create enterprise-ready AI models and apps? Your current stack might have some gaps in it. Here’s what’s working.
  • What do you need to evaluate and iterate on apps quickly, so that you can gain confidence that your app is ready for production?
  • Rapid response - what happens when an app generates a hallucinatory or irrelevant or unsafe response? How to monitor, recognize when your app is in trouble and quickly get it back on the rails.
Here are links to Documentation:

Slides

Python Notebook