Building Production-Grade LLM Apps

[Eli]

Today's workshop is about Building Production-Grade LLM Apps.


This event was live here and on YouTube at 10:00 AM PST



Questions were taken from the audience via Slido.

The workshop addressed the following;

• What do you need to create enterprise-ready AI models and apps? Your current stack might have some gaps in it. Here’s what’s working.
• What do you need to evaluate and iterate on apps quickly, so that you can gain confidence that your app is ready for production?
• Rapid response - what happens when an app generates a hallucinatory or irrelevant or unsafe response? How to monitor, recognize when your app is in trouble and quickly get it back on the rails.

Here are links to Documentation:

Slides

Python Notebook