Sign in Subscribe

Siddharth Sambharia

LLMs in Prod: The Reality of AI Outages, No LLM is Immune

LLMs in Prod: The Reality of AI Outages, No LLM is Immune

This is Part 2 of our series analyzing Portkey's critical insights from production LLM deployments. Today, we're diving deep into provider reliability data from 650+ organizations, examining outages, error rates, and the real impact of downtime on AI applications. From the infamous OpenAI outage to the daily challenges of rate

LLMs In Prod: Day 1

LLMs In Prod: Day 1

This is Part 1 of our analysis diving into Portkey's year-end LLM production data. Over the next few days, we'll be unpacking insights from over 2 trillion tokens worth of production data to reveal how the AI ecosystem evolved in 2024. Today, we're starting with the most crucial aspect: who's

LibreChat vs Open WebUI: Choose the Right ChatGPT UI for Your Organization

LibreChat vs Open WebUI: Choose the Right ChatGPT UI for Your Organization

Looking to harness AI while keeping your data in-house? Dive into our comprehensive comparison of LibreChat and Open WebUI – two powerful open-source platforms that let you build secure ChatGPT-like systems.

7 Ways to Make Your Vercel AI SDK App Production-Ready

7 Ways to Make Your Vercel AI SDK App Production-Ready

Learn how to make your Vercel AI SDK app production-ready with Portkey. Step-by-step guide covers 5 key techniques: implementing guardrails, conditional routing, interoperability, reliability features, and observability.

Bridging the Gap: How Portkey AI Gateway Connected with MongoDB Helps Productionize AI Apps

Bridging the Gap: How Portkey AI Gateway Connected with MongoDB Helps Productionize AI Apps

Portkey’s open-source AI Gateway is used by thousands of AI companies to take their apps to production. Learn how these companies tackle crucial LLM challenges and build apps that delight users.

Building a Robust RAG App with Guardrails using Portkey and MongoDB

Building a Robust RAG App with Guardrails using Portkey and MongoDB

Introduction Retrieval-Augmented Generation (RAG) has become a go-to technique for enhancing LLMs with external data. In this tutorial, we'll build a production-ready RAG application in just 10 minutes using Portkey, MongoDB Atlas, Patronus AI, and LlamaIndex. But first, what is RAG? Retrieval-Augmented Generation (RAG) is a technique that enhances LLMs

Attention Isn’t All You Need

Attention Isn’t All You Need

Mamba: The AI that remembers like a Transformer but thinks like an RNN. Its improved long-term memory could revolutionize DNA processing, video analysis, and AI agents with persistent goals.