Open Sourcing Guardrails on the Gateway Framework We are solving the *biggest missing component* in taking AI apps to prod → Now, enforce LLM behavior and route requests with precision, in one go.
Partnering with F5 to Productionize Enterprise AI We are thrilled to announce that Portkey is partnering with F5, the creators of NGINX and global leader in multi-cloud application security & delivery, to bring enterprise AI apps to production. By integrating our AI Gateway and Observability Suite with F5 Distributed Cloud Services, we are accelerating the path to production
April Cool: 154 PR Merges I sat down to count our PRs for the last month - 154 PRs merged, resulting in a total of 30 distinct updates. (that's 1 every day). I think we can do more! But we'll compensate for that with what we are shipping this month. 👀 In the meanwhile, here's a
⭐️ Implementing FrugalGPT: Reducing LLM Costs & Improving Performance FrugalGPT is a framework proposed by Lingjiao Chen, Matei Zaharia and James Zou from Stanford University in their 2023 paper "FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance". The paper outlines strategies for more cost-effective and performant usage of large language model (LLM) APIs. A
What It Means To Go To Prod Lately, I am feeling more and more confident about Portkey solving *real* production challenges for our users. Of course, developer love and revenue increase are important parameters, but there's something else just as high signal: The platform modularity that customers demand from Portkey, and how fast we serve it without
Portkey Goes Multimodal 2024 is the year where Gen AI innovation and productisation happens hand-in-hand. We are seeing companies and enterprises move their Gen AI prototypes to production at a breathtaking pace. At the same time, an exciting new shift is also taking place in how you can interact with LLMs: completely new
Transforming E-Commerce Search with Semantic Cache: Insights from Walmart's Journey We recently spoke with Rohit Chatter, Chief Software Architect at Walmart, who offered profound insights into how Walmart is leveraging these technologies, particularly focusing on semantic caching and its impact on e-commerce search functions.