Aporia Partners with Portkey to Bring Secure and Reliable AI Guardrails to Production

We’re excited to announce our partnership with Portkey, aimed at enhancing the security and reliability of in-production GenAI applications for AI Engineers. This partnership is going to allow AI engineer teams globally to integrate Aporia’s low-latency, high accuracy Guardrails into their GenAI app natively with Portkey’s AI gateway solution.

Aporia has been helping Fortune 500s and leading tech companies secure their AI for many years, having developed customizable and out-of-the-box Guardrail policies that fit any GenAI app. Processing billions of tokens daily, and providing live logging and transparency of messages from the user and LLM, Aporia is one of the leading tech companies paving the way for secure and reliable AI.

Portkey is widely recognized as a leading OSS AI gateway used by companies such as Postman, Multion, and other Fortune 500 companies. Portkey processes billions of LLM tokens daily for some of the world’s top AI teams and helps them bring their AI apps to production.

Today, we’re pleased to share that Aporia and Portkey are teaming up to integrate Aporia’s state-of-the-art LLM Guardrails natively with Portkey’s Gateway.

What Does This Partnership Mean for AI Engineers?

In the simplest form, AI teams and engineers can now integrate Aporia’s low-latency, high accuracy Guardrails into their GenAI app natively with Portkey’s AI gateway solution. In just a few clicks, AI engineers can fortify their GenAI applications with Aporia Guardrails:

• Mitigate AI hallucinations
• Block prompt injections
• Prevent data leaks
• Ensure topical focus
• Enforce company compliance
• Create custom polices
  + 20 other options

This collaboration empowers the AI community to effortlessly fortify any GenAI app with an additional layer of security and reliability at the click of a button.

“Together, we are committed to building an AI ecosystem that encourages innovation while safeguarding against risks by empowering users to remain confident that their AI applications are not only effective but also secure and reliable.” Liran Hason, CEO of Aporia

How Does It Work?

Using Aporia with Portkey couldn’t be simpler. Here’s the steps to follow:

1. Add Aporia’s API key to portkey

2. Add Aporia’s Guardrail check

3. Add Guardrail ID to a config and make your request

4. Track your policies and sessions on Aporia’s Session Explorer & Dashboard

(see Session Explorer demo video below)

Won’t the Guardrails Affect the Latency or Accuracy of the App?

Aporia’s recently released 2024 benchmarks report highlights the lightning-fast latency and accuracy of their Guardrails – significantly outperforming GPT-4o and Nvidia/NeMo Guardrails. This is achieved through Aporia’s recently launched multi-Small Language Model (SLM) detection engine, which ensures greater accuracy and lower latency in AI interactions.

Furthermore, tests were run on the latency of individual policies, results of which can be shown below.

Aporia’s Session Explorer: Unprecedented Look into How Your AI and Users Behave

Integrating with Aporia also gives you access to the newly-released Session Explorer, to unleash real-time transparency and visibility like never before. The Session Explorer gives visibility to user prompts and model responses in real-time, as well as flagged messages that violate policies.

In addition, AI teams can benefit from real-time analytics, actionable insights of AI sessions, and advanced filtering to enable targeted analysis and troubleshooting.

What Exclusive Benefits Do Portkey Users of Aporia Get?

In addition to providing the most seamless and simple way to provide the highest layers of security to your GenAI, Aporia is giving all Portkey users the benefit of 3M free GRUs*/month (no. of tokens x no. of policies). This offer is exclusively available for Portkey users who use Aporia Guardrails.

“Bringing Aporia Guardrails onto Portkey is a direct reflection of our mission to bring responsible LLMs to production for enterprises worldwide” – Rohit Agarwal, Co-Founder and CEO of Portkey.

We are extremely excited about this partnership, and can’t wait to see how it benefits AI teams across the world.

To sign up for Portkey’s AI Gateway Solution, and get an exclusive free 3M GRUs* when integrating Aporia, click here>>

*Free when taking the ‘Team’ pricing.