LLM Gateway - Admin Panel

Project Management

Create and manage your LLM Gateway projects

Existing Projects

Create New Project

Create a new project in Default Organization.

Project Name

Description

Department

Project Owner

Project Mode

API Keys

Use your own provider API keys (OpenAI, Anthropic, etc.)

Credits

Use your organization credits and our internal API keys

Hybrid

Use your own API keys when available, fall back to credits when needed

Request Caching

Configure caching for identical LLM requests

Enable request caching

Cache Duration (seconds)

Min: 10, Max: 31,536,000 (one year) • Default: 86,400 (1 day)

Edit Project

Update project settings and configuration.

Project Name

Description

Department

Project Owner

Project Mode

API Keys

Use your own provider API keys (OpenAI, Anthropic, etc.)

Credits

Use your organization credits and our internal API keys

Hybrid

Use your own API keys when available, fall back to credits when needed

Request Caching

Configure caching for identical LLM requests

Enable request caching

Cache Duration (seconds)

Min: 10, Max: 31,536,000 (one year)

Add Department

Department Name

Add Project Owner

Owner Name

Email (optional)

User Management

Create and manage user accounts

Existing Users

Add New User

Create a new user account

Full Name

Password

Minimum 6 characters required

Edit User

Full Name

New Password (leave empty to keep current)

Minimum 6 characters required (if changing)

API Keys Management

Select a project... Mode

Total Keys: 0 | Active: 0 | Total Usage: $0.00 | Avg per key: $0.00

💡 Monitor your API key usage to optimize costs

Select a project to view API keys

Create API Key

Create a new API key to access LLM Gateway.

Project: Not selected

💡 After creation, you can configure IAM rules to control access to specific models, providers, or pricing tiers.

API Key Name

Set API Key Usage Limit

Usage includes both usage from LLM Gateway credits and usage from your own provider keys when applicable.

Edit key credit limit

Set a credit limit for this key. When key usage is past this limit, requests using this key will return an error.

Key:

Usage Limit (leave empty for no limit)

Usage includes both usage from LLM Gateway credits and usage from your own provider keys when applicable.

Edit API Key

Update the name for this API key.

Key Name

IAM Rules -

Configure access control rules for this API key to restrict model access by type, provider, or pricing.

Create New Rule

Rule Type

Pricing Type

Models

Custom Model

JSON Stream

Auto Route

JSON Stream

GPT-4o Mini

$0.15/1M tokens $0.00/1K requests

JSON Stream

GPT-4

$30.00/1M tokens

$0.00/1K requests

Stream

GPT-4o

$2.50/1M tokens

$0.00/1K requests

JSON Stream

Providers

Max Input Price ($/M tokens)

Max Output Price ($/M tokens)

Existing Rules

No IAM rules configured. All models are accessible.

Usage Analytics

Monitor model usage, costs, and tokens

Time Period

—

Group By

View By

Filters

Total Requests

API calls made

Total Cost

$0.00

Total spent

Total Tokens

Tokens processed

Error Rate

0.0%

Failed requests

Project Usage Overview

Stacked project usage over time

Top Used Models

Model	Provider	Requests	Cost	Tokens	Usage
Loading data...

Budget & Alerts

Manage budgets and configure alerts for cost monitoring

Projects & API Keys

Create Budget

Budget For

Select Entity

Period

Usage History

Budget Amount ($)

Deactivate when budget exceeded

Create Alert

Threshold (%)

Alert will trigger when budget usage reaches this percentage

Email Recipients

Budget Alert Send Logs

Loading alert logs...

Reports

Create and schedule automated email reports

Report Name	Project Filter	Created	Frequency	Next Send	Status	Actions
No reports yet Create your first automated report to get started

Create Report

Report Template

Select a template to auto-fill the form (optional)

Report Name

Description (Optional)

Project Filter (Optional)

All Projects

Select a specific project to filter report data, or leave as "All Projects" for organization-wide reporting

Report Period

💡 Select a time period for the report - relative periods update automatically when the report runs

Recipients

Send as single email chain (CC all recipients)

Checked: All recipients receive one email and see each other. Unchecked: Each recipient receives a separate individual email.

Frequency

Time (GMT)

Day of Week

Time (GMT)

Day of Month

For months with fewer days, the last day will be used

Time (GMT)

Every

Starting Time (GMT)

Reports will be sent starting from this time, then every N hours

Email Subject

Click {} to insert variables

Email Body

The report data will be automatically attached below the message

Report Content

No widgets added yet

Click "Add Widget" to start building your report

Add charts, tables, and metrics to customize your report content

Enable this report

Report Preview

Send Report Now?

This will send the report immediately to all configured recipients.

Save as Template

Template Name

Save Action

Save as New Template

Create a new template from current settings

Overwrite Existing Template

Replace the current template settings

Select Template to Overwrite

Report Send Logs

Loading send logs...

Add Widget

Projects Cost Table

Detailed breakdown of costs by project with MoM comparison

Monthly Totals Chart

Total costs by month (line or bar chart)

Provider Distribution

Pie chart showing cost distribution by provider

Department Comparison

Bar chart comparing department costs

Model Usage Statistics

Table showing usage by AI model

Top Projects

List of highest spending projects

Cache Efficiency

Cache hit rate and savings metrics

Budget Utilization

Gauge showing % of budget used

Key Metrics Cards

4 colorful cards with key metrics and MoM changes

Model Usage Table

Top models by cost with rankings

Top API Keys

Most expensive API keys with progress bars

Usage Timeline

Daily API requests bar chart

Peak Hours Heatmap

7x24 hours activity heatmap

Performance Summary

Duration, TTFT, and error rate metrics

Error Analysis

Error types breakdown with percentages

Month-over-Month Comparison

Compare current vs previous month metrics

Configure Widget

Insert Variable

Providers

Manage AI provider configurations and API keys

Providers panel coming soon...

System Settings

Configure system preferences

Email Settings

Configure email delivery for alerts and reports

Email Provider

Choose your email delivery provider

From Email

Email address that will appear as sender

From Name

Display name for the sender

OAuth2 Credentials

Client ID

Client Secret

Refresh Token

SMTP Credentials

Gmail Address

App Password

Generate at: myaccount.google.com/apppasswords

Service Account Configuration

Service Account JSON (paste entire content)

*** Service Account JSON configured - Click "Show" to view/edit ***

Impersonate User Email

Email address to send from (must exist in your Workspace)

SendGrid Configuration

API Key

Get your API key from SendGrid dashboard

AWS SES Configuration

AWS Region

Access Key ID

Secret Access Key

SMTP Server Configuration

SMTP Host

SMTP Port

Username

Password

Use TLS/SSL