LLM Providers

Connect your own LLM credentials for full control over AI responses and costs.

Overview

Monology uses a "bring your own key" model for LLM providers. You provide your own API credentials, giving you full control over costs, data privacy, and model selection.

Supported Providers

OpenAI
Direct integration with OpenAI's API

Required Credentials

  • API Key: Your OpenAI API key (starts with sk-)

Supported Models

gpt-4ogpt-4o-minigpt-4o-2024-08-06gpt-4o-mini-2024-07-18

How to Get Your OpenAI API Key

  1. Create an OpenAI Account: Visit platform.openai.com/signup and sign up for a new account (or log in if you already have one)
  2. Add Billing Information: Navigate to Billing → Payment methods and add a payment method. You'll need this to use the API.
  3. Create an API Key: Go to API Keys section and click "Create new secret key"
  4. Name Your Key: Give your key a descriptive name (e.g., "Monology Production") to identify it later
  5. Copy and Save: Copy the API key immediately (it starts with sk-). You won't be able to see it again!
  6. Set Usage Limits (Optional): In Usage limits, set monthly spending limits to control costs
Important: Store your API key securely. Never share it publicly or commit it to version control.
Azure OpenAI
Enterprise-grade option with Azure infrastructure

Required Credentials

  • Endpoint: Your Azure OpenAI resource endpoint
  • API Key: Azure OpenAI API key
  • Deployment Name: Name of your model deployment
  • API Version: Azure API version (e.g., 2024-02-15-preview)

Benefits

  • Enterprise SLAs and support
  • Data residency options
  • Integration with Azure security
  • Private network deployment

How to Set Up Azure OpenAI

  1. Azure Subscription: Ensure you have an active Azure subscription. If not, create one at azure.microsoft.com/free
  2. Request Access: Azure OpenAI requires approval. Submit an access request at aka.ms/oai/access (approval typically takes 1-2 business days)
  3. Create Azure OpenAI Resource:
    • Go to Azure Portal
    • Click "Create a resource" → Search for "Azure OpenAI"
    • Select your subscription, resource group, region, and pricing tier
    • Click "Review + Create" → "Create"
  4. Deploy a Model:
    • Open your Azure OpenAI resource
    • Go to "Model deployments" → "Create"
    • Select a model (e.g., gpt-4o)
    • Give it a deployment name (e.g., "gpt-4o-deployment")
    • Click "Create"
  5. Get Your Credentials:
    • Endpoint: Found in "Keys and Endpoint" section (e.g., https://your-resource.openai.azure.com/)
    • API Key: Copy either KEY 1 or KEY 2 from the same section
    • Deployment Name: The name you gave your model deployment
    • API Version: Use 2024-02-15-preview or latest from Azure docs
Note: Azure OpenAI provides enterprise features like private endpoints, managed identity, and compliance certifications.

Configuring LLM Credentials

  1. Open your workflow and select an Agent Node
  2. Navigate to the Credentials section
  3. Select your provider (OpenAI or Azure OpenAI)
  4. Enter your credentials
  5. Click Validate to test the connection
  6. Save your changes

Credential Validation

Monology validates your credentials when you save them to ensure they work correctly:

  • Checks API key validity
  • Verifies endpoint accessibility (Azure)
  • Confirms model deployment exists (Azure)
  • Tests a simple API call
Tip: If validation fails, double-check your credentials and ensure your API key has the necessary permissions.

Security

Your API credentials are handled securely:

  • Credentials are encrypted at rest
  • Keys are never exposed in the UI after saving
  • API calls are made server-side
  • You can rotate keys anytime

Next Steps

Email Providers

Configure email sending for Action nodes