AI & Machine Learning 1-Click App

Deploy LiteLLM in one click

OpenAI-compatible LLM gateway with virtual keys, budgets, and spend tracking, backed by PostgreSQL. LiteLLM runs in your Nodion project in the Frankfurt region (Germany), or in the US or Singapore if you prefer. Nodion runs the servers, so there are none for you to manage.

Deploy to Nodion ›

from 9.50 EUR / month

Up to 15 € credit when signing up

Version
v1.110.2
RAM
at least 2 GB
Services
App, PostgreSQL
Regions
Frankfurt (EU), US East, US West, Singapore

What the LiteLLM preset sets up

One click creates these resources in your project and connects them. You can review the sizes in the form before you deploy.

  • Application ghcr.io/berriai/litellm:v1.110.2 · port 4000 · at least 2 GB RAM
  • Managed PostgreSQL litellm-db

    Connection details are set as DATABASE_URL

  • HTTPS URL

    The default hostname gets a TLS certificate. Its address is set as PROXY_BASE_URL

  • Generated secrets

    Created for you when the app is created: LITELLM_MASTER_KEYLITELLM_SALT_KEYUI_PASSWORD

Deploy LiteLLM in three steps

  1. Sign in Log in or sign up. New accounts can earn up to 15 € in credit.
  2. Open the preset Pick a project and a region. The form shows the sizes and the monthly cost. Deploy to Nodion ›
  3. Deploy Nodion creates the app and its resources, then starts the first deploy.
After the first deploy

Open /ui and sign in as admin with the generated UI_PASSWORD from the application environment. There is no default password. Add your models and provider keys in the UI, then create virtual keys for your apps. Never change LITELLM_SALT_KEY after adding a model, because it encrypts the stored provider keys.

Run it like any other app

  • Domains A default hostname with HTTPS works right away. Add your own domain on the Domains tab.
  • Environment The preset sets the variables LiteLLM needs. Change them on the Environment tab.
  • Version The preset sets tag v1.110.2. Your app keeps it until you change the image on the Processes tab.
  • Logs and metrics Every process has logs and metrics in the dashboard. See Applications.

LiteLLM on Nodion: questions and answers

How do I deploy LiteLLM on Nodion?

Sign in to Nodion, open the LiteLLM preset and pick a project and a region. Nodion creates the app with a managed PostgreSQL database, sets the environment variables and starts the first deploy.

Can I host LiteLLM in the EU?

Yes. Pick the EU Central region in Frankfurt, Germany, when you create the app. Build, registry, the app and its databases, volumes, buckets, logs and metrics stay in the region you pick, and Nodion's API and control plane are hosted in Germany. US East, US West and APAC Central (Singapore) are available as well.

Can I use LiteLLM in line with the GDPR?

Nodion provides the basis for it: Nodion GmbH is based in Stuttgart, Germany, in the Frankfurt region the app, its databases and volumes run in Germany, and you conclude the data processing agreement (DPA) under Art. 28 GDPR electronically in the dashboard. Whether your setup complies also depends on how you configure and use the app.

Is this the same as self-hosting LiteLLM?

You get your own LiteLLM instance in your Nodion project. The difference: Nodion runs the servers, so there is no machine of your own to install and maintain.

How much does it cost to run LiteLLM on Nodion?

The starting setup costs about 9.50 EUR per month: App DS-G2-2GB, 2 GB RAM 8 EUR, PostgreSQL DS-G2-256MB, 256 MB RAM 1.50 EUR. Prices are net and billed per second. You can pick bigger sizes in the form.

What should I do after the first deploy?

Open /ui and sign in as admin with the generated UI_PASSWORD from the application environment. There is no default password. Add your models and provider keys in the UI, then create virtual keys for your apps. Never change LITELLM_SALT_KEY after adding a model, because it encrypts the stored provider keys.

Which version of LiteLLM does Nodion deploy?

The preset sets the image ghcr.io/berriai/litellm:v1.110.2. Your app keeps that image tag until you change it on the app's Processes tab.

Can I use my own domain for LiteLLM?

Yes. Every app gets a default hostname with HTTPS. Add your own domain on the app's Domains tab.

Give your agent a cloud.

Earn up to 15 € in credit when signing up.

Continue with GitHub

or with email

Stay in the loop.

Product news, no spam. Unsubscribe anytime.