AI & Machine Learning 1-Click App
OpenAI-compatible LLM gateway with virtual keys, budgets, and spend tracking, backed by PostgreSQL. LiteLLM runs in your Nodion project in the Frankfurt region (Germany), or in the US or Singapore if you prefer. Nodion runs the servers, so there are none for you to manage.
One click creates these resources in your project and connects them. You can review the sizes in the form before you deploy.
Connection details are set as DATABASE_URL
The default hostname gets a TLS certificate. Its address is set as PROXY_BASE_URL
Created for you when the app is created: LITELLM_MASTER_KEYLITELLM_SALT_KEYUI_PASSWORD
Open /ui and sign in as admin with the generated UI_PASSWORD from the application environment. There is no default password. Add your models and provider keys in the UI, then create virtual keys for your apps. Never change LITELLM_SALT_KEY after adding a model, because it encrypts the stored provider keys.
Sign in to Nodion, open the LiteLLM preset and pick a project and a region. Nodion creates the app with a managed PostgreSQL database, sets the environment variables and starts the first deploy.
Yes. Pick the EU Central region in Frankfurt, Germany, when you create the app. Build, registry, the app and its databases, volumes, buckets, logs and metrics stay in the region you pick, and Nodion's API and control plane are hosted in Germany. US East, US West and APAC Central (Singapore) are available as well.
Nodion provides the basis for it: Nodion GmbH is based in Stuttgart, Germany, in the Frankfurt region the app, its databases and volumes run in Germany, and you conclude the data processing agreement (DPA) under Art. 28 GDPR electronically in the dashboard. Whether your setup complies also depends on how you configure and use the app.
You get your own LiteLLM instance in your Nodion project. The difference: Nodion runs the servers, so there is no machine of your own to install and maintain.
The starting setup costs about 9.50 EUR per month: App DS-G2-2GB, 2 GB RAM 8 EUR, PostgreSQL DS-G2-256MB, 256 MB RAM 1.50 EUR. Prices are net and billed per second. You can pick bigger sizes in the form.
Open /ui and sign in as admin with the generated UI_PASSWORD from the application environment. There is no default password. Add your models and provider keys in the UI, then create virtual keys for your apps. Never change LITELLM_SALT_KEY after adding a model, because it encrypts the stored provider keys.
The preset sets the image ghcr.io/berriai/litellm:v1.110.2. Your app keeps that image tag until you change it on the app's Processes tab.
Yes. Every app gets a default hostname with HTTPS. Add your own domain on the app's Domains tab.
Earn up to 15 € in credit when signing up.
or with email
Product news, no spam. Unsubscribe anytime.
Successfully subscribed.