Open-Source
Run It Yourself
Three ways into production
The daemon always runs on the GPU nodes and is installed there via the CLI, whichever route you pick.
REST API and MCP
What is in the repository
API gateway. Handles all inference requests.
SvelteKit admin UI. Deployments, keys, orgs.
Model runtime agent. Runs on inference hardware.
Operator CLI. Install, configure, manage.
Model metadata schema and YAML server.
Shared DB schema and migrations, Postgres 17.
Licensing: Gateway, daemon, CLI, infoserver and common-db are licensed under the Apache License 2.0. The dashboard is source-available under the Elastic License 2.0. The full codebase is auditable. Software is provided as is, without warranty of any kind. GDPR: GDPR compliance of any self-hosted deployment is the sole responsibility of the deploying organisation. Questions: contact@xinity.ai