[email protected]

AnythingLLM Hosting in Germany

WZ-IT runs AnythingLLM as a dedicated instance in data centres in Germany, Switzerland or Austria, with updates, daily backups, 24/7 monitoring and a personal contact. On request, we also install AnythingLLM in your cloud or on premises.

Reviews
Cloud Wolke HerausforderungServer NachhaltigkeitIT Beratung Service Consulting SoforthilfeTimo Wevelsiep Robin ZinsExperten für Innovation Migration AWSHetzner Hosting zuverlässig

Customers from mid-sized business, industry and the public sector, in Germany and internationally

  • Stadtwerke Brühl
  • DGHO e.V.
  • solarwerkstatt berlin
  • Krüger Dirndl
  • ABCO Water Systems
  • Golem.de
  • EVADXB
  • nextGYM
  • AInergy
  • ml&s
  • Odiseo Solutions
  • Annota
  • ARGE
  • SweetConnect GmbH
  • Aphy AG
  • CORGOS
  • Rekorder
  • SolidProof
  • Yonju
  • Keymate
  • Paritel
  • Mr. Clipart
  • Millenium
  • Negosh
  • Führerscheinmacher
  • BTI
  • Deutsche Gesellschaft für Datenschutz
Read client reviews

About the technology

What is AnythingLLM?

AnythingLLM is a fully self-hostable AI document chat platform that enables businesses to privately chat with their documents. As an all-in-one desktop & Docker AI application, AnythingLLM offers built-in RAG functionality, AI agents, a no-code agent builder, and much more.

AnythingLLM can connect local and remote LLM providers as well as different vector stores and provides team workspaces. Which data leaves the environment depends on the selected model, embedding and integration services.

Features

  • AI Document Chat

    Query document content through a chat interface. Quality and source grounding depend on extraction, chunking, indexing, retrieval and the selected model.
  • RAG (Retrieval-Augmented Generation)

    RAG retrieves suitable document passages for the model response. Indexing, permissions, retrieval and source display are tested for the concrete corpus.
  • Multi-LLM Support

    Supports multiple LLM providers: Ollama (local), OpenAI, Anthropic Claude, Google Gemini, Azure OpenAI, LM Studio, and many more. Flexibly switch between providers based on requirements.
  • Controllable data flows

    With an entirely local configuration, documents, embeddings and model requests can remain in your environment. When remote LLM or embedding providers are used, the content sent to them is processed externally.
  • Multi-User Workspaces

    Create separate workspaces for different teams, projects, or use cases. Each workspace can have its own documents, LLM configurations, and permissions.
  • Intelligent Document Management

    Processes common document formats into chunks and embeddings. Supported formats and result quality depend on version, parser and document structure.
  • Enterprise Security

    Access rules and connections to existing identity services are combined with network, transport and storage encryption in the operating environment. Available features depend on version and edition.
  • Open source

    The publicly available source code supports technical review and adaptation. Dependencies, connected models and external services are included in the security assessment.
  • Self-Hosted or Managed

    Run AnythingLLM on-premise, in your cloud, or use our managed hosting. The deployment and connected model services are configured around your privacy and compliance requirements.

Infrastructure, integration and operations

AnythingLLM as part of your infrastructure

We do more than provide an application. WZ-IT designs the technical architecture, integrates network and identity, operates the agreed scope and develops integrations when the standard product is not enough.

Architecture and migration

Sizing, target environment, data transfer, cutover and recovery are resolved before production operations.

  • On-Premise

    In your data center: Installation on bare-metal, VM or Docker · Integration with existing Active Directory/LDAP

  • Installation in your cloud

    In your own cloud account, for example with AWS, Azure, GCP or Hetzner · Terraform/IaC setup (optional) · Kubernetes or Docker Compose · Capacity and scaling design

  • Enterprise Setup

    Advanced architecture after technical and licence assessment: HA and recovery design where supported by the application and edition · Logging according to feature set and edition · Custom security policies

Network and identity

SSO, secure access, internal systems and existing security components are integrated appropriately.

  • VPN Access

    WireGuard, NetBird, Tailscale, Headscale, OpenVPN, Cloudflare Tunnel · Easy client setup for all devices

  • SSO Integration

    Directly or through an upstream identity layer

  • Multi-Factor Auth

    Depends on application, edition and identity provider

  • Firewall & Hardening

    Fail2Ban, Rate Limiting, IP Whitelisting

Monitoring and service level

Updates, backups, technical monitoring and response paths follow a transparent operational scope.

  • 24/7 proactive monitoring

  • Updates and patches

    Regular updates, CVE monitoring and prioritised patches for critical vulnerabilities

  • Daily backup with 7-day retention

  • Personal technical contact

Integration and development

APIs, automation and custom extensions can be delivered beyond basic deployment.

  • Chat & Query API

    Integration of the chatbot into your existing software (intranet, support tool). Your app sends the question, AnythingLLM delivers the answer incl. citations.

  • Custom Data Connectors

    Standard scrapers not enough? We write scripts that extract data from proprietary SQL databases or internal wikis, clean it, and load it into the vector store.

  • Agent Skills

    We give the AI 'hands'. Development of tool definitions allowing the LLM to execute API calls (e.g., 'Book Room X' -> API call to calendar).

Full-service installation with no hidden costs

What the AnythingLLM setup includes

  • Complete installation & configuration
  • SSL certificate & reverse proxy setup
  • Backup strategy & disaster recovery
  • Performance optimization & tuning
  • Security hardening following OWASP
  • Monitoring & logging setup
  • Documentation & best practices
  • Administrator training (remote)
  • 30 days email support included
  • Dedicated contact person
  • Optional integration: LDAP/AD, SSO, MFA
  • Update strategy & patch management setup

The exact scope depends on the application, edition, infrastructure and criticality. Vendor licences and non-standard components are quoted separately.

Use Cases

Using AnythingLLM in your organisation

  • AI-powered Document Chat

    Chat with your documents and receive precise answers based on your own data using RAG technology
  • Knowledge Management

    Centralize company knowledge in workspaces and make it searchable and usable for your entire team through AI
  • Private AI for Enterprises

    Privacy-focused AI solution without data transfer to third parties - ideal for regulated industries and privacy-critical applications
  • Team Collaboration with AI

    Multi-user support with workspace management, granular permissions and role-based access control for efficient teamwork
  • Flexible LLM Selection

    Use local models (Ollama, LM Studio) or cloud-based LLMs (OpenAI, Azure, Anthropic) according to your requirements
  • Data Sovereignty & Compliance

    Control over data location and access and AI models for healthcare, finance, government agencies and other regulated industries

Concrete Use Cases

AnythingLLM Development & Integration

AnythingLLM is the operating system for your private documents. We extend it so it reads documents and actively intervenes in your processes.

L1 Support Automation

Problem

Support is overloaded with recurring questions about manuals.

Solution

Embedding an AnythingLLM bot in the helpdesk. It immediately suggests relevant passages from technical docs to the agent based on the customer question.

Automated Knowledge Sync

Problem

Knowledge becomes obsolete quickly. Manually uploading PDFs doesn't scale.

Solution

Cronjob scripts that detect changes in Sharepoint/Confluence nightly and incrementally update the vector index.

Managed Hosting & Operations

How much does AnythingLLM hosting cost?

Compute, applications, storage and response are shown separately. You can see what ongoing operations include and which requirements need a technical assessment.

Starter workload from€99.90/ month · cancel monthlyWith a minimum term: 10% reduction on operations and hosting with 6 months, 20% with 12 months, payment monthly, half-yearly or yearly

AnythingLLM hosting in Germany: GDPR-compliant operations

  • One managed standard application included
  • .de domain included or your own domain or subdomain via CNAME
  • Choice of location: Germany (ISO 27001, BSI C5), Switzerland (ISO 27001) or Austria (ISO 27001), each within the scope of the data centre operator
  • Confidentiality agreement under Section 203 German Criminal Code (StGB) available on request (location Germany) New
  • Confidential compute VM optional, price on request New
  • 99.9 % standard availability per month
  • Regular updates, CVE monitoring and prioritised patches for critical vulnerabilities
  • Central logs with immutable retention
  • Daily backup with 7-day retention
  • 5 TB outbound traffic per workload and month
  • 24/7 proactive monitoring
  • Five service levels, 24/7 P1 response with Production or Critical
  • Personal technical contact

Instance sizes and monthly prices

XS · 2 vCPU, 2 GB RAM, 40 GB NVMe SSD
€99.90 in total
S · 2 vCPU, 4 GB RAM, 80 GB NVMe SSD
€129.90 in total
M · 4 vCPU, 8 GB RAM, 80 GB NVMe SSD
€159.80 in total
L · 8 vCPU, 16 GB RAM, 80 GB NVMe SSD
€219.80 in total
XL · 16 vCPU, 32 GB RAM, 80 GB NVMe SSD
€329.80 in total
Additional storage per 50 GB
+€4.99

Straightforward provisioning within a few business days

Payment
  • SEPA direct debit
  • Visa
  • Mastercard
  • American Express
  • Apple Pay
  • Google Pay
  • PayPal
  • Bank transfer

All prices are net and exclude statutory VAT. The offers are addressed to businesses. All on-premises options

Service levels

Five service levels for different operating requirements

Response target = initial technical response to critical incidents (P1) · Price and flexible operations allowance per customer environment and month · Hourly rate for additional work

  1. Essential

    Next business dayby end of dayInitial technical response to critical incidents (P1) by the end of the next business day

    includedin the base operations price

    no allowance
    Hourly rate
    5% below standard
    regular service hours
    €114
    outside regular service hours
    €228

    For less time-critical systems, staging and internal applications.

  2. Business

    Popular

    4 hwithin service hoursInitial technical response to critical incidents (P1) within 4 service hours

    +€99.90

    0.5 h allowance
    Hourly rate
    10% below standard
    regular service hours
    €108
    outside regular service hours
    €216

    For production systems without contractual night and weekend on-call coverage.

  3. Priority

    1 hwithin service hoursInitial technical response to critical incidents (P1) within 1 service hour

    +€199.90

    1 h allowance
    Hourly rate
    15% below standard
    regular service hours
    €102
    outside regular service hours
    €204

    For business-critical systems requiring a fast response during the service window.

  4. Production

    60 minnights and weekends includedInitial technical response to critical incidents (P1) within 60 minutes, 24/7

    +€349.90

    1 h allowance
    Hourly rate
    20% below standard
    regular service hours
    €96
    outside regular service hours
    €192

    24/7 P1 on-call coverage for business-critical production environments.

  5. Critical

    after audit

    30 minnights and weekends includedInitial technical response to critical incidents (P1) within 30 minutes, 24/7

    +€549.90

    2 h allowance
    Hourly rate
    25% below standard
    regular service hours
    €90
    outside regular service hours
    €180

    Available after audit, runbook and capacity approval.

Business, Priority, Production and Critical include the first covered workload in a customer environment. Further covered workloads cost €29.90, €39.90, €49.90 and €59.90 per month respectively. For monitoring-only servers, we notify within the level's window for €14.90, €19.90, €24.90 and €29.90 per server and month respectively; without a service level, during service hours.

The flexible operations allowance applies to planned work during regular service hours and expires at month end. Operations, monitoring, backups, maintenance and updates within the agreed scope do not reduce it. Additional work beyond the agreed operations and the allowance, as well as further incident work, is billed at the hourly rate of the service level of the affected environment. The standard rate applies to commissioned work without a service level. Hour packages and fixed prices have their own prices. All prices are net and exclude statutory VAT. The offers are addressed to businesses.

SLA & Service Levels →

Target architecture

Integrate AnythingLLM into your infrastructure with clear controls

AI applications need controlled model access, knowledge sources, permissions and observability in addition to the user interface. We design these data flows as one coherent stack.

Users and connected applications

Teams, business applications and API clients use defined interfaces and endpoints.

Secure access

TLS, firewall rules, reverse proxies or private network paths are designed around the platform's exposure.

Identity and permissions

Local accounts, SSO, directories, service accounts and emergency access are connected through clear roles.

AnythingLLM platform

Application logic, model access, roles and approved capabilities run in a controlled environment.

Models and compute

Local or external models, GPU/CPU resources, routing, limits and cost controls.

Knowledge and data

Documents, databases, vector search and traceable data paths for RAG and search.

Tools and observability

Reviewed tools, APIs, logging, metrics and technical quality controls.

Models, extensions and data sources are not enabled indiscriminately. Permissions, data exposure, cost and professional oversight are assessed per use case.

Role in the overall system

Related services for AnythingLLM

This page covers installation and the agreed platform operations for AnythingLLM. Custom code, the access layer and special confidentiality requirements remain clearly separated responsibilities that can be added when needed.

Three relevant adjacent paths instead of a long list of further products.

View the overall system

Frequently Asked Questions

Answers to the most important questions

Knowledge

More about AnythingLLM

Reviews & projects

Client feedback and projects worldwide

Networking & Provisioning

WZ-IT moved our studio infrastructure from decentralised individual devices to a central platform: every site is securely connected via VPN, new devices are onboarded automatically and an entire site is provisioned from a template, without manual steps on location. What impressed me most is the breadth and depth of their knowledge: Timo and Robin are not a typical IT provider who sets up a server and leaves. The two of them think their way into highly complex infrastructure and software topics, work through every requirement we put in front of them, and build networking, provisioning and operations so that everything fits together in the end. WZ-IT is an excellent partner for complex software, network and architecture projects.
Steve KirchnerManaging Director, nextGYM GmbH
View project

International

Built in Germany's Ruhr Valley. Running worldwide.

WZ-IT designs, develops and operates infrastructure and software for clients in Germany and internationally. We deliver projects remotely and continue supporting them in ongoing operations after go-live.

Selected projects

Read client reviews

Managed Hosting & Operations

Enquire about hosting and operations for AnythingLLM

Briefly describe the current state and objective for AnythingLLM. We assess infrastructure, integration, and ongoing operations.

  • Straight with Timo and Robin - no sales team, no pitch
  • A professional assessment of your situation
  • Concrete next steps for infrastructure, software or AI

The conversation is free and non-binding.

WZ-IT's advice on our Azure migration was technically sound and completely non-binding right from the intro call - we took away a great deal.
Jakob ÖschlbergerInno7 GmbH
Timo and Robin, founders of WZ-IT

Which AnythingLLM service do you need?

Choose the appropriate starting point or simply describe the situation.

We usually respond within one business day. Please do not submit credentials.

WZ-IT's advice on our Azure migration was technically sound and completely non-binding right from the intro call - we took away a great deal.
Jakob ÖschlbergerInno7 GmbH