[email protected]
DEEN

PrivateGPT Hosting in Germany

WZ-IT runs PrivateGPT as a dedicated instance in German data centres, with updates, daily backups, 24/7 monitoring and a personal contact. On request, we also install PrivateGPT in your cloud or on premises.

Request hostingHosting & pricing
Reviews
Cloud Wolke HerausforderungServer NachhaltigkeitIT Beratung Service Consulting SoforthilfeTimo Wevelsiep Robin ZinsExperten für Innovation Migration AWSHetzner Hosting zuverlässig

Companies worldwide trust WZ-IT

  • Stadtwerke Brühl
  • DGHO e.V.
  • ABCO Water Systems
  • Golem.de
  • EVADXB
  • nextGYM
  • AInergy
  • ml&s
  • Odiseo Solutions
  • Annota
  • ARGE
  • SweetConnect GmbH
  • Aphy AG
  • CORGOS
  • Rekorder
  • SolidProof
  • Yonju
  • Keymate
  • Paritel
  • Mr. Clipart
  • Millenium
  • Negosh
  • Führerscheinmacher
  • Boese VA
Read client reviews

About the technology

What is PrivateGPT?

PrivateGPT provides building blocks for document-based RAG applications using large language models. Document processing, retrieval and model access can run locally; when remote LLM or embedding providers are used, the content sent to them is processed externally.

The platform supports local and remote model providers. We therefore design data flows, model access, vector storage and permissions for the required protection level instead of treating self-hosting as automatic privacy compliance.

GitHubWebsiteOfficial Documentation

Features

  • Controllable data flows

    Documents, embeddings and model requests can remain in your environment with an entirely local configuration. External providers are assessed and approved as separate data flows.

  • Complete RAG Pipeline

    RAG pipeline with document parsing, splitting, metadata, embeddings and chunk retrieval. Result quality and source grounding are tested against the concrete corpus.

  • OpenAI API Compatible

    FastAPI-based architecture with OpenAI-compatible endpoints. Required parameters, streaming, tool and client capabilities are tested by version and adapted where needed.

  • Fully Local Operation

    Can be operated completely offline and locally - on-premise, in your private cloud, or air-gapped environment. No dependency on external cloud services.

  • Flexible LLM Provider Support

    Supports local providers (Ollama, LlamaCPP) and remote providers (OpenAI, Azure OpenAI, Sagemaker, etc.). Flexibly switch between different models.

  • Intelligent Document Ingestion

    Document processing with parsing, chunking, metadata and embeddings. Result quality and supported formats depend on version, parsers and configuration.

  • Control over data location and access

    A local design can control storage locations, identities and network paths. Legal compliance additionally depends on the use case and connected services.

  • Open source

    The publicly available source code is licensed under Apache 2.0 and can be reviewed and adapted. Models and other dependencies are assessed separately.

  • No Vendor Lock-in

    Based on LlamaIndex framework. Free choice between different LLM providers, vector databases, and deployment models without dependency on individual vendors.

Infrastructure, integration and operations

PrivateGPT as part of your infrastructure

We do more than provide an application. WZ-IT designs the technical architecture, integrates network and identity, operates the agreed scope and develops integrations when the standard product is not enough.

Architecture and migration

Sizing, target environment, data transfer, cutover and recovery are resolved before production operations.

  • On-Premise

    In your data center: Installation on bare-metal, VM or Docker · Integration with existing Active Directory/LDAP

  • Cloud Installation

    AWS, Azure, Hetzner & more: Installation on AWS, Azure, GCP, Hetzner · Terraform/IaC setup (optional) · Kubernetes or Docker Compose · Capacity and scaling design

  • Enterprise Setup

    Advanced architecture after technical and licence assessment: HA and recovery design where supported by the application and edition · Logging according to feature set and edition · Custom security policies

Network and identity

SSO, secure access, internal systems and existing security components are integrated appropriately.

  • VPN Access

    WireGuard, NetBird, Tailscale, Headscale, OpenVPN, Cloudflare Tunnel · Easy client setup for all devices

  • SSO Integration

    Directly or through an upstream identity layer

  • Multi-Factor Auth

    Depends on application, edition and identity provider

  • Firewall & Hardening

    Fail2Ban, Rate Limiting, IP Whitelisting

Monitoring and service level

Updates, backups, technical monitoring and response paths follow a transparent operational scope.

  • 24/7 proactive monitoring

  • Updates and patches

    Regular updates, CVE monitoring and prioritised patches for critical vulnerabilities

  • Daily backup with 7-day retention

  • Personal technical contact

Integration and development

APIs, automation and custom extensions can be delivered beyond basic deployment.

  • REST API

    Via the API we connect PrivateGPT to your systems: Chat completion, document ingest, and context retrieval can be controlled programmatically.

  • Document Processing

    We develop custom ingestion pipelines: Special document types (CAD, contracts, code) are processed with optimized chunking strategies.

  • LlamaIndex Extensions

    The LlamaIndex backend allows deep customization: Custom retrievers, rerankers, and embedding models for domain-specific search.

Full-service installation with no hidden costs

What the PrivateGPT setup includes

  • Complete installation & configuration
  • SSL certificate & reverse proxy setup
  • Backup strategy & disaster recovery
  • Performance optimization & tuning
  • Security hardening following OWASP
  • Monitoring & logging setup
  • Documentation & best practices
  • Administrator training (remote)
  • 30 days email support included
  • Dedicated contact person
  • Optional integration: LDAP/AD, SSO, MFA
  • Update strategy & patch management setup

The exact scope depends on the application, edition, infrastructure and criticality. Vendor licences and non-standard components are quoted separately.

Use Cases

Using PrivateGPT in your organisation

  • Locally operated document AI

    Search confidential documents in a controlled environment; data flows, model access and telemetry are configured for your architecture

  • GDPR & Compliance

    Controllable data flows for organisations with elevated protection needs; legal and domain requirements are assessed per project

  • RAG Pipeline Implementation

    Production-ready RAG with intelligent document parsing, embeddings generation and context-based chunk retrieval for precise answers

  • Multi-LLM Support

    Flexible use of local LLMs (Ollama, LlamaCPP) or remote providers (OpenAI, Azure OpenAI, Gemini) depending on requirements

  • Air-Gapped Deployment

    Fully operable offline for layered security controls requirements, isolated networks and air-gapped environments without external dependencies

  • OpenAI API Compatibility

    FastAPI-based architecture with OpenAI-compatible API for seamless integration into existing tools and workflows without code changes

Concrete Use Cases

PrivateGPT Development & Integration

PrivateGPT enables local LLM usage with your own documents. We integrate it into your existing infrastructure and extend capabilities.

Air-Gapped Deployment

Problem

Highly sensitive environments (government, defense) cannot have cloud connections but need LLM capabilities.

Solution

Fully offline-capable setup with local models, own embeddings, and airgapped update mechanisms.

Legal Document Discovery

Problem

Lawyers need to search thousands of documents for relevant passages. Manual review takes weeks.

Solution

PrivateGPT with legally optimized chunking and retrieval. Questions in natural language, answers with source references.

Email Assistant

Problem

Executives receive hundreds of emails daily. Summaries and prioritization are needed.

Solution

PrivateGPT integration that analyzes, summarizes, and categorizes emails by urgency - fully on-premise.

Managed Hosting & Operations

How much does PrivateGPT hosting cost?

Compute, applications, storage and response are shown separately. You can see what ongoing operations include and which requirements need a technical assessment.

Starter workload from€99.90/ month · cancel monthly

PrivateGPT hosting in Germany: GDPR-compliant operations

  • One managed standard application included
  • .de domain included or your own domain or subdomain via CNAME
  • German data centres with ISO 27001 and BSI C5, no US clouds
  • 99.9 % standard availability per month
  • Regular updates, CVE monitoring and prioritised patches for critical vulnerabilities
  • Central logs with immutable retention
  • Daily backup with 7-day retention
  • 5 TB outbound traffic per workload and month
  • 24/7 proactive monitoring
  • Five service levels, 24/7 P1 response with Production or Critical
  • Personal technical contact

Instance sizes and monthly prices

XS · 2 vCPU, 2 GB RAM, 40 GB NVMe SSD
€99.90 in total
S · 2 vCPU, 4 GB RAM, 80 GB NVMe SSD
€129.90 in total
M · 4 vCPU, 8 GB RAM, 80 GB NVMe SSD
€159.80 in total
L · 8 vCPU, 16 GB RAM, 80 GB NVMe SSD
€219.80 in total
XL · 16 vCPU, 32 GB RAM, 80 GB NVMe SSD
€329.80 in total
Additional storage per 50 GB
+€4.99
Configure now

Typically provisioned within a few business days after signing

Payment
  • SEPA direct debit
  • Visa
  • Mastercard
  • American Express
  • Apple Pay
  • Google Pay
  • PayPal
  • Bank transfer

All prices are net and exclude statutory VAT. The offers are addressed to businesses. All on-premises options

Other options

Try it free for 7 days

Request a test instance

We set up a test instance for you, usually on the next business day. No payment details required. After seven days it is deleted unless you continue.

Request a test instance →Bring Your Own Infrastructure

Installation on Your Infrastructure

Installation on your own infrastructure · On-premise or in your cloud · Control over data location and access · Custom configuration · Complete documentation · Initial setup & configuration · Optional support and maintenance contract

Price on request, plus optional support & maintenanceRequest a proposal →On-premises option

Run PrivateGPT on hardware at your organisation

As an alternative to managed hosting in the data centre, WZ-IT provides the hardware, configures PrivateGPT, and handles hardening, monitoring, updates, backup and technical support. Access can be limited to the internal network or enabled through VPN and existing identities.

from €349 excl. VAT / month · plus one-time provisioning and initial setupView WZ-IT App Node →

Target architecture

Integrate PrivateGPT into your infrastructure with clear controls

AI applications need controlled model access, knowledge sources, permissions and observability in addition to the user interface. We design these data flows as one coherent stack.

Users and connected applications

Teams, business applications and API clients use defined interfaces and endpoints.

Secure access

TLS, firewall rules, reverse proxies or private network paths are designed around the platform's exposure.

Identity and permissions

Local accounts, SSO, directories, service accounts and emergency access are connected through clear roles.

PrivateGPT platform

Application logic, model access, roles and approved capabilities run in a controlled environment.

Models and compute

Local or external models, GPU/CPU resources, routing, limits and cost controls.

Knowledge and data

Documents, databases, vector search and traceable data paths for RAG and search.

Tools and observability

Reviewed tools, APIs, logging, metrics and technical quality controls.

Models, extensions and data sources are not enabled indiscriminately. Permissions, data exposure, cost and professional oversight are assessed per use case.

Powered by WZ-IT

Local AI server or custom GPU infrastructure

The AI Cube covers the compact entry point. For larger models, rackmount or high concurrency, we design custom GPU systems.

Managed GPU Servers

Dedicated NVIDIA GPU servers in Germany including an agreed model, vLLM inference layer, Open WebUI and ongoing managed operations.

  • 20 or 96 GB of dedicated GPU memory
  • 24/7 monitoring with selectable service level
  • Model, vLLM and Open WebUI included
  • Server location Germany
Explore GPU Servers

AI Cube

Compact NVIDIA GB10-based local AI server. Fully configured, hardened and prepared with a local model agreed in advance.

  • 128 GB unified memory
  • Open WebUI and local model runtime
  • Base setup and hardening included
  • Initial setup and support included
View local AI server

Role in the overall system

Related services for PrivateGPT

This page covers installation and the agreed platform operations for PrivateGPT. Custom code, the access layer and special confidentiality requirements remain clearly separated responsibilities that can be added when needed.

Maintain the application

Support custom code and integrations

Keep custom extensions, interfaces and dependencies controlled, updated and supportable.

View service Secure access

Connect users, sites and systems

Add identity-based access and private network paths as a separate operational layer.

View service Operate confidentially

Assess Section 203 requirements separately

For professional secrecy holders, define contractual, access and infrastructure requirements in a dedicated operating model.

View service

Three relevant adjacent paths instead of a long list of further products.

View the overall system

Frequently Asked Questions

Answers to the most important questions

Knowledge

More about PrivateGPT

Tutorials & guides

Matching solutions for your project

Reviews & projects

Client feedback and projects worldwide

WZ-IT moved our studio infrastructure from decentralised individual devices to a central platform: every site is securely connected via VPN, new devices are onboarded automatically and an entire site is provisioned from a template, without manual steps on location. What impressed me most is the breadth and depth of their knowledge: Timo and Robin are not a typical IT provider who sets up a server and leaves. The two of them think their way into highly complex infrastructure and software topics, work through every requirement we put in front of them, and build networking, provisioning and operations so that everything fits together in the end. WZ-IT is an excellent partner for complex software, network and architecture projects.
Steve KirchnerManaging Director, nextGYM GmbH
View project

International

Built in Germany's Ruhr Valley. Running worldwide.

WZ-IT designs, develops and operates infrastructure and software for clients in Germany and internationally. We deliver projects remotely and continue supporting them in ongoing operations after go-live.

Selected projects

Read client reviews

  • Secure your Proxmox & backup setup
  • Modernize your infrastructure - sovereign
  • Plan a sovereign open-source stack
  • Integrate a local AI solution
  • Modernize your legacy software
  • Cut cloud cost - up to −81%
  • Build a high-availability Proxmox cluster
  • Virtualize with Managed Proxmox
  • Design an open-source AI architecture
  • Get collaboration fully managed
  • Ship your prototype to production
  • Connect sites and clusters securely

Managed Hosting & Operations

Enquire about hosting and operations for PrivateGPT

Briefly describe the current state and objective for PrivateGPT. We assess infrastructure, integration, and ongoing operations.

  • Straight with Timo and Robin - no sales team, no pitch
  • A professional assessment of your situation
  • Concrete next steps for infrastructure, software or AI

The conversation is free and non-binding.

WZ-IT's advice on our Azure migration was technically sound and completely non-binding right from the intro call - we took away a great deal.
Jakob ÖschlbergerInno7 GmbH
Email[email protected]Phone+49 2922 875068
Timo and Robin, founders of WZ-IT

Which PrivateGPT service do you need?

Choose the appropriate starting point or simply describe the situation.

We usually respond within one business day. Please do not submit credentials.

WZ-IT's advice on our Azure migration was technically sound and completely non-binding right from the intro call - we took away a great deal.
Jakob ÖschlbergerInno7 GmbH