Architecture and migration
Sizing, target environment, data transfer, cutover and recovery are resolved before production operations.
Expertise
PrivateGPT: Managed Hosting, Installation and Operations
WZ-IT plans, installs and operates PrivateGPT as managed hosting, in your cloud or on premises. Depending on the target design, we also provide migration, secure network and identity integration, monitoring, backups, updates, integrations and further development.
Companies worldwide trust WZ-IT
The following are trademarks of their respective owners: PrivateGPT (Zylon by PrivateGPT). WZ-IT is an independent service provider and has no business, partnership, or contractual relationship with these companies. We offer independent migration, installation, hosting, and operations services.
About the Technology
About PrivateGPT
PrivateGPT provides building blocks for document-based RAG applications using large language models. Document processing, retrieval and model access can run locally; when remote LLM or embedding providers are used, the content sent to them is processed externally.
The platform supports local and remote model providers. We therefore design data flows, model access, vector storage and permissions for the required protection level instead of treating self-hosting as automatic privacy compliance.
Self-Hosted
Architecture
Integration
Managed operations
WZ-IT & PrivateGPT
We install, host and operate PrivateGPT either on-premise or on agreed infrastructure in Germany. Local and external model and embedding services are designed as traceable data flows.
We provide 24/7 monitoring, backups and maintenance for your PrivateGPT instance. Human response times and support coverage follow the selected service level. Including support for integrating your preferred LLM providers, document ingestion, and RAG optimization.
Controllable data flows
Documents, embeddings and model requests can remain in your environment with an entirely local configuration. External providers are assessed and approved as separate data flows.
Complete RAG Pipeline
RAG pipeline with document parsing, splitting, metadata, embeddings and chunk retrieval. Result quality and source grounding are tested against the concrete corpus.
OpenAI API Compatible
FastAPI-based architecture with OpenAI-compatible endpoints. Required parameters, streaming, tool and client capabilities are tested by version and adapted where needed.
Fully Local Operation
Can be operated completely offline and locally - on-premise, in your private cloud, or air-gapped environment. No dependency on external cloud services.
Flexible LLM Provider Support
Supports local providers (Ollama, LlamaCPP) and remote providers (OpenAI, Azure OpenAI, Sagemaker, etc.). Flexibly switch between different models.
Intelligent Document Ingestion
Document processing with parsing, chunking, metadata and embeddings. Result quality and supported formats depend on version, parsers and configuration.
Control over data location and access
A local design can control storage locations, identities and network paths. Legal compliance additionally depends on the use case and connected services.
Open source
The publicly available source code is licensed under Apache 2.0 and can be reviewed and adapted. Models and other dependencies are assessed separately.
No Vendor Lock-in
Based on LlamaIndex framework. Free choice between different LLM providers, vector databases, and deployment models without dependency on individual vendors.
You got questions? We are here to help!
Professional Installation Service
PrivateGPT Installation & setup
Professional installation on your infrastructure - on-premise, cloud or hybrid
On-Premise
In your data center
- Installation on bare-metal, VM or Docker
- Optimal performance configuration
- Integration with existing Active Directory/LDAP
- SSL certificate & reverse proxy
- Backup strategy & monitoring
- Security hardening following best practices
- Documentation & training
Cloud Installation
AWS, Azure, Hetzner & more
- Installation on AWS, Azure, GCP, Hetzner
- Terraform/IaC setup (optional)
- Kubernetes or Docker Compose
- Capacity and scaling design
- Reverse proxy and optional platform services
- CloudWatch/monitoring setup
- Cost optimization & best practices
Enterprise Setup
Advanced architecture after technical and licence assessment
- HA and recovery design where supported by the application and edition
- VPN access (e.g. WireGuard, NetBird, Tailscale)
- SSO integration or an upstream identity layer
- MFA through the application or identity provider
- Logging according to feature set and edition
- Backup and recovery design
- Custom security policies
- Dedicated contact person
Use Cases
Using PrivateGPT in your organisation
Locally operated document AI
Search confidential documents in a controlled environment; data flows, model access and telemetry are configured for your architecture
GDPR & Compliance
Controllable data flows for organisations with elevated protection needs; legal and domain requirements are assessed per project
RAG Pipeline Implementation
Production-ready RAG with intelligent document parsing, embeddings generation and context-based chunk retrieval for precise answers
Multi-LLM Support
Flexible use of local LLMs (Ollama, LlamaCPP) or remote providers (OpenAI, Azure OpenAI, Gemini) depending on requirements
Air-Gapped Deployment
Fully operable offline for layered security controls requirements, isolated networks and air-gapped environments without external dependencies
OpenAI API Compatibility
FastAPI-based architecture with OpenAI-compatible API for seamless integration into existing tools and workflows without code changes
Security
Operate PrivateGPT with secure access
Secure access and access control for your installation
VPN Access
WireGuard, NetBird or Tailscale
SSO Integration
Directly or through an upstream identity layer
Multi-Factor Auth
Depends on application, edition and identity provider
Firewall & Hardening
Fail2Ban, Rate Limiting, IP Whitelisting
Secure Access via VPN
We set up secure VPN access to your installation - ideal for remote work and external employees.
- Zero-Trust Network Access (ZTNA)
- Encrypted connections
- Easy client setup for all devices
- Centralized access management
Supported VPN Solutions:
WireGuard
NetBird
Tailscale
Headscale
OpenVPN
Cloudflare Tunnel
Included
What the PrivateGPT setup includes
Full-service installation with no hidden costs
✓ Complete installation & configuration
✓ SSL certificate & reverse proxy setup
✓ Backup strategy & disaster recovery
✓ Performance optimization & tuning
✓ Security hardening following OWASP
✓ Monitoring & logging setup
✓ Documentation & best practices
✓ Administrator training (remote)
✓ 30 days email support included
✓ Dedicated contact person
✓ Optional integration: LDAP/AD, SSO, MFA
✓ Update strategy & patch management setup
Architecture & Interfaces
PrivateGPT Development & Integration
PrivateGPT enables local LLM usage with your own documents. We integrate it into your existing infrastructure and extend capabilities.
REST API
Via the API we connect PrivateGPT to your systems: Chat completion, document ingest, and context retrieval can be controlled programmatically.
Document Processing
We develop custom ingestion pipelines: Special document types (CAD, contracts, code) are processed with optimized chunking strategies.
LlamaIndex Extensions
The LlamaIndex backend allows deep customization: Custom retrievers, rerankers, and embedding models for domain-specific search.
Concrete Use Cases
How we implement PrivateGPT development in practice.
Air-Gapped Deployment
Problem
Highly sensitive environments (government, defense) cannot have cloud connections but need LLM capabilities.
Solution
Fully offline-capable setup with local models, own embeddings, and airgapped update mechanisms.
Legal Document Discovery
Problem
Lawyers need to search thousands of documents for relevant passages. Manual review takes weeks.
Solution
PrivateGPT with legally optimized chunking and retrieval. Questions in natural language, answers with source references.
Email Assistant
Problem
Executives receive hundreds of emails daily. Summaries and prioritization are needed.
Solution
PrivateGPT integration that analyzes, summarizes, and categorizes emails by urgency - fully on-premise.
Infrastructure, integration and operations
PrivateGPT as part of your infrastructure
We do more than provide an application. WZ-IT designs the technical architecture, integrates network and identity, operates the agreed scope and develops integrations when the standard product is not enough.
Network and identity
SSO, secure access, internal systems and existing security components are integrated appropriately.
Monitoring and service level
Updates, backups, technical monitoring and response paths follow a transparent operational scope.
Integration and development
APIs, automation and custom extensions can be delivered beyond basic deployment.
The exact scope depends on the application, edition, infrastructure and criticality. Vendor licences and non-standard components are quoted separately.
Target architecture
Integrate PrivateGPT into your infrastructure with clear controls
AI applications need controlled model access, knowledge sources, permissions and observability in addition to the user interface. We design these data flows as one coherent stack.
Users and connected applications
Teams, business applications and API clients use defined interfaces and endpoints.
Secure access
TLS, firewall rules, reverse proxies or private network paths are designed around the platform's exposure.
Identity and permissions
Local accounts, SSO, directories, service accounts and emergency access are connected through clear roles.
PrivateGPT platform
Application logic, model access, roles and approved capabilities run in a controlled environment.
Models and compute
Local or external models, GPU/CPU resources, routing, limits and cost controls.
Knowledge and data
Documents, databases, vector search and traceable data paths for RAG and search.
Tools and observability
Reviewed tools, APIs, logging, metrics and technical quality controls.
Models, extensions and data sources are not enabled indiscriminately. Permissions, data exposure, cost and professional oversight are assessed per use case.
Managed Hosting & Operations
PrivateGPT hosting in Germany: GDPR-compliant operations
Managed Hosting
Hosting and ongoing operations
A clearly defined operating scope instead of an opaque hosting flat fee.
One managed standard application included
Dedicated compute workload in S, M, L or XL
Subdomain on wz-it.cloud included
German provider, German data centres, no US clouds
ISO 27001-certified and BSI C5-attested data centres
99.9 % standard availability per month
CVE and security-advisory monitoring for the operating system and managed application, regular updates, and priority deployment of available patches for critical vulnerabilities
Central collection of agreed system and operations logs with immutable retention
Daily backup with 7-day retention
5 TB outbound traffic per workload and month
24/7 proactive monitoring
Five clearly separated service levels
24/7 P1 response with Production or Critical
Personal technical contact
Starter workload from
€129.90/ month
Try it free for 7 days
We set up a test instance for you, usually on the next business day. No payment details required. After seven days it is deleted unless you continue.
Modular pricing based on your requirements - service level, apps and compute selectable individually.
DCs
ISO 27001 / BSI C5
24/7
Monitoring
GDPR
requirements
What managed hosting covers
Compute, applications, storage and response are shown separately. You can see what ongoing operations include and which requirements need a technical assessment.
Bring Your Own Infrastructure
Installation on Your Infrastructure
Installation on your own infrastructure
On-premise or in your cloud
Control over data location and access
Custom configuration
Complete documentation
Initial setup & configuration
Optional support and maintenance contract
Price on request
plus optional support & maintenance
Looking for a custom solution?
We also design custom PrivateGPT architectures, integrations and migrations. Contact us for a technical assessment.
Calculator
How much does hosting for PrivateGPT cost?
One managed standard PrivateGPT application is included in the Starter workload. Business and higher levels add a flexible operations allowance for planned work during regular service hours. Select compute, additional applications, storage and the appropriate service level.
Workloads
A workload is one compute instance with the applications agreed for it.
Additional standard applications
One standard app per workload is already included. Additional dedicated servers count as separate workloads.
Additional block storage
€7.99 excl. VAT per additional 100 GB per month, including daily encrypted offsite backup with 7-day retention. Billing is based on provisioned capacity, not actual usage.
GB
Custom backup retention
We also implement custom backup schedules and retention periods. For example: daily backups retained for 30 days and one monthly backup retained for 12 months. Scope, storage requirements and additional costs are agreed separately.
Availability configuration
Assessed individually; custom quote.
Standard hosting runs on a single instance without high availability. Availability for custom architectures is agreed separately.
Zero downtime on request
Distributed operation with several instances, a database cluster and rolling updates, so that a node failure causes no interruption. Only for applications suited to it; design and price after technical assessment.
Role in the overall system
Related services for PrivateGPT
This page covers installation and the agreed platform operations for PrivateGPT. Custom code, the access layer and special confidentiality requirements remain clearly separated responsibilities that can be added when needed.
Maintain the application
Support custom code and integrations
Keep custom extensions, interfaces and dependencies controlled, updated and supportable.
from €699.90 excl. VAT / month
View serviceSecure access
Connect users, sites and systems
Add identity-based access and private network paths as a separate operational layer.
from €349.90 excl. VAT / month
View serviceOperate confidentially
Assess Section 203 requirements separately
For professional secrecy holders, define contractual, access and infrastructure requirements in a dedicated operating model.
from €499.90 excl. VAT / month
View serviceThree relevant adjacent paths instead of a long list of further products.
All prices are net and exclude statutory VAT. The offers are addressed to businesses.
View the overall systemEnquiry
Enquire about hosting and operations for PrivateGPT
Briefly describe the current state and objective for PrivateGPT. We assess infrastructure, integration, and ongoing operations.
Powered by WZ-IT
Local AI server or custom GPU infrastructure
The AI Cube covers the compact entry point. For larger models, rackmount or high concurrency, we design custom GPU systems.
Managed GPU Servers
Dedicated NVIDIA GPU servers in Germany including an agreed model, vLLM inference layer, Open WebUI and ongoing managed operations.
- 20 or 96 GB of dedicated GPU memory
- 24/7 monitoring with selectable service level
- Model, vLLM and Open WebUI included
- Server location Germany
AI Cube
Compact NVIDIA GB10-based local AI server. Fully configured, hardened and prepared with a local model agreed in advance.
- 128 GB unified memory
- Open WebUI and local model runtime
- Base setup and hardening included
- Initial setup and support included
On-premises option
Run PrivateGPT on hardware at your organisation
As an alternative to managed hosting in the data centre, WZ-IT provides the hardware, configures PrivateGPT, and handles hardening, monitoring, updates, backup and technical support. Access can be limited to the internal network or enabled through VPN and existing identities.
from EUR 349 excl. VAT / month · plus one-time provisioning and initial setup
Similar & Complementary
Matching Solutions for Your Project
Complementary Technologies
These solutions are often used together with PrivateGPT
Qdrant
Apache-2.0 vector database for RAG, semantic search, hybrid search and production retrieval pipelines
LiteLLM
Multi-LLM gateway with OpenAI-compatible API, provider routing, fallbacks, budgets and virtual keys
vLLM
High-performance inference and serving engine for large language models with high concurrency.
Similar Technologies
These solutions offer similar functionalities and can be evaluated together
Open WebUI
User-friendly web interface for LLMs with RAG pipeline, document chat, and Ollama integration
AnythingLLM
Full-stack AI application for documents and agents with support for multiple LLM providers
Ollama
Local LLM inference engine for sovereign AI stacks with model management and OpenAI-compatible workflows
Alternative Solutions
These solutions are direct alternatives with similar use cases
Free intro call
Let's talk about your project - honest and no strings attached
- Straight with Timo and Robin - no sales team, no pitch
- An honest take, including when we are not the right fit
- Concrete next steps for infrastructure, software or AI
No risk: worst case, you leave with a clearer understanding of your project than before.
“WZ-IT's advice on our Azure migration was technically sound and completely non-binding right from the intro call - we took away a great deal.”
Reviews
Selected customers and projects in Germany and internationally
GermanyNetworking & ProvisioningVPNAutomationOperations
“WZ-IT moved our studio infrastructure from decentralised individual devices to a central platform: every site is securely connected via VPN, new devices are onboarded automatically and an entire site is provisioned from a template, without manual steps on location. What impressed me most is the breadth and depth of their knowledge: Timo and Robin are not a typical IT provider who sets up a server and leaves. The two of them think their way into highly complex infrastructure and software topics, work through every requirement we put in front of them, and build networking, provisioning and operations so that everything fits together in the end. WZ-IT is an excellent partner for complex software, network and architecture projects.”
Steve Kirchner
Managing Director, nextGYM GmbH
GermanyProxmox & BackupProxmoxBackupDocumentation
“Professional, honest and technically thoroughly sound: WZ-IT set up our Proxmox and backup infrastructure securely and future-proof. The consulting from Timo and Robin was objective and needs-driven, the implementation smooth and the final documentation exemplary. You can tell immediately that business-critical infrastructure is thought through holistically from the outset here and implemented with clear ownership.”
Pascal Block
Project Manager, Stadtwerke Brühl GmbH
Stadtwerke Brühl - municipal energy and infrastructure utility.
GermanyInfrastructure ModernizationData SovereigntyGDPRDocumentation
“Communication with WZ-IT was open, friendly and professional from the very beginning. Mr. Wevelsiep and Mr. Zins responded to every one of our questions patiently, promptly and respectfully, and contributed their own suggestions and good ideas on how to modernize our server infrastructure and adapt it even better to our needs. Throughout, WZ-IT consistently kept our need for data sovereignty and GDPR compliance in mind. Even short-notice adjustments and change requests from our side were implemented quickly and patiently and integrated consistently into the overall concept. From planning to the final handover, every step was documented transparently and comprehensively - so if a provider change should ever become necessary, the documentation would let us onboard a successor into our infrastructure very quickly. We are extremely satisfied with WZ-IT and hope to continue working together for a long time.”
Christoph Mußmann
Project Officer, DGHO e.V.
DGHO - German Society for Hematology and Medical Oncology.
GermanyArchitecture ConsultingSovereign Software SelectionOpen Source Strategy
“I got to know Timo and Robin as dedicated and professional partners who make a lot of things possible for their clients that initially seem impossible. I felt very well advised. The services offered have thoroughly convinced me. (translated)”
Andrea Pawlowski
Communications Manager, Golem.de
Golem.de - leading German IT news outlet.
H
GermanyLocal AI IntegrationTechnical IntegrationImplementation
“While looking for a partner to integrate a local AI solution, we came across Timo and Robin - and could not have made a better decision. They quickly understood our requirements and solved technical challenges competently and pragmatically. We were particularly impressed by the straightforward collaboration, their high level of expertise and the speed of implementation. We are delighted to have Timo and Robin at our side as reliable business partners and look forward to our next projects together. (translated)”
Henrik Jeche
Head of IT Administration
ml&s - full-service provider for the electronics industry.
GermanySoftware DevelopmentPHP ModernizationAPI Extension
“With Timo and Robin, you're not only on the safe side technically - you also get the best human support! Whether it's quick help in everyday life or complex IT solutions: the guys from WZ-IT think along with you, act quickly and speak a language you understand. The collaboration is uncomplicated, reliable and always on an equal footing. That makes IT fun - and above all: it works! Big thank you to the team! (translated)”
Sonja Aßer
Data Manager, ARGE
ARGE Neue Medien - master data & digital standards for plumbing and building technology.
UAECloud MigrationAWS ExitProxmox81% Cost Reduction
“I recently worked with Timo and the WZ-IT team, and honestly, it turned out to be one of the best tech decisions I have made for my business. Right from the start, Timo took the time to walk me through every step in a simple and calm way. No matter how many questions I had, he never rushed me. The results speak for themselves. With WZ-IT, we reduced our monthly expenses from $1,300 down to $250. This was a huge win for us.”
Aleksandr Shuliko
CTO, EVA Real Estate
EVA Real Estate - leading real-estate agency in Dubai.
SwitzerlandManaged ProxmoxClusterMonitoringHigh Availability
“WZ-IT manages our Proxmox cluster reliably and professionally. The team handles continuous monitoring and regular updates for us and responds very quickly to any issues or inquiries. They also configure new nodes, systems, and applications that we need to add to our cluster. With WZ-IT's proactive support, our cluster and the business-critical applications running on it remain stable, and high availability is consistently ensured. We value the professional collaboration and the noticeable relief it brings to our daily operations.”
Pascal Hakkers
Aphy AG
Aphy AG - AI platform for hotel back-office.
GermanyProxmox & VirtualizationBackupVPNSecurity
“WZ-IT provided very competent support in implementing our server and virtualization infrastructure. As part of the project, a Proxmox-based virtualization environment was set up along with a virtual machine for our application systems. Additionally, a structured backup concept was implemented. A particular focus was on security: the setup of a VPN tunnel and the clean implementation of encryption and access concepts were professionally executed. The structured consulting as well as the reliable and swift implementation deserve special mention. We are very satisfied with the services provided and are happy to recommend WZ-IT.”
John Hellmerichs
Managing Director, AInergy GmbH
AInergy - consultancy for energy and facility management.
GermanyOpen Source ArchitectureImplementationTechnical Consulting
“We have had very good experiences with Mr. Wevelsiep and WZ-IT. The consultation was professional, clearly understandable, and at fair prices. The team not only implemented our requirements but also thought along and proactively. Instead of just processing individual tasks, they provided us with well-founded explanations that strengthened our own understanding. WZ-IT took a lot of pressure off us with their structured approach - that was exactly what we needed and is the reason why we keep coming back. (translated)”
Matthias Zimmermann
Managing Director, Annota GmbH
Annota - healthtech startup with an AI documentation assistant.
BulgariaSovereign CollaborationOpen Source StackOperationsMaintenance
“Timo and Robin from WZ-IT set up a RocketChat server for us - and I couldn't be more satisfied! From the initial consultation to the final implementation, everything was absolutely professional, efficient, and to my complete satisfaction. I particularly appreciate the clear communication, transparent pricing, and the comprehensive expertise that both bring to the table. Even after the setup, they take care of the maintenance, which frees up my time enormously and allows me to focus on other important areas of my business - with the good feeling that our IT is in the best hands. I can recommend WZ-IT without reservation and look forward to continuing our collaboration! (translated)”
Sebastian Maier
Managing Director, Yonju GmbH
Yonju - business coaching and AI products.
SpainProduction DeploymentCI/CDPaaSOperations
“Counting on WZ-IT team was crucial, their expertise and solutions gave us the pace to deploy in production our services, even suggesting and performing improvements over our configuration and setup. We expect to keep counting on them for continuous maintenance of our services and implementation of new solutions.”
Gabriel Sanz Señor
Managing Director, Odiseo Solutions
Odiseo Solutions - software engineering for the space industry.
GermanyNetBird & KubernetesNetBirdKubernetesConsulting
“WZ-IT supported us professionally with the provisioning and setup of NetBird. Alongside the technical implementation, we also received well-founded advice on connecting our Kubernetes clusters. The recommendations were concrete and directly actionable. The collaboration was consistently reliable, fast and on equal terms. We can recommend WZ-IT without reservation.”
Kai Clauß
Head of Development, SweetConnect GmbH
SweetConnect - cross-manufacturer Industry 4.0 platform for confectionery production.
Contact
Let's Talk About Your Idea
Whether a specific IT challenge or just an idea - we look forward to the exchange. In a brief conversation, we'll evaluate together if and how your project fits with WZ-IT.
Arrange a callback
Companies worldwide trust WZ-IT
1/3 - Topic Selection33%